20
Gender-Based Real-Time Face Beautifier Using RenderScript 7/9/2014 1 ThunderSoft Confidential Chen Ji
Gender-Based Real-Time Face Beautifier
Using RenderScript
7/9/2014 1 ThunderSoft Confidential
Chen Ji
❖ Company Introduction
❖ Algorithm Introduction
❖ Optimization Experience
❖ Discussion
Agenda
7/9/2014 2 ThunderSoft Confidential
Company Introduction
Company Profile
Providing leading hardware design and mobile OS technology to reduce Development Costs and Shorten Time-to-Market.
‣ Founded in March 2008
‣ 1200+ experienced Hardware/Software engineers
‣ Provide Hardware + Software One-stop Solution
‣ Target for Smart Connected Devices
‣ Solid partnership with Global Companies
Global
‣ Headquarter in Beijing
‣ 4 R&D center in Beijing, Nanjing,
Chengdu and Hangzhou
‣ 6 Support/Business Center in US,
Tokyo, Seoul, Shanghai, Shenzhen and
HongKong
Shanghai Support Center
Tokyo Business Center
Seoul Business Center
Shenzhen Support Center
US Business Center
Beijing Headquarters
Nanjing R&D Center
Chengdu R&D Center
Hangzhou R&D Center
HongKong Financial Center
ThunderSoft Confidential 5
Image Process & Algorithm
Smart Cut Easiest way to Cutout
Smart Eraser Object erase using just 1 frame
Realtime Beautification Super natural beautification in Real-time
Smart Shutter Shutter with smile, voice, gesture
❖ 50+ million downloads
❖ Customers ► KDDI, Docomo, China Telecom, Orange,
Speedup, Konka, Doov, Inhon, Innos, Yusun…
► No.1 in KDDI AU Market
❖ H/W Oriented Optimization ► Optimized for GPU/CPU/ISP
❖ Full Featured Camera SDK ► 20+ Major Features
► 60+ Real-time filters
► 120+ Post-processing Filters
► HDR, Stabilization, Denoise, …
❖ Best Compatibility ► 200+ smartphones, 60+ camera modules
UCam Camera App Overview
7/9/2014 7 ThunderSoft Confidential
Algorithm Introduction
7/9/2014 ThunderSoft Confidential 8
❖ Natural effect
► Deblemish
► Skin Soften
► Whiten Face
❖ Advance algorithm
► Auto face outline detection
► Auto skin detection
► Local facial enhancement
Real-time Face Beautifier
7/9/2014 9 ThunderSoft Confidential
Cover all
skin areas Does not blur
background
❖ Key Features
► Performance
► Good Generalization
● Insensitive to Illumination
● Insensitive to face region
● Robust to occlusion
Gender Detection
7/9/2014 10 ThunderSoft Confidential
Category
Detection Rate 90%
Angle ±15°
Age 6 ~ 80
Intelligent Beautifier Parameter
7/9/2014 11 ThunderSoft Confidential
Intelligent Beautifier Parameter
7/9/2014
12
ThunderSoft Confidential
Optimization Experience
7/9/2014 ThunderSoft Confidential 13
❖ Compute-Intensive Algorithm
► Preview resolution continued to increase.
► 20+FPS is requirement for good user experience
❖ Algorithm Dependence
► Beautifier parameter based on gender detection result
❖ High CPU Loading
► UI response becomes slow
Optimization Requirement
7/9/2014 14 ThunderSoft Confidential
Parallel Computing
7/9/2014 15 ThunderSoft Confidential
Parameter Estimation
Data Preprocess
Filter
Gender Detection
CPU GPU
❖ Kernel Formula
❖ Suitable for GPU Computation
► Large number of floating-point operations
► Little data dependence
► Maps easily to SIMD architecture
Filter Optimization
7/9/2014 16 ThunderSoft Confidential
* Carlo Tomasi “Bilateral filtering for gray and color images”
*
❖ Easy To Code
► Java Interface
► C99-derived language
► Easy to debug
❖ Easy To Leverage GPU
► Fully supported on Mali
❖ Easy To Tune
► Conveniently switch between CPU/GPU
Using RenderScript
7/9/2014 17 ThunderSoft Confidential
Performance CPU Loading
Before Optimization
10FPS
70%
After Optimization
20PFS
40%
Optimization Result
7/9/2014 18 ThunderSoft Confidential
Real-time Face Beautifier
Platform: Nexus 10
GPU: Mali-T604
Discussion
7/9/2014 ThunderSoft Confidential 19
for more informat ion, please visit :
http://www.thundersoft.com/
contact us:
+86-10-62662686
Address:
4th floor, Taixiang Building 1A#, Longxiang
Road, Haidian District Beijing, China, 100191
T hanks
2014/7/9 ThunderSoft Confidential 20
