7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 1/20

3D Human Motion Capture and Gesture Recognition

AFDS

June 15, 2011

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 2/20

Vision

2 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 3/20

Evolution

3 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 4/20

Evolution

4 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 5/20

Evolution

5 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 6/20

Mass Market Solution?

6 

× HIGH cost

× LARGE form factor 

× HIGH power 

× Very specific range

× Avoid daylight

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 7/20

XTR3D Offering

7 

3D Motion Capture and Gesture Control 

• Software only 

• Utilizing a single ‘built in’/ standard rgb webcam

• Gesture Control from a few inches to 20ft away from the

camera

• Low footprint

• Daylight support 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 8/20

XTR3D Offering

8 

Uti l izing the exis t ing camera to 

Turn Laptops , TVs, Mobi les and Tablets in to 

Gesture Con trol led Devices!  

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 9/20

Technology

3D SKELETON ANALYSIS

• Real time extraction of 3D skeleton joints in

every frame

•  Analysis of the skeleton allows for real time

detection of gestures 

Proprietary and Confidential Information of XTR

The entire technology is based on software only, and relies on basic input imagery

that originates from a single, simple webcam.

Subject to distance and resolution, the 3D skeleton extraction varies from fingers

to full body.

9 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 10/20

Technology

Proprietary and Confidential Information of XTR

10 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 11/20

Technology

Proprietary and Confidential Information of XTR

11 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 12/20

Technology

XBuilder Development Tools 

•  App developers can utilize

 XTR tech very easily 

•  Add gesture control to

existing content! 

• Platform agnostic  –

same tool, all platforms

Proprietary and Confidential Information of XTR

12 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 13/20

Mass Market Solution!

13 

√ LOW cost

√ SMALL form factor √ LOW power 

√ Support a variety of ranges

√ Support daylight

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 14/20Proprietary and Confidential Information of XTR

14 

SCALING UP

14

Enhanced experience requires: – Multi user support

 – Full body (add legs detection)

 – Maintain High Precision

Higher resolution ~2MP

Much more computing power is needed

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 15/20Proprietary and Confidential Information of XTR

15 

XTR on Fusion

15

• Much of XTR code is based on image processing

functions operating on 2D arrays

• Data is locally accessible

• Operation on one part of the image is independentfrom other parts.

Classic candidates for GPU porting

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 16/20Proprietary and Confidential Information of XTR

16 

XTR on Fusion

16

•  Analysis shows that around 65% of current CPU load

can be offloaded to GPU.

• When scaling up to higher resolutions this code iseffectively over 80% of the workload

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 17/20Proprietary and Confidential Information of XTR

17 

XTR on Fusion

• Sample function – 1X3 morphological erosion filter • Fusion Platform – Brazos (2CPU cores, 80 GPU cores)

17

Resolution 320X240 1024X768

CPU time 2.5ms 75ms

GPU time 0.48ms 4.7ms

Speedup X5.2 X16

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 18/20

 

Let’s see some demos…. 

Proprietary and Confidential Information of XTR

18 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 19/20

Thank you ! 

Proprietary and Confidential Information of XTR

19 

7/29/2019 2241_final

http://slidepdf.com/reader/full/2241final 20/20

Disclaimer & Attribution

• The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and

typographical errors.

• The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to

product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences

between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. There is no obligation to update or 

otherwise correct or revise this information. However, we reserve the right to revise this information and to make changes from time to

time to the content hereof without obligation to notify any person of such revisions or changes.

• NO REPRESENTATIONS OR WARRANTIES ARE MADE WITH RESPECT TO THE CONTENTS HEREOF AND NO RESPONSIBILITY

IS ASSUMED FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION.

•  ALL IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE ARE EXPRESSLY

DISCLAIMED. IN NO EVENT WILL ANY LIABILITY TO ANY PERSON BE INCURRED FOR ANY DIRECT, INDIRECT, SPECIAL OR

OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF

EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

•  AMD, the AMD arrow logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. All other names used in this

presentation are for informational purposes only and may be trademarks of their respective owners.

• The contents of this presentation were provided by individual(s) and/or company listed on the title page. The information and opinionspresented in this presentation may not represent AMD’s positions, strategies or opinions. Unless explicitly stated, AMD is not responsible

for the content herein and no endorsements are implied.

20