Kinect Introduce

2012

Seung Heon Kang

Kinect Introduce

Motion sensing device

Natural user interface using gestures and

spoken commands

2

History

Technical invented by Zeev Zalevsky, Alexander Shpunt, Aviad Maizels and Javier Garcia (2005)

Project Natal (June 1, 2009) Kinect (November 4, 2010) First release of Kinect SDK (June 16, 2011) Release of Kinect SDK v1.0 Beta2 (November

1, 2011) Release of Kinect for Windows SDK (February

1, 2012)3

Structure

4

Features

Field of View Horizontal field of view : 57 degrees

Vertical field of view : 43 degrees

Physical tilt range : ±27 degrees

Data Stream 320X240 16-bit depth @ 30 frames/sec

640X480 32-bit color @ 30 frames/sec

16-bit audio @ 16kHz

5

Features

Skeleton tracking system Tracks up to 6 people, including 2 active players

Tracks 20 joints per active player

Audio System Echo cancellation system enhances voice input

Speech recognition in multiple

6

NUI Library

Natural User Interface

7

NUI Library

8

Video Components Audio Components

Windows components

1

2

35

4

Kernel-mode drivers for Kinect for Windows

DMO codec for mic array

Applications

Kinect for Windows SDK

User-created components

USB Hub

Windows Core Audio and Speech APIs

Device setup

Audio stream controlVideo stream control

WinUSB device stack USBAudio audio stackWinUSB camera stack

Motor Audio mic arrayCameras

NUI APIA/V capture and transcodingMedia Foundation | DirectShow

User Mode

Kernel Mode

Kinect sensor

Hardware

Device access

Color Image Data

Resolution 640x480, fps 30

Resolution 1280x960, fps maximum 12

4Byte per Pixel RGB color

YUV color

9

Depth Image Data

Resolution 320x240 fps 30

Resolution 640x480 fps 30

(upsampling)?

2Byte per Pixel Real depth 13bit 0~8192

Player 3bit

10

Depth Image Data

Measure distance Default Mode 800 ~ 4000 mm

Near Mode 400 ~ 3000 mm

11

Skeleton Data

Using depth image

Make joint points

3D points Float x

Float y

Float z

Float w

12

How to Skeleton Tracking

13

DepthMapDepthMap Divide Divide by Backgroundby Background

DistinguishDistinguish RecognizeRecognize CreateCreate

Skeleton Data

Skeleton data of the players detects 6

players

Get skeleton data 2 players

14