OpenCV + Kinect

Presented by hankkuo

Outline

• OpenCV meets Kinect• Packages & Hardware & Installation– Kinect Sensor– OpenCV 2.3.1– OpenNI– SensorKinect– PrimeSense NITE

• Some demos• Homework

OpenCV meets Kinect

• OpenCV– A powerful computer vision library– Incorporate with lots of heterogeneous devices– Deployed to many platforms

• Kinect– Powerful but cheap multimedia capturing device– Efficiency in calculating depth image

How Kinect works

• http://www.techbang.com.tw/posts/2936-get-to-know-how-it-works-kinect

Packages & Hardware & Installation

• Of course, you need a “Kinect Sensor”• There are various ways to set up Kinect Sensor– Microsoft Kinect SDK– OpenNI – OpenKinect

OpenNI• Follow the steps…• 1. OpenNI

– OpenNI manages all the natral interface– https://github.com/OpenNI/OpenNI

• 2. SensorKinect– Provide modified PrimeSense driver for Kinect in various platforms– https://github.com/avin2/SensorKinect

• 3. PrimeSense NITE– Provide extra posture recognition function– http://75.98.78.94/

• 4. OpenCV 2.3.1– Support capturing from Kinect device– Have to build with OpenNI and PrimeSense module options

Some Demos

• 1. Try to run “NiViewer” the under OpenNI

Some Demos

• 2. Try to run “NiUserTracker” the under OpenNI

Some Demos

• 3. Try to run “PointViewer” the under NITE

• 4. Try other examples

OpenCV + OpenNI + Kinect

• Refer to example “kinect_maps” under OpenCV

• Show disparity map by pseudo colors

Go into the code