1
TEAM KINECT
Final presentation31-8-2012
2
What is Kinect?
31-8-2012
Microsoft gaming console accesoire for Xbox 360 Human interface device with gestures For Xbox 360 since September 2010 For Windows since February 2012
3
Motivation
31-8-2012
Interest in HCI and alternative input devices Expand functionality of (consumer) hardware “Trendy” topic Versatile application areas
Entertainment Education Security Medicine
4
Existing Projects
31-8-2012
Application specific projects : MIT: Google Chrome KinEmote: Controlling home theater software Use in sterile environment like a hospital
5
Technical background
31-8-2012
3 important components: Infrared laser projector RGB Camera Depth sensor (monochrome camera with IR-pass-
through filter)
Not used (by us): Microphone array
6
IR Grid
31-8-2012
7
Name: Kinect using shortCuts
Application independent Kinect control
Using Java and OpenNI and PrimeSense
Java Robot-Class
Our project – “KinectCut”
31-8-2012
8
Approach
31-8-2012
Stock gesture recognition isn’t appropriate enough for our approach
Measuring the angles and length of the arms Velocity and position of several body parts
9
Interaction Model
31-8-2012
Problem to differ between gestures and actions
Solution: mode arm & action arm Mode arm (left): switch
between states Action arm (right): propose
the action while in state
10
From Body to Command
Discretizing angles to recognize gestures
Smoothing filter for mouse coordinates to screen mapping
31-8-2012
11
Mapping for Mouse Control
31-8-2012
12
Architecture
31-8-2012
OpenNI&
PrimeSense
BodyParser
(discretization)
1110100001
Gestures/Skeleton
StateMachine
Body (Skeleton)/Raw Data
Robot
Actions
Control
13
Feedback
31-8-2012
No tengible feedback provided by Kinect
Different Types of feedback: Mode displayed Calibration state Hand-recognition state History of actions and state
changes Wireframe model
14
Demo Video
31-8-2012
15
Experience on project
31-8-2012
Working in an interdisciplinary, multicultural and multilanguage team
Finding ideas that can be completed in the given time with the given team
16
Experience on Summer Camp
31-8-2012
océ is not only doing paper printing :-) Real-life experience on project work
New Environment New Task New Team
Excellent organization of SummerCamp Social Events Accommodation Supervision
17
In the end, it was FUN!
31-8-2012
Thankyouocé!
