1

GESTURE RECOGNITION TECHNOLOGY

PRESENTED BY :-Suraj Kumar Rai Roll:- GUIDED BY :-

2Contents Introduction Motivation Gesture types Input devices Challenges Uses References

3Introduction What are Gestures?

A form of non-verbal communication. Movement of the hands, face, or other parts of the

body. What is Gesture Recognition?

Interpreting human gestures via mathematical algorithms.

Gestures as input to control devices or applications.

4

EXAMPLE

A smart TV recognizing the hand movement to control the channels or to select a option from the menu.

5

Gesturing is a natural form of communication Gesture naturally while talking

Babies gesture before they can talk

Interaction problems with the mouse Have to locate cursor

Hard for some to control (Parkinsons or people on a train)

Limited forms of input from the mouse

Motivation

6Gesture types In computer interfaces, two types of gestures

are distinguished. Offline gestures

Processed after the user’s interaction with the object. Ex:- gesture to activate a menu.

Online gestures Direct manipulations like scaling and rotating.

7Basic Working of Gesture Recognition Technology

Gesture Recognit

ion System

User interface display

Standard web camera

userUpdating

object

Image capture

Image input

Hand movement

8Input devices

Tools to track a person's movements Wired gloves Depth aware cameras Stereo cameras Gestures based Controller Single camera

9Technology Behind it..Wired gloves

Provides input to the computer about the position and notation of the hands.

Uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, and is registered giving an approximation of the hand pose.

10Technology Behind it..

Stereo cameras It has two lenses about the same

distance apart as your eyes and take two pictures at a same time.

A 3D representation can be approximated by the output of the cameras.

11

12Challenges

Lack of Gesture Language Different users make gestures differently,

causing difficulty in identifying motions

Robustness Many gesture recognition systems do not

read motions accurately or optimally due to factors like insufficient background light, high background noise etc.

13Uses

1.Sign Language Recognition

Just as speech recognition can transcribe speech to text, certain types of gesture recognition software can transcribe the symbols

represented through sign language into text.

142.Virtual Controllers

For systems where the act of finding or acquiring a physical controller

could require too much time, gestures can be used as an

alternative control mechanism. Controlling secondary devices in a

car, or controlling a television set are examples of such usage.

3.Remote ControlThrough the use of gesture recognition, remote control with the wave of a hand of various devices is possible.

Uses/Conclusion

15

Machine wheel chairs are coming with gesture based system. The movement of

the hand will act as a controller of speed as well

as direction

In video game consoles such as Microsoft X-box with kinect sensors, often the user is the controller and has to perform all physical movements that they desire the character in

the game to do.

4.Aid to PhysicallyChallenged

5.Immersive Gaming Technology

Uses

16References

Ying Wu and Thomas S. Huang, "Vision-Based Gesture Recognition: A Review", In: Gesture-Based Communication in Human-Computer Interaction, Volume 1739 of Springer Lecture Notes in Computer Science, pages 103-115,

Matthias Rehm, Nikolaus Bee, Elisabeth André, Wave Like an Egyptian - Accelerometer Based Gesture Recognition for Culture Specific Interactions, British Computer Society, 2007

Pavlovic, V., Sharma, R. & Huang, T. (1997), "Visual interpretation of hand gestures for human-computer interaction: A review", IEEE Trans. Pattern Analysis and Machine Intelligence., July, 1997. Vol. 19(7), pp. 677 -695

17

Any Questions??