Date post: | 16-Jul-2015 |
Category: |
Technology |
Upload: | jinal-thakrar |
View: | 625 times |
Download: | 9 times |
CONTENTS• What are gestures and types of gestures.• What is gesture recognition? And its example• Basic working of gesture recognition system• Hand gesture recognition• Facial gesture recognition• Sign language recognition• Gesture sensing technology• Technology behind it• Algorithms• Uses of gesture recognition• Gesture recognition challenges
What are gestures?
• A gesture is a form of non-verbal communication.
• Visible bodily actions communicate particular messages.
• Gestures include movement of the hands, face, or other parts of the body.
EXAMPLE
A smart TV recognizing the hand movement to control the channels or to select a option from the menu.
Basic working of gesture recognition technology
User interface User interface displaydisplay
Standard web Standard web cameracamera
useruserUpdating
object
Image capture
Image inputImage input
Hand movement
Hand gesture recognition
Hand gesture recognition technology allows operations of complex machines using only a series of fingers and hand movements ,
eliminating the need of physical contact between operator and machine
Facial gesture recognitionFacial Gesture Recognition
creates an effective non-contact interface between user and their
machines
The goal of facial Gesture Recognition is to make
machine effectively understand human emotions.
Even most cameras detects your smile to automatically click a
picture
Sign language recognitionCertain types of gesture recognition software can transcribe the symbols represented through sign language
into text
Effective sign language recognition can help the deaf people to communicate with
both other people as well as the machine
Gesture sensing technologyElectric Field sensing technology
Proximity of a human body or body part can be measured by
sensing electric fields .
These measurements can be used to measure the distance
of a human hand or other body part from an object; this
facilitates a vast range of applications for a wide range
of industries.
Device sensing technology
Device-based techniques use a glove or other position tracker, whose movements send signals that the
system uses to identify the gesture.
The glove is equipped with a variety of sensors to provide information about hand position, orientation, and flex of
fingers.
Technology behind it...Wired gloves
These can provide input to the computer about the position and
rotation of the hands using magnetic devices.
The first commercially available hand-tracking glove-type device was the Data Glove , a glove-type device which could
detect hand position, movement and finger bending.
This uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, light leaks through small cracks and the loss is registered, giving
an approximation of the hand pose.
Stereo cameras
A Stereo camera is a camera that has two lenses about the same distance apart as your eyes and takes two pictures at the
same time. This simulates the way we actually see and therefore creates the 3D
effect when viewed.
Using two cameras whose relations to one another are known, a 3D
representation can be approximated by the output of the
cameras.
Depth-aware cameras
Using specialized cameras such as structured light or time-of-
flight cameras, one can generate a depth map of what is being seen
through the camera at a short range, and use this data to
approximate a 3d representation of what is being seen.
These can be effective for detection of hand gestures due to their short range
capabilities.
Thermal cameras
An infrared camera is a device that detects infrared radiation(temperature) from the
target object and converts it into an electronic signal to generate a thermal
picture on a monitor or to make temperature calculations on it.
Use of gesture recognition technology
Just as speech recognition can transcribe speech to text, certain types of gesture recognition software can transcribe the
symbols represented through sign language into text.
Sign language recognition
For systems where the act of finding or acquiring a physical controller could require too much time, gestures can be used as an alternative control mechanism. Controlling secondary devices in a car, or controlling a television set are examples of such usage.
Through the use of gesture recognition, remote control with the wave of a hand of various devices is
possible.
Virtual controllers
Remote control
Machine wheel chairs are coming with gesture based system. The
movement of the hand will act as a controller of speed as well as
direction
In video game consoles such as Microsoft X-box with kinect sensors, often the user is the
controller and has to perform all physical movements that they desire
the character in the game to do.
Aid to physically challenged
Immersive gaming technology
challenges
Different users make gestures differently, causing difficulty in identifying motions
Many gesture recognition systems do not read motions accurately or optimally due
to factors like insufficient background light, high background noise etc
Lack of gesture language
Robustness