Gesture-Based Computing
Alicia Heintjes, Tony Pagnotta, Emily Earwood, Alexis Brown, Sean Doherty
What is it?
● Uses the human body to interact with the digital resource without any input devices.○ Eliminates keyboard,
mouse, game controller, or voice mechanism.
● Scans a limited space to analyze the human movement.
● The body’s movement determines the input.
How does it Work?● Uses different human motions to command technology
○ may zoom in and out by stepping forward or
backwards
○ for videos could point left to replay flat hand to
pause, and point right to continue
● Currently used in games and entertainment purposes
○ Microsoft Kinect
○ Leap Motion
● Technology can capture multiple points of interaction
simultaneously, which helps in
○ dance or athletic technique
○ physical therapy
Who is doing it?● The Tangible Media Group at the MIT Media Lab
○ inFORM interface, uses a digital display and a pinscreen
○ pins are attached to motors that lift in response to gestures made by remote operator, making effect of hands reaching out from display
● Technological Educational Institute of Crete and Aalborg University○ made gesture based game for teaching emotion
recognition skills to preschoolers
● Ohio University’s Language Resource Center○ uses “holodeck,” or environment created by images
on multiple surfaces
Why is it significant?● 3D computing skills● see results of actions taken as they occur
○ communicate with computer via sign language○ use hand gestures to control computer
● realistic● fast response time● more personalized● enabled for multiple participants at once● equipped for handicapped● easy for all ages● expand classroom resources● visual learners● easy to apply to any application or device● encourages more developmental technology for the
future
What are the downsides?● Some systems have difficulty discerning fine motor movements.● Users, with disabilities, who are limited with fine motor skills ● Health concerns caused by everyday use.
- Stress issues- Repetitive-motion injuries
● Recognizing and interpreting gestures might strike some users as invasive. - sparking concerns about privacy
● Determining what gestures mean may require a new vocabulary for interaction.
● Could conflict with gestures some cultures interpret as inappropriate.
Where is it going?● Possibilities are endless.
● Gesture Based Computing & Augmented Reality○ Medical Students○ Safety Drills○ Civil Engineering
● Customization is key.
What are the Implications for teaching and learning?● Asset for hands on work
○ design, construction, medical professionals.
● Aids in the speed in which physical skills are picked up.
● Provides practices and techniques available for copy.○ Athletics, rehabilitation
● Increases dexterity ○ instruments.
● Assists languages by evaluating facial expressions while speaking.
What is it? How does it work?
Who is doing it?
Why is it significant?
What are the downsides?
Where is it going?
What are the implications for teaching and learning?
500 Emily 500 Tony 500 Tony 500 Alicia 500 Alexis 500 Sean 500 Emily
Jeopardy
Q1
True or False: Gesture-based computing has no need for controllers or keyboards.
Click here to see answer
A1
TRUE!
Home
Uses the human body to interact with the digital resource
Q2True or False:
Gesture based computing can be used for entertainment, physical therapy, dance techniques and athletic techniques.
Click Here to see the Answer
A2
True! Home
Q3Name a school or organization mentioned in the powerpoint, that is using and improving gesture based computing.
Click Here to see the Answer!
A3- The Tangible Media Group at the MIT Media Lab- Technological Educational Institute of Crete and Aalborg University- Ohio University’s Language Resource Center
(are all acceptable)
Home
Q4True or False:
Gesture-Based Computing is NOT equipped for those that are physically handicapped?
Click Here to See the Answer!
A4
False!
Gesture-Based Computing will be easily accessible by those that are physically handicapped.
home
Q5True or False:
There are NO health concerns from everyday use
Click Here To See The Answer!
A5FALSE!
Health concerns caused by everyday use.Stress issuesRepetitive-motion injuries
Home
Q6The possibilities are endless with Gesture Based Computing. One particularly promising area we discussed was the combination of Gesture Based Computing and _________?
Click Here For Answer
A6Augmented Reality
○ Medical Students○ Safety Drills○ Civil Engineering
Home
Q7
Why is gesture-based learning helpful in learning a language?
Click here to see answer
A7
It can evaluate your facial expression as you speak!
Home