Gesture-Based Computing

Alicia Heintjes, Tony Pagnotta, Emily Earwood, Alexis Brown, Sean Doherty

What is it?

● Uses the human body to interact with the digital resource without any input devices.○ Eliminates keyboard,

mouse, game controller, or voice mechanism.

● Scans a limited space to analyze the human movement.

● The body’s movement determines the input.

How does it Work?● Uses different human motions to command technology

○ may zoom in and out by stepping forward or

backwards

○ for videos could point left to replay flat hand to

pause, and point right to continue

● Currently used in games and entertainment purposes

○ Microsoft Kinect

○ Leap Motion

● Technology can capture multiple points of interaction

simultaneously, which helps in

○ dance or athletic technique

○ physical therapy

Who is doing it?● The Tangible Media Group at the MIT Media Lab

○ inFORM interface, uses a digital display and a pinscreen

○ pins are attached to motors that lift in response to gestures made by remote operator, making effect of hands reaching out from display

● Technological Educational Institute of Crete and Aalborg University○ made gesture based game for teaching emotion

recognition skills to preschoolers

● Ohio University’s Language Resource Center○ uses “holodeck,” or environment created by images

on multiple surfaces

Why is it significant?● 3D computing skills● see results of actions taken as they occur

○ communicate with computer via sign language○ use hand gestures to control computer

● realistic● fast response time● more personalized● enabled for multiple participants at once● equipped for handicapped● easy for all ages● expand classroom resources● visual learners● easy to apply to any application or device● encourages more developmental technology for the

future

What are the downsides?● Some systems have difficulty discerning fine motor movements.● Users, with disabilities, who are limited with fine motor skills ● Health concerns caused by everyday use.

- Stress issues- Repetitive-motion injuries

● Recognizing and interpreting gestures might strike some users as invasive. - sparking concerns about privacy

● Determining what gestures mean may require a new vocabulary for interaction.

● Could conflict with gestures some cultures interpret as inappropriate.

Where is it going?● Possibilities are endless.

● Gesture Based Computing & Augmented Reality○ Medical Students○ Safety Drills○ Civil Engineering

● Customization is key.

What are the Implications for teaching and learning?● Asset for hands on work

○ design, construction, medical professionals.

● Aids in the speed in which physical skills are picked up.

● Provides practices and techniques available for copy.○ Athletics, rehabilitation

● Increases dexterity ○ instruments.

● Assists languages by evaluating facial expressions while speaking.

What is it? How does it work?

Who is doing it?

Why is it significant?

What are the downsides?

Where is it going?

What are the implications for teaching and learning?

500 Emily 500 Tony 500 Tony 500 Alicia 500 Alexis 500 Sean 500 Emily

Jeopardy

Q1

True or False: Gesture-based computing has no need for controllers or keyboards.

Click here to see answer

A1

TRUE!

Home

Uses the human body to interact with the digital resource

Q2True or False:

Gesture based computing can be used for entertainment, physical therapy, dance techniques and athletic techniques.

Click Here to see the Answer

A2

True! Home

Q3Name a school or organization mentioned in the powerpoint, that is using and improving gesture based computing.

Click Here to see the Answer!

A3- The Tangible Media Group at the MIT Media Lab- Technological Educational Institute of Crete and Aalborg University- Ohio University’s Language Resource Center

(are all acceptable)

Home

Q4True or False:

Gesture-Based Computing is NOT equipped for those that are physically handicapped?

Click Here to See the Answer!

A4

False!

Gesture-Based Computing will be easily accessible by those that are physically handicapped.

home

Q5True or False:

There are NO health concerns from everyday use

Click Here To See The Answer!

A5FALSE!

Health concerns caused by everyday use.Stress issuesRepetitive-motion injuries

Home

Q6The possibilities are endless with Gesture Based Computing. One particularly promising area we discussed was the combination of Gesture Based Computing and _________?

Click Here For Answer

A6Augmented Reality

○ Medical Students○ Safety Drills○ Civil Engineering

Home

Q7

Why is gesture-based learning helpful in learning a language?

Click here to see answer

A7

It can evaluate your facial expression as you speak!

Home