1LEAP MOTION

TECHNOLOGY

PRESENTED BY,

Sreeraj C.S.(625)

Vivek S.Kumar(632)

GUIDED BY,

Prof. Dr. Sheeja M.K.

2CONTENTS INTRODUCTION LEAP & FEATURESHOW DOES IT WORK? ANALYSIS OF ACCURACY AND

REPEATABILITY VALUE OF PROPOSITION ADVANTAGES APPLICATIONS CONCLUSION

3INTRODUCTION

Leap is a breakthrough in computer interaction.

Through this new technology we can say good

bye to Mouse & Keyboard.

Leap Motion is a startup developing advanced

motion sensing technology connected to usb port

Natural user interaction using gestures and spoken

commands Contd.

4 It is a new way of interaction and consumes

only 1-2% of the CPU

Motion detection – a process of detecting changes

in position of an object relative to surrounding

5 Build on technical software internally and a range

camera technology Application Programmable

Interface(API)

Interpret specific gestures using infrared projector, a

camera and special microchip

Track the movements of objects and individuals 3D

Device is 200 times accurate than anything else on

market Contd.

6 Widely recognized as more powerful and accurate

More accurate than a mouse

Reliable as a keyboard

More sensitive than touch screen

3D control with your natural hand and finger

Works on windows vista/7/8 and Mac OSx and

Linux and occupies very less spaceContd.

7 Motion sensing is now available in video games

IPod size controller is outfitted with company’s software

Track individual finger movement to 1/100th of a millimeter

Main technology behind leap is natural user interface,

gestures recognition and motion detection

Has a 150° field of view and a Z-axis for depth

Can track movements at a rate of over 200 frames per

second

8 To be placed on physical desktop, facing

upward.

Creates a 3D interaction space

It also tracks tools like pen, pencil, chopstick etc.with high

accuracy

Leap performs task like navigating a website using pinch

to zoom gestures on map

Provide high precision drawing and manipulating complex

3D data visualization Contd.

9

10

HOW DOES IT WORK?

The Leap is a small USB peripheral device

Using two VGA cameras and three infrared LEDs to

capture depth information

11

The operating principle of the measurement of optical 3D sensors are Structured Light, Time of Flight and Stereo-Vision.

Structured light sensors analyse the known pattern and determine the three-dimensional shape

The time of flight is determined by using PMD (Photonic Mixer Device) and laser sensors for measuring the distance to the object by emitting pulsed laser beams

Stereo Vision cameras consist of two optical 2D cameras which determines the depth in the scene and detect the position of object in the Cartesian space

12

 It is designed to track fingers which cross into the

observed area, to a spatial precision of about 0.01

mm

Extracting position information using extremely

complex math

Sensor update position typically 215 times per

second

The Leap Motion controller introduces a new gesture and position tracking system with sub-millimetre accuracy

The device observes a roughly hemispherical area, to a distance of about 1 meter.

13

Sensor detects the finger

Driver software determines where your finger is

Update cursor position

Hemispherical area of interaction

Contd.

14

FEATURES OF LEAP

Basic computing tasks like navigating an operating

system or browsing through Web pages.

Precise virtual drawing in 2-D and 3-D.

Navigating large scale 3-D data visualization systems

Playing computer games

Biological view of molecules, atoms etc. in 3-D space

15 Creating and manipulating 3-D models like

houses and cars.

Signing a digital document by writing in air

Contd.

16

ANALYSIS OF ACCURACY AND REPEATABILITY

FOR AN APPROPRIATE EVALUATION, A NOVEL EXPERIMENTAL SETUP WAS DEVELOPED MAKING USE OF AN INDUSTRIAL ROBOT WITH A REFERENCE HAND

THERE ARE TWO TYPES OF MEASUREMENTS FROM WHICH WE CALCULATE ACCURACY AND REPEATABILITY

1. STATIC MEASUREMENTS

2. DYNAMIC MEASUREMENTS

17

A DEVIATION BETWEEN A DESIRED 3D POSITION AND THE AVERAGE MEASURED POSITIONS BELOW 0.2MM HAS BEEN OBTAINED FOR STATIC SETUPS AND OF 1.2MM FOR DYNAMIC SETUPS

18

• Thus it produces an overall spatial accuracy of about 0.01 mm

19

20

21

Leap changing the world

comfort

perf

orm

ance

22

ADVANTAGES

The tiny device may look like any old USB, but power to

change how we interact with computers.

The leap motion offers a lot of potential to many professions

particularly the creative kind.

It is cheaper and high resolution and portable, so we can use it

in any situation Navigating an operating system or browsing Web pages

with the flick of a finger Finger-pinching to zoom in on maps Letting engineers interact with a 3D model

23

APPLICATIONS GAMINGo More intuitive compared to mouse or even touch

screenso Great accuracy and responsiveness ROBOTICSo Self Navigateo Mimic Human Movement MUSIC AND VIDEOo Electronic Music o Playing or learning Instruments

24o Organic Feel

o Efficient o Flexible to Create and Edit videos HEALTH CARE

For Surgeonso Contactless. Maintain sterilizationo Manipulating screenso Viewing reports

Physiotherapyo To remotely monitor patients as they undergo

rehab

Contd.

25o Engage children recovering from injuries by merging

physiotherapy and games

ART AND DESIGN

o Offers better ergonomics compared to mouse

o More intuitive 3D interface

o Greater accuracy and responsiveness

o Easy to use with simple form factor

o Relatively cheaper than competitors

Contd.

26

CONCLUSION

Far better alternative to mouse and keyboard

Leap Motion plans has distributed thousands of units for free to

developers

It is affordable for many people

Wireless version is already planned

It is light and portable

Improved human-computer interactions

Highly precise device available on market right now

27

References:

Accuracy and resolution of Kinect depth data for indoor mapping applications by Khoshelham.K(2012)

Gesture recognition using Microsoft Kinect by Biswas.K.K(2011)

3-D shape measurement using optical methods by F.Brown(2000)

www.leapmotion.com

http://www.theverge.com/2012/6/26/3118592/leap-motion-gesture-controls

http://heiswed.tistory.com/entry/Leap-Motion-%EC%86%8C%EA%B0%9C

28

Thank you :D