1

Sixth Sense Technology

WEARABLE GESTURAL INTERFACE

2CONTENT OVERVIEW

1 •Introduction

2 •History

3 •Components

4 •installation

5 •Working

6 •Applications

7 •Advantages

8 •Disadvantages

9 •Uses

10 •Future Enhancements

3

DEFINITION

‘Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.’

4

What is SIXTH SENSE?

It is a technology based on the concept of augmented reality

It is an integration of the real world object with the digital world

It is an ESP(extra sensory perception) thus the name.

5HISTORY

Proposed by Steve MannDeveloped in MIT Labs1994-1997 as head worn

device1998 as neck worn device

6

The work was furthered by Pranav Mistry

They initially produced a wristband that would read an Radio Frequency Identification tag.

They started with a larger projector that was mounted on a helmet.

7Initial Prototype

8

Hardware Components

CameraProjectorMicrophoneMirrorSmartphoneColoured markers

9

CAMERA

MICROPHONE

PROJECTOR

MIRROR

COLOR MARKERS

MOBILE COMPUTING DEVICE

10CAMERA

Capture an object in view and tracks the user’s hand gestures

It sends the data to smart phone It acts as a digital eye , connecting

you to the world to digital information

11

PROJECTOR Projects graphical user interface of the

selected application onto surfaces or walls in front.

Prototype contains a rechargeable battery

The mobile computing device provides the projector with the content to be projected

12 MIRROR

The usages of the mirror is significant as the projector dangles pointing downwards from the neck.

The user can manually change the tilt of the mirror to change the location of the projection

13SMART PHONES A Web-enabled smart phone

in the user’s pocket processes the video data.

Other Software searches the Web and interprets the hand gesture.

14COLOR MARKERS It is at the tip of the user’s fingers . Marking the user’s fingers with red,

yellow, green, and blue tape helps the webcam recognize gestures.

The movements and arrangements of these markers are interpreted into gestures that act as interaction instruction for the projected application interfaces.

15

Optional component of SixthSense

Required when a paper is used as a computing device

Clipped microphone captures the sound signals of user touching the paper

MICROPHONE

16GESTURE RECOG-NITION

17

Language: c++, c#Software: WUW v0.1Operating System:

windowsVisual StudioDirectX

SoftwareComponents

18

Download

v0.1from https://code.google.com/archive/p/sixthsense/wikis/Software.wiki

Extract and copy the files from wuw_v0.1.zip

Open WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it

Configure camera settings select color markers and then launch any application available in menu

19

WORKING

Images PicturesGesture

s

Camera for

image capture

ProcessInforma

-tion

Project

informa-tion

20

21

Applications

Call your contacts Refer a map Check the time Easily available multimedia content Drawing application Product details Play games Get book details Book and check flights Get details of people Take pictures

22MAKE A CALL

AUGMENTEDNEWSPAPER

CLICKPICTURES

PLAY GAMES

DRAWANYWHERE

REFER AMAP

CHECK THETIME

PROJECT DETAILS

23Advantages

Makes the whole world our computer Adapts to our needs Brings intangible information to tangible world Supports multi-touch and multi-user interaction Real time direct data access Open source and cost effective Useful, viable and flexible system Portable

24Disadvantages

Security Projection efficiencyCost Impractical

25USEFULNESS

USABILITY

EFFICIENCYFLEXIBILITY

COST

26

Engaging LecturesResearch PurposeCollaborative Projects

USES

27 To get rid of colour markers To incorporate camera and

projector inside mobile computing device.

Broadening the scope of technology

To have 3D gesture tracking. To make sixth sense work as

fifth sense for specially abled people.

FUTUREENHANCEMENT

28

CURRENTSTATUS

No commercial product released.

Open source code has not been updated since 2012

Thank You-MISHIKA BHARADWAJ