Tech Main Documntn

8/2/2019 Tech Main Documntn

1/29

1

1.1 Preamble of the topic:

As the computer mouse has remained largely unchanged over the last

decades, we have become increasingly proficient at operating the two-button mouse.

Recently, various multitouch and gestural interaction technologies have been

explored as means to implement alternative methods to interact with a computer.

Despite these advances in computing hardware technologies, the two-button

computer mouse has remained the predominant means to interact with a computer.

The Mouse less invention removes the requirement of having a physical mouse

altogether but still provides the intuitive interaction of a physical mouse that we are

familiar with.

1.2 Objective of the topic:

Mouseless is an invisible computer mouse that provides the familiarity of

interaction of a physical mouse without actually needing a real hardware mouse.

The Mouse less invention removes the requirement of having a physical mouse

altogether but still provides the intuitive interaction of a physical mouse that users

are familiar with.

Fig: 1.2.1: Mouseless


2/29

2

2.1 Previous Methods / Previous work done in domain:

The First computer Mouse is invented in 1963 by Douglas Engelbart at

Stanford Research Institute with his assistant Bill English Patent no USA3,541,541.

With respect to the topic, the work done in domain i.e., the usage of the mouse is

done with the help of wired and wireless technology. So, here we consider the

evolution process of a mouse.

First computer mouse:

The first computer mouse is invented by Douglas Engelbart in 1963. The

first computer mouse is very bulky and early had one button. It works two metal

wheel which make contact with working surface.

Fig: 2.1.1 First computer mouse


3/29

3

2.2 Project Approach / Motivation of the topic:

A mouse is a pointing device that functions by detecting two-dimensional

motion relative to its supporting surface. Physically, a mouse consists of an object

held under one of the users hands, with one or more buttons. This definition is true

according to the inventor of the first ever mouse Douglas Engelbart.

Now, when coming to the present title, here we represent the mouse

virtually which replaces the physical mouse. Pranav Mistry (A research assistant and

PHD candidate at MIT media lab) has a completely new and different view which

has radical effect on the foundation of computer mouse. Mistry has developed a

technology which has potential to replace the traditional mouse. The Mouseless

invention removes the requirement of having a physical mouse altogether but still

provides the intuitive interaction of a physical mouse. Simply, it is an invisible

computer mouse that lets you control the pointer on the screen using your hand but

without touching any physical mouse or hardware.
http://www.glideidea.com/2012/01/03/sixth-sense-technology-pranav-mistry/http://www.glideidea.com/2011/10/12/home-smart-home-a-way-to-smart-living/http://www.glideidea.com/2011/10/12/home-smart-home-a-way-to-smart-living/http://www.glideidea.com/2012/01/03/sixth-sense-technology-pranav-mistry/


4/29

4

3.1 Mouseless Overview:

Mouseless is a proposed input device for personal computers. A prototype

Mouseless, designed by Pranav Mistry of the MIT Media Lab, (Massachusetts Institute of

Technology)replaces conventional hardware mouse with a set of infrared laser strobe, an

infrared camera and image recognition software.

Mouseless, uses an infrared laser beam and camera to track the movements

of the palm and fingers and translate them into computer commands. In the case of the

Mouseless , the infrared laser and camera are embedded in the computer.

The Mouseless idea is not as big a breakthrough as Sixth Sense. Though it is

fun, it is difficult to see a real-world case for getting rid of hardware while keepinginteraction the same. User interfaces are going beyond the point-and-click interaction that

the computer mouse demands. And mouse hardware itself is cheap, so theres not much o f

a cost saving here. As we improve our computer vision algorithms, an extensive library of

gestures could be implemented in addition to mouse movement and mouse clicks. Typical

multitouch gestures, such as zooming in and out, as well as novel gestures, such as balling

ones fist are all possible. In addition, the use of multiple laser beams would allow for

recognition of a wider range of free hand motions, enabling novel gestures that the

hardware mouse cannot support.

Fig: 3.1.1.Mouseless
http://en.wikipedia.org/wiki/Input_devicehttp://en.wikipedia.org/wiki/Pranav_Mistryhttp://en.wikipedia.org/wiki/MIT_Media_Labhttp://en.wikipedia.org/wiki/Mouse_%28computing%29http://en.wikipedia.org/wiki/Infraredhttp://en.wikipedia.org/wiki/Thermographic_camerahttp://en.wikipedia.org/wiki/Thermographic_camerahttp://en.wikipedia.org/wiki/Infraredhttp://en.wikipedia.org/wiki/Mouse_%28computing%29http://en.wikipedia.org/wiki/MIT_Media_Labhttp://en.wikipedia.org/wiki/Pranav_Mistryhttp://en.wikipedia.org/wiki/Input_device


5/29

5

3.2 Evolution process of mouse:

1. First computer mouse

2. Roll Ball mouse

3. Optical mouse

4. Laser Mouse

5. Wireless mouse

6. 3-D mouse

7. Invisible mouse

Roll Ball Mouse:

Bill English, builder of Engel arts original mouse, invented the ball mouse in 1972

while working for Xerox PARC the ball mouse has two freely rotating rollers. They

are located 90 degrees apart. One roller detects the forwardbackward motion of the

mouse and other the leftright motion.

Fig: 3.2.1 Roll-Ball Mouse


6/29

6

Advantage:

1. Low cost.

Disadvantages:

1. performance and tracking ability depend on the surface the mouse moves

2. need mouse pad or any special surface

3. the cursor movement looks not smoother to the end user

4. When you use mechanical mouse, you need to clean the dirt or debris that comes

inside the mouse so that the ball and rollers are able to move freely when the

mouse moves

5.

Mechanical mouse are heavy generally.

Optical Mouse:

The optical mouse is a great improvement over the mechanical mouse that was

created early 1976. The Optical mouse was introduced in 1999 by Agilent

Technologies; the technology uses a tiny camera that takes thousand of picture per

second to determine position and speed. The optical mouse use very small light

emitting diode more commonly referred to as in LED which is red in color .this

LED bounce light off of a mouse pad.

Fig: 3.2.2- Optical Mouse


7/29

7

Advantages:

1. Optical mice usually function trouble-free for years.

2.

Early optical mice required a special mouse pad, but today's devices can be rolled

over traditional pads like a mechanical mouse as well as over almost any surface

other than glass or mirror.

3. Precision of optical mice is also much greater than mechanical mice.

4. There are no moving parts to break or otherwise cause problems.

5. Weightless.

Disadvantages:

1. Much expensive than Mechanical mouse.

2. Mouse code is required. Physically should be connected to the computer.

Laser Mouse:

A laser mouse is a type of computer mouse device that uses a laser beam rather than

a ball to track the movement of the user's hand. The lack of moving parts also makes

them far less subject to damage.

Fig: 3.2.3-Laser Mouse

Advantages:

1. Very useful for anyone who does precise work, such as with art or photographs, etc.

2. It is easier to move your mouse to the exact pixel.


8/29

8

Wireless mouse:

Wireless mice mainly use Radio frequencies to transmit data from the mouse to the

computer. RF wireless mice require two components to work properly a radio

transmitter and a radio receiver.

Fig: 3.2.4- Wireless Mouse

Advantages:

1. Cordless mice are more and more popular because they can be used without

physically being connected to the computer, which gives a sensation of freedom.

2. free up desk space and elimination of mouse cord

3. not need special surface

Disadvantages:

1. Much expensive

2. battery required for some designs


9/29

9

3-D Mouse:

It also known as bats, flying mice, or wands, these devices generally

function through ultrasound and provide at least three degrees of freedom.

November 2010 a German Company called Axsotic introduced a new concept of 3D

mouse called 3D Spherical Mouse.

3D Mouse Benefits:

1. Increase Productivity: Average gains of 21% from simultaneously navigating,

creating and editing your model.

2.

Enhanced Comfort: Reduce mouse movement and clicks by up to 50%.3. Design Performance: Whether youre working on a sketch or a complex 3D model,

the superior navigation experience encourages levels of model exploration that are

crucial to avoiding costly design errors.

Fig: 3.2.5 3D-finger optical mouse


10/29

10

3.3 Working Principle of Mouseless device:

Mouseless is an invisible computer mouse that lets control the pointer

on the screen by using hand but without touching any physical mouse or hardware.

It consists of an Infrared (IR) laser beam (with line cap) and an Infrared camera.

Both IR laser and IR camera are embedded in the computer. The laser beam

module is modified with a line cap and placed such that it creates a plane of IR

laser just above the surface the computer sits on.

Requirements:

The mouseless requires two components.

1. Infrared Laser Beam

2. Infrared Camera

Fig: 3.3.1 IR LASER BEAM AND IR CAMERA


11/29

11

The user cups their hand, as if a physical mouse was present underneath, and the

laser beam lights up the hand which is in contact with the surface. The IR camera detects

those bright IR blobs using computer vision. The change in the position and arrangements

of these blobs are interpreted as mouse cursor movement and mouse clicks.

Fig: 3.3.2 Palm of Hand as Mouse

As the user moves their hand the cursor on screen moves accordingly. When

the user taps their index finger, the size of the blob changes and the camera

recognizes the intended mouse click.

IR LASER BEAM:

The laser beam is optically split into a wide beam illuminating an imaginaryplane above the working desk. The camera captures the pattern of invisible infrared light as

it illuminates user's hand. The user resets the palm on the desk and commands the system in

the same way as he or she would do with a conventional mouse.


12/29

12

Fig: 3.3.3 Laser Beam

The infrared laser module is self-contained with integrated driver circuit and built-

in optics.

Wavelength range is 705 nm to 1064 nm.

Works at TEC temperature control.

FEATURES of IR Laser Beam:

High Power Stability

Collimated Beam

Low RMS Noise

Excellent Wavelength Stability


13/29

13

Fig: 3.3.4 Laser Beam of Light

APPLICATIONS:

Bioanalytical

Imaging

Light Scattering

Measurement


14/29

14

IR Camera:

Fig: 3.3.5 IR Camera

An infrared camera is a non-contact device that detects infrared energy (heat)

and converts it into an electronic signal, which is then processed to produce a thermal

image on a video monitor and perform temperature calculations. Heat sensed by an

infrared camera can be very precisely quantified, or measured, allowing you to not only

monitor thermal performance, but also identify and evaluate the relative severity of heat-

related problems.


15/29

15

THERMAL IMAGER:

Fig: 3.3.6 Thermal Imager

Thermal imagers measure the infrared energy emitted by surfaces remotely. The

Infrared energy emitted by the object is focused on to an infrared detector. By the laws of

Physics the Infrared energy emitted by the object is related to the temperature of the

object. The Thermal Imager converts this infrared energy into a heat picture of the object

which in thermal Imaging Terminology is known as a Thermo gram.

Different temperatures in the Thermo gram are represented by different colors.The distribution of temperature on the object gives the user vital information on the

operating condition of the machine which helps the user take corrective actions.

Thermography has been used for many years by preventive maintenance

engineers to inspect motors, circuit boards, switchgear, electrical connectors, bearings and

pumps etc.


16/29

16

Fig: 3.3.7 Mouseless Working Prototype System


17/29

17

3.4 Gestures:

Gestures are nothing but the movements that are implemented while using an

invisible mouse. The change in the position and arrangements of these blobs are

interpreted as mouse cursor movement and mouse clicks. As the user moves their hand,

the cursor on screen moves accordingly. When the user taps their index finger, the size of

the blob changes and the camera recognizes the intended mouse click.

The following figure shows the way of gestures that are to be performed.

Fig: 3.4 Gestures

As we improve our computer vision algorithms, an extensive library of

gestures could be implemented in addition to mouse movement and mouse clicks.

Typical multitouch gestures, such as zooming in and out, as well as novel gestures,

such as balling ones fist are all possible. In addition, the use of multiple laser beams

would allow for recognition of a wider range of free hand motions, enabling novel

gestures that the hardware mouse cannot support.


18/29

18

As of July 2010, the project has been presented to the media but has not been

commercialized. According to Mr. Mistry' statement, the fully functional prototype

of the Mouse less costs around $20.

Advantages:

1. Less Effort- More Efficiency.

2. Less Time- More Productivity.

3. Less Mistakes-More Accuracy.

4. Less Strain-More Health.

5. Its cool.

This is new technology will draw users to mouse-less sites in order to try it out. Therefore,show your creativity and give them a reason to come to your site like the digital design

agency.

6. Its captivating.

Creating interaction with your audience means a stronger brand, the ability to

physically control the user experience. No more splash pages to go through and lots of visual

feedback.

7. Its new.

An opportunity with budding technology like this is boundless. Spin it to target your

audience. Be creative and use it to your advantage.


19/29

19

3.5 Sixth Sense Technology:

INTRODUCTION:

Sixth Sense is a wearable gestural interface that augments the physical

world around us with digital information and lets us use natural hand gestures to interact

with that information.It was developed by Pranav Mistry, a PhD student in the Fluid

Interfaces Group at the MIT Media Lab.

SixthSense bridges the gap by bringing intangible, digital information out

into the tangible world, and allowing us to interact with this information via natural

hand.SixthSense comprises a pocket projector, a mirror and a camera. The hardware

components are coupled in a pendant like mobile wearable device.

All of us are aware of the five basic senses seeing, feeling, smelling,

tasting and hearing. But there is also another sense called the sixth sense.It is basically a

connection to something greater than what their physical senses are able to perceive. To a

layman, it would be something supernatural. Some might just consider it to be a

superstition or something psychological. But the invention ofsixth sense technologyhas

completely shocked the world. Although it is not widely known as of now but the time is

not far when this technology will change our perception of the world.

Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the

sixth sense technology. He invented Sixth Sense / WUW ( Wear UR World) which is a

wearable gestural , user friendly interface which links the physical world around us with

digital information and uses hand gestures to interact with them. He is a PhD student at

MIT and he won the Invention of the Year 2009 - by Popular Science. The device seeswhat we see but it lets out information that we want to know while viewing the object. It

can project information on any surface, be it a wall, table or any other object and uses

hand / arm movements to help us interact with the projected information. The device

brings us closer to reality and assists us in making right decisions by providing the

relevant information, thereby, making the entire world a computer.
http://theviewspaper.net/bigpage/sixth-sense/http://theviewspaper.net/bigpage/sixth-sense-technology/http://theviewspaper.net/bigpage/sixth-sense-technology/http://theviewspaper.net/bigpage/sixth-sense-technology/http://theviewspaper.net/bigpage/sixth-sense-technology/http://theviewspaper.net/bigpage/sixth-sense/


20/29

20

The Sixth Sense prototype consists of a pocket projector, mirror and a

camera. The device is pendant shaped like mobile wearing devices. Both the projector and

the camera are connected to the mobile computing device in the users pocket. The

projector projects visual information enabling surfaces, walls and physical objects around

us to be used as interfaces; while the camera recognizes and tracks users hand gestures

and physical objects using computer-vision based techniques. The software program

processes the video stream data captured by the camera and tracks the locations of the

colored markers (visual tracking fiducials) at the tip of the users fingers using simple

computer-vision techniques. It also supports multi touch and multi user interaction.

The device has a huge number of applications. Firstly, it is portable and

easily to carry as you can wear it in your neck. The drawing application lets user draw on

any surface by observing the movement of index finger. Mapping can also be done

anywhere with the features of zooming in or zooming out. The camera also helps user to

take pictures of the scene he is viewing and later he can arrange them on any surface.

Thats not it. Some of the more practical uses are reading a newspaper. Imagine reading a

newspaper and viewing videos instead of the photos in the paper. The device can also tell

you arrival, departure or delay time of your air plane on your tickets. For book lovers it is

nothing less than a blessing. Open any book and you will find the Amazon ratings of the

book. To add to it, pick any page and the device gives additional information on the text,

comments and lot more add on features. While picking up any good at the grocery store,

the user can get to know whether the product is eco friendly or not. To know the time, all

one has to do is to just gesture drawing circle on the wrist and there appears a wrist watch.

Still more work is being done on the device and when fully developed, it will definitely

revolutionize the world.

COMPONENTS

The hardware components are coupled in a pendant like mobile wearable device.

Camera

Projector

Mirror

Mobile Component

Colored Markers


21/29

21

FIG: 3.5.1 components used in sixth sense technology.

Camera

Fig: 3.5.2 Camera used in sixth sense technology


22/29

22

Captures an object in view and tracks the users hand gestures

It sends the data to smart phone

It acts as a digital eye, connecting you to the world of digital information.

Projector

Fig: 3.5.3 Projector

The projector projects visual information enabling surfaces and physical objects to

be used as interfaces

The project itself contains a battery inside, with 3 hours of battery life.

A tiny LED projector displays data sent from the smart phone on any surface in

viewobject, wall, or person.

Mirror

Fig: 3.5.4. Mirror in sixth sense


23/29

23

The usage of the mirror is significant as the projector dangles pointing downwards

from the neck.

Smart Phone

Fig: 3.5.5 Smartphone

A Web-enabled smart phone in the users pocket processes the video data.

Other software searches the Web and interprets the hand gestures.

Color Markers

Fig: 3.5.6 Color Markers

It is at the tip of the users fingers.

Marking the users fingers with red, yellow, green, and blue tape helps the

webcam recognize gestures

The movements and arrangements of these makers are interpreted into gestures

that act as interaction instructions for the projected application interfaces.


24/29

24

HOW IT WORKS? :

Fig: 3.5.7 Working Process of Sixth Sense Technology

The hardware that makes Sixth Sense work is a pendant like mobile wearable

interface.

It has a camera, a mirror and a projector and is connected wirelessly to a Bluetooth

smart phone that can slip comfortably into ones pocket.

The camera recognizes individuals, images, pictures, gestures one makes with their

hands.

Information is sent to the Smartphone for processing.

The downward-facing projector projects the output image on to the mirror.

Mirror reflects image on to the desired surface. Thus, digital information is freed

from its confines and placed in the physical world.


25/29

25

RELATED TECHNOLOGIES:

Augmented reality is a term for a live direct or indirect view of a physical real

world environment whose elements are augmented by virtual computer generated

imagery.

Gesture recognition is a topic in computer science and language technology with

the goal of interpreting human gestures via mathematical algorithms.

Computer vision is the science and technology of machines that see. It is

concerned with the theory behind artificial systems that extract information from

images.

Radio Frequency Identification is basically an electronic tagging technology that

allows the detection, tracking of tags and consequently the objects that they are

affixed to.

ADVANTAGES:

Portable

Supports multi-touch and multi-user interaction

Connectedness between world and information

Cost effective

Data access directly from machine in real time

Mind map the idea anywhere

It is an open source

CONCLUSION:

Sixth Sense recognizes the objects around us, displaying information automatically

and letting us to access it in any way we need

The Sixth Sense prototype implements several applications that demonstrate the

usefulness, viability and flexibility of the system

Allowing us to interact with this information via natural hand gestures

The potential of becoming the ultimate "transparent" user interface for accessing

information about everything around us.


26/29

26

APPLICATIONS:

Call up a map

Make a call

Create multimedia reading experiences


27/29

27

About Pranav Mistry:

Pranav Mistry, an Indian Genius, is one of the inventors of the Sixth

Sense Technology. He is a research assistant and a PhD candidate at MIT Media

Lab. Before joining MIT he worked as a UX Researcher with Microsoft. He

received Master in Media Arts and Sciences from MIT and Master of Design from

IIT Bombay. He has completed bachelors degree in Computer Science and

Engineering. Among some of his previous work, Pranav has invented Mouseless an

invisible computer mouse; intelligent sticky notes that can be searched, located and

can send reminders and messages; a pen that can draw in 3D; and a public map that

can act as Google of physical world. Pranav holds a Master in Media Arts and

Sciences from MIT and Master of Design from Industrial Design Center, IIT

Bombay. Pranavs research interests include Ubiquitous computing, Gestural and

Tangible Interaction, AI, Augmented reality, Machine vision, Collective intelligence

and Robotics.

FIG: Pranav Mistry
http://en.wikipedia.org/wiki/MIT_Media_Labhttp://en.wikipedia.org/wiki/MIT_Media_Labhttp://en.wikipedia.org/wiki/Mouselesshttp://en.wikipedia.org/wiki/Googlehttp://en.wikipedia.org/wiki/MIThttp://en.wikipedia.org/wiki/Industrial_Design_Centerhttp://en.wikipedia.org/wiki/IIT_Bombayhttp://en.wikipedia.org/wiki/IIT_Bombayhttp://en.wikipedia.org/wiki/IIT_Bombayhttp://en.wikipedia.org/wiki/Ubiquitous_computinghttp://en.wikipedia.org/wiki/Gesture_recognitionhttp://en.wikipedia.org/wiki/Tangible_User_Interfacehttp://en.wikipedia.org/wiki/AIhttp://en.wikipedia.org/wiki/Augmented_realityhttp://en.wikipedia.org/wiki/Machine_visionhttp://en.wikipedia.org/wiki/Collective_intelligencehttp://en.wikipedia.org/wiki/Roboticshttp://en.wikipedia.org/wiki/Roboticshttp://en.wikipedia.org/wiki/Collective_intelligencehttp://en.wikipedia.org/wiki/Machine_visionhttp://en.wikipedia.org/wiki/Augmented_realityhttp://en.wikipedia.org/wiki/AIhttp://en.wikipedia.org/wiki/Tangible_User_Interfacehttp://en.wikipedia.org/wiki/Gesture_recognitionhttp://en.wikipedia.org/wiki/Ubiquitous_computinghttp://en.wikipedia.org/wiki/IIT_Bombayhttp://en.wikipedia.org/wiki/IIT_Bombayhttp://en.wikipedia.org/wiki/Industrial_Design_Centerhttp://en.wikipedia.org/wiki/MIThttp://en.wikipedia.org/wiki/Googlehttp://en.wikipedia.org/wiki/Mouselesshttp://en.wikipedia.org/wiki/MIT_Media_Labhttp://en.wikipedia.org/wiki/MIT_Media_Lab


28/29

28

Conclusion:

A mouse is a pointing device that functions by detecting two-dimensional

motion relative to its supporting surface. Physically, a mouse consists of an object

held under one of the users hands, with one or more buttons. Mouseless is a an

invisible computer mouse that lets you control the pointer on the screen using your

hand but without touching any physical mouse or hardware. This advanced

technology provides range of interaction between the computer and the user such as

zoom in/out, volume control, brightness. In addition, the use of multiple laser beams

would allow for recognition of a wider range of free hand motions, enabling novel

gestures that the hardware mouse cannot support.

Finally, the Mouseless concludes that it is cool, it is captivating and it is new.


29/29

PUBLICATIONS:

[1] P. Mistry, P. Maes. Mouseless - a Computer Mouse as Small as Invisible. To be

appear in CHI2011. Interactivity. Vancouver, BC, Canada. 2011

[2] P. Mistry, P. Maes. Mouseless - an invisible computer mouse. In the Proceedings

of UIST2010. Poster. NY, USA. 2010

WEBSITES:

[1] www.pranavmistry.com/projects/mouseless/

[2] www.mouseless.es/index.php?seccion=8&idiom=ing

[3] www.techvert.com/mouseless-invisible-computer-mouse

[4] www.physorg.com

[5] www.knowbrainer.com

[6] www.teamliquid.net

[7] www.eripplescebu.com
http://www.pranavmistry.com/projects/mouseless/http://www.pranavmistry.com/projects/mouseless/http://www.pranavmistry.com/projects/mouseless/http://www.mouseless.es/index.php?seccion=8&idiom=inghttp://www.mouseless.es/index.php?seccion=8&idiom=inghttp://www.mouseless.es/index.php?seccion=8&idiom=inghttp://www.techvert.com/mouseless-invisible-computer-mousehttp://www.techvert.com/mouseless-invisible-computer-mousehttp://www.physorg.com/http://www.knowbrainer.com/http://www.teamliquid.net/http://www.teamliquid.net/http://www.knowbrainer.com/http://www.physorg.com/http://www.techvert.com/mouseless-invisible-computer-mousehttp://www.mouseless.es/index.php?seccion=8&idiom=inghttp://www.pranavmistry.com/projects/mouseless/

Date post:	05-Apr-2018
Category:	Documents
Upload:	aravind-sagar
View:	216 times
Download:	0 times

Tech Main Documntn

Documents