1

Presented by:Sristi KapoorShubham kejriwalRaktim RoyArnab DasSrijanee Biswas

WHAT WE WILL TALK ABOUT:-• Introduction to Blue Eyes technology • About Blue Eyes • System designing• System overview• Data security• Applications of Blue Eyes Technology• Conclusion

2

WHAT IS BLUE EYES TECHNOLOGY?

3

?

The wider meaning.. BLUE in the term stands for Bluetooth, which enables reliable wireless communication.

EYES , because the eye movement enables us to obtain a lot of interesting and important information.

4

NEEDS:-

To build a machine that can understand your emotions

A PC that can listen, talk or scream

Verify your identity, feels your presence and interact with you

5

PROPOSED TECHNOLGIESEmotion Sensor

Manual And Gaze Input Cascaded (MAGIC)

Artificial Intelligent Speech Recognition

Simple User Interest Tracker (SUITOR)

6

EMOTION SENSOR

7

EMOTION MOUSESimplest way to sense anger, fear, sadness,

disgust, happiness, surprise, etc when we use a computer

People spend approximately 1/3 of their total computer time touching the input device

Recognizes your emotions based on processed data and speak to you based on the processing

8

9

Emotion mouse implemented on a real mouse

Emotion mouse developed by ibm

10

PARAMETERS SENSED:BIOLOGICAL PARAMETERS:

Heart Rate Blood PressureBody TemperatureSkin Conductivity(GSR)

PHYSICAL PARAMETERS:

Finger PressureButton Click Frequency

Heart rate sensor

11

Steps involvedPhysiological data is obtained based on

mouse movements,button click frequency & finger presssure. Some biological parameters are also sensed.

Data acquisition system receives the analog data from several sensors and converts it to discrete data.

The discrete sampled data is sent to CPU for further processing and determination of our emotional and mental state.

12

13

MAGIC POINTING

What is it?

ManualAndGazeInputCascaded

14

MAGIC

key idea1. The eyes are used as a source of

input in “advanced user interfaces”

2. Use gaze to dynamically redefine (warp) the “home” position of the pointing cursor at the vicinity of the target

3. To effectively reduce the cursor movement.

15

Magic pointingA touch of the mouse positions the mouse

pointer at the current gaze position of the user

The pointer is always at the position where the user expects it on the screen.

This approach changes the user experience in tasks that include frequent switching between keyboard and mouse

16

Contd…

Pointing (target acquisition) is the core element here.

One has to be conscious of where one looks and how long one looks at an object otherwise selection will be erroneous.

17

APPROACHES

•LIBERAL APPROACHTo warp the cursor to every new

object user looks at. The liberal approach may appear “pro-active,”

•CONSERVATIVE APPROACHDoes not warp the cursor target until

the manual input device has been actuated.

18

19

Liberal approach

Figure 1. The liberal MAGIC pointing technique: cursor is placed in the vicinity of a target that the user fixates on.

20

CONSERVATIVE APPROACH

Figure 2. The conservative MAGIC pointing technique with “intelligent offset”

21

Fig.3 Trial Completion time

22

OVERVIEW

SUITOR

Help by fetching more information at desktop

Notice where the user’s eyes focus on the screen

Fills a scrolling ticker on a computer screen with information related to user’s task

Ex. If reading headline ,pops up the story in the browser window

23

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION•Speech Recognition (SR) is the translation of spoken words into text

•These systems analyze the person's specific voice and use it to fine tune the recognition of that

person's speech, resulting in more accurate transcription

24

25

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION

Input words are scanned and matched against internally stored words

Identification causes some action to be taken User speaks to the computer through

microphone

Filtered and fed to ADC and then stored in RAM

26

APPLICATIONs:-•To control weapons by voice commands

•Can be connected to word processors and instead of writing, simply dictate to them

•System control/navigation e.g.-GPS-connected digital maps

•Voice dialing i.e. hands free dialling in car

27

Data Acquisition Unit

The DAU consists of the following components:-

•ATMEL 8952 microcontroller• BLUE TOOTH MODULE•PCM codec • JAZZ multisensor•ALPHAUNUMERIC LCD display• LED indicators• ID CARD interface

28

29

Central System Unit – components

CONNECTION MANAGER – main task is toperform low-level blue tooth communication DATA ANALYSIS MODULE – performs theanalysis of the raw sensor data

DATA LOGGER MODULE – provides supportfor storing the monitored data.

VISUALIZATION MODULE – provides userinterface for the supervisors

30

DAU - featuresLightweightRuns on batteries - low power

consumptionEasy to use - does not disturb the

operator workingID cards for operator authorizationVoice transmission using hardware PCM

codec

31

Csu features

32

Central System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Connection

Manager

DataLogger

Connection management

Data processing

Data recording

Access verification

System maintenance

Data securityOnly registered mobile devices can connect to

the system

Bluetooth connection authentication

Bluetooth connection encryption

Access rights restrictions

Personal and physiological data encryption

33

APPLICATIONS:-

34

The first blue Eye enabled mass production device was POD, the car

manufactured by TOYOTA

Contd….35

IBM released robot named PONG equipped with BLUE EYES TECHNOLOGY

Also used in.. Retailing record and interpret customer

movements Automobile industry Video games Create “Face Responsive Display” and

“Perceptive Environment” Generic control rooms Power stationFlight control centresOperating theatres

36

CONCLUSIONProvide more delicate and user friendly

facilities in computing devices

Gap between the electronic and physical world is reduced

The computers can be run using implicit commands instead of the explicit commands

37

Thank u…..

38

39