8/2/2019 7200518-Blue-Eye

1/25

Agenda

Motivation What is BlueEye technology ? What is BlueEyes ? System designing System overview DAU CSU

Data security IBM research Conclusion

Motivation

What isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

8/2/2019 7200518-Blue-Eye

2/25

Motivation

Human error - a frequent reason ofcatastrophes and ecological disasters

Motivation

What isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

-temporary indisposition

-weariness

-oversight

8/2/2019 7200518-Blue-Eye

3/25

What is blue eye

technology ? The BLUE EYES technology aims

at creating computational

machines that have perceptualand sensory ability like those ofhuman beings.

8/2/2019 7200518-Blue-Eye

4/25

How can we make

computers see and feel ? Blue eyes uses sensing technology to

identify a users actions and to extract key

information. Information is then analyzed to determine

the users physical ,emotional ,orinformational state.

8/2/2019 7200518-Blue-Eye

5/25

What is BlueEyes ? The complex solution for human-operator

monitoring:

Visual attention monitoring Physiological condition

Operators position detection

Wireless data acquisition using bluetooth

Real time user defined alarm triggering

Recorded data playback

Motivation

What isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

8/2/2019 7200518-Blue-Eye

6/25

Doesnt predict nor interfere with operatorsthoughts

Cannot force directly the operator to work

What is BlueEyes not?

8/2/2019 7200518-Blue-Eye

7/25

Applications ofBlueEyes Generic control rooms

(System can be applied in every working environment

requiring permanent operators attention) Power station

Captain bridge

Flight control centers

Operating theatres anesthesiologists

Motivation

What isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

8/2/2019 7200518-Blue-Eye

8/25

BlueEyes - benefits Prevention from dangerous incidents

Minimization of

ecological consequences

financial loss

a threat to a human life

The reconstructionof the course of

operators work

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

8/2/2019 7200518-Blue-Eye

9/25

Implementation and

engineering considerations-THREE groups of users

OPERATOR -a person whose physiological parameters are supervised

- authorization in the system

- receiving alerts SUPERVISORa person responsible for analyzing operators

condition and performance.

SYSTEM ADMINISTRATORS- maintains the system

deliver tools for adding

- new operators to the database- defining alarm conditions

- configuring logging tools

- creating new analyzer modules

8/2/2019 7200518-Blue-Eye

10/25

Designing

A personal area network for linking allthe operators and the supervising

system Two major units

- DAU (data acquisition unit )

- CSU (central system unit )

8/2/2019 7200518-Blue-Eye

11/25

System overview

Central System UnitData Acquisition UnitAtmel 89C52

microcontrollerJazz

Multisensor

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Bluetooth

Bluetooth technology provides

means for creating a PersonalArea Network linking theoperators and the centralsystem.

DataLogger

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

System

implementationFutureimprovements

Project worksummary

Systemdemonstration

ObjectivesSystemoverview

DAUCSU

8/2/2019 7200518-Blue-Eye

12/25

The eye movement sensor

Off-shelf eye movement sensor Jazzmultisensor

Supplies raw digital data regarding- Eye position

- Level of blood oxygenation

- Acceleration along horizontal and verticalaxes

- Ambient light intensity

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project worksummary

System

demonstration

8/2/2019 7200518-Blue-Eye

13/25

Jazz multisensor

Jazz Multisensor

8/2/2019 7200518-Blue-Eye

14/25

Jazz

8/2/2019 7200518-Blue-Eye

15/25

DAU

The DAU consists of the following components

ATMEL 8952 microcontroller

BLUE TOOTH MODULE supports synchronous voice data

transmission PCM CODECused to transmit operators voice and central

system sound feedback

UARTcommunication between bluetooth module andmicrocontroller (115200 bps)

MAX232level shifter

ALPHAUNUMERIC LCD display

LED indicators

ID CARD interface

8/2/2019 7200518-Blue-Eye

16/25

BlueEyesData Acquisition Unit

ID card

DAU - components

MC 145483PCM codec

ID cardinterface Simplekeyboard

Jazz MultisensorBeeper

LCD displayLED indicators

Atmel 89C52

microcontrollerUART MAX232

UART

Bluetoothmodule

microphoneearphone

8/2/2019 7200518-Blue-Eye

17/25

Implementation - DAU

Bluetooth module

PCM codec board

Batteries and

voltage level monitor

Microcontroller board

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Futureimprovements

Project work

summary

Systemdemonstration

DAUCSU

8/2/2019 7200518-Blue-Eye

18/25

DAU - features

Lightweight

Runs on batteries - low

power consumption

Easy to use - does notdisturb the operator

working ID cards for operator

authorization

Voice transmission using

hardware PCM codec

Data Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

Bluetooth

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

System

implementationFutureimprovements

Project worksummary

Systemdemonstration

ObjectivesSystemoverview

DAUCSU

8/2/2019 7200518-Blue-Eye

19/25

CSU - features

Central System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth

Connectionmanagement

Data processing

Visualization

Data recording

Accessverification

System maintenance

ConnectionManager

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

System

implementationFutureimprovements

Project worksummary

Systemdemonstration

ObjectivesSystemoverview

DAUCSU

DataLogger

8/2/2019 7200518-Blue-Eye

20/25

CSU components

CONNECTION MANAGER main task to performlow-level blue tooth communication

DATA ANALYSIS MODULE performs the analysisof the raw sensor data in order to obtaininformation about operators physiological condition

DATA LOGGER MODULE provides support forstoring the monitored data.

VISULAIZATION MODULE provides user interfacefor the supervisors

8/2/2019 7200518-Blue-Eye

21/25

Data security

Only registered mobile devicescan connect to the system

Bluetooth connection authentication Bluetooth connection encryption

Access rights restrictions

Personal and physiological data encryption

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

System

implementationFutureimprovements

Project worksummary

Systemdemonstration

ObjectivesSystemoverview

DAUCSU

8/2/2019 7200518-Blue-Eye

22/25

IBM research

BLUE EYE EMOTIONAL MOUSEsensors in the mouse ,sense the physiological

attributes which are correlated to emotions

using correlation model-by simply touching the mouse ,the computer

will be able to determine a personsemotional state.

BLUE EYE enabled TELEVISION couldbecome active when the user makes an eyecontact.

8/2/2019 7200518-Blue-Eye

23/25

Conclusion

In the near future ,ordinary householddevices- such as television ,

refrigerators ,ovens may be able to dotheir jobs when we look at them andspeak to them.

Future applications of blue eyetechnology is limitless

8/2/2019 7200518-Blue-Eye

24/25

References

www.seminar4u.com

www.howstuffswork.com

www.cs.put.poznan.com

www.whitepapers.com

www.ibmresearchcenter.com

www.almaden.ibm.com

http://www.seminar4u.com/http://www.howstuffswork.com/http://www.cs.put.poznan.com/http://www.whitepapers.com/http://www.ibmresearchcenter.com/http://www.almaden.ibm.com/http://www.almaden.ibm.com/http://www.ibmresearchcenter.com/http://www.whitepapers.com/http://www.cs.put.poznan.com/http://www.howstuffswork.com/http://www.seminar4u.com/

8/2/2019 7200518-Blue-Eye

25/25

Thank you

BlueEyesHuman-Operator

Monitoring System

MotivationWhat isBlueEyes ?

Physiologicalfoundations

Systemdesign

Systemimplementation

Systemdemonstration

Futureimprovements

Project work

summary