Post on 06-Apr-2018
transcript
8/2/2019 7200518-Blue-Eye
1/25
Agenda
Motivation What is BlueEye technology ? What is BlueEyes ? System designing System overview DAU CSU
Data security IBM research Conclusion
Motivation
What isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
8/2/2019 7200518-Blue-Eye
2/25
Motivation
Human error - a frequent reason ofcatastrophes and ecological disasters
Motivation
What isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
-temporary indisposition
-weariness
-oversight
8/2/2019 7200518-Blue-Eye
3/25
What is blue eye
technology ? The BLUE EYES technology aims
at creating computational
machines that have perceptualand sensory ability like those ofhuman beings.
8/2/2019 7200518-Blue-Eye
4/25
How can we make
computers see and feel ? Blue eyes uses sensing technology to
identify a users actions and to extract key
information. Information is then analyzed to determine
the users physical ,emotional ,orinformational state.
8/2/2019 7200518-Blue-Eye
5/25
What is BlueEyes ? The complex solution for human-operator
monitoring:
Visual attention monitoring Physiological condition
Operators position detection
Wireless data acquisition using bluetooth
Real time user defined alarm triggering
Recorded data playback
Motivation
What isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
8/2/2019 7200518-Blue-Eye
6/25
Doesnt predict nor interfere with operatorsthoughts
Cannot force directly the operator to work
What is BlueEyes not?
8/2/2019 7200518-Blue-Eye
7/25
Applications ofBlueEyes Generic control rooms
(System can be applied in every working environment
requiring permanent operators attention) Power station
Captain bridge
Flight control centers
Operating theatres anesthesiologists
Motivation
What isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
8/2/2019 7200518-Blue-Eye
8/25
BlueEyes - benefits Prevention from dangerous incidents
Minimization of
ecological consequences
financial loss
a threat to a human life
The reconstructionof the course of
operators work
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
8/2/2019 7200518-Blue-Eye
9/25
Implementation and
engineering considerations-THREE groups of users
OPERATOR -a person whose physiological parameters are supervised
- authorization in the system
- receiving alerts SUPERVISORa person responsible for analyzing operators
condition and performance.
SYSTEM ADMINISTRATORS- maintains the system
deliver tools for adding
- new operators to the database- defining alarm conditions
- configuring logging tools
- creating new analyzer modules
8/2/2019 7200518-Blue-Eye
10/25
Designing
A personal area network for linking allthe operators and the supervising
system Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
8/2/2019 7200518-Blue-Eye
11/25
System overview
Central System UnitData Acquisition UnitAtmel 89C52
microcontrollerJazz
Multisensor
ConnectionManager
Data Analysis
VisualizationModuleBluetooth Bluetooth
Bluetooth technology provides
means for creating a PersonalArea Network linking theoperators and the centralsystem.
DataLogger
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
System
implementationFutureimprovements
Project worksummary
Systemdemonstration
ObjectivesSystemoverview
DAUCSU
8/2/2019 7200518-Blue-Eye
12/25
The eye movement sensor
Off-shelf eye movement sensor Jazzmultisensor
Supplies raw digital data regarding- Eye position
- Level of blood oxygenation
- Acceleration along horizontal and verticalaxes
- Ambient light intensity
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project worksummary
System
demonstration
8/2/2019 7200518-Blue-Eye
13/25
Jazz multisensor
Jazz Multisensor
8/2/2019 7200518-Blue-Eye
14/25
Jazz
8/2/2019 7200518-Blue-Eye
15/25
DAU
The DAU consists of the following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE supports synchronous voice data
transmission PCM CODECused to transmit operators voice and central
system sound feedback
UARTcommunication between bluetooth module andmicrocontroller (115200 bps)
MAX232level shifter
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface
8/2/2019 7200518-Blue-Eye
16/25
BlueEyesData Acquisition Unit
ID card
DAU - components
MC 145483PCM codec
ID cardinterface Simplekeyboard
Jazz MultisensorBeeper
LCD displayLED indicators
Atmel 89C52
microcontrollerUART MAX232
UART
Bluetoothmodule
microphoneearphone
8/2/2019 7200518-Blue-Eye
17/25
Implementation - DAU
Bluetooth module
PCM codec board
Batteries and
voltage level monitor
Microcontroller board
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Futureimprovements
Project work
summary
Systemdemonstration
DAUCSU
8/2/2019 7200518-Blue-Eye
18/25
DAU - features
Lightweight
Runs on batteries - low
power consumption
Easy to use - does notdisturb the operator
working ID cards for operator
authorization
Voice transmission using
hardware PCM codec
Data Acquisition Unit
Atmel 89C52microcontroller
JazzMultisensor
Bluetooth
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
System
implementationFutureimprovements
Project worksummary
Systemdemonstration
ObjectivesSystemoverview
DAUCSU
8/2/2019 7200518-Blue-Eye
19/25
CSU - features
Central System Unit
ConnectionManager
Data Analysis
VisualizationModuleBluetooth
Connectionmanagement
Data processing
Visualization
Data recording
Accessverification
System maintenance
ConnectionManager
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
System
implementationFutureimprovements
Project worksummary
Systemdemonstration
ObjectivesSystemoverview
DAUCSU
DataLogger
8/2/2019 7200518-Blue-Eye
20/25
CSU components
CONNECTION MANAGER main task to performlow-level blue tooth communication
DATA ANALYSIS MODULE performs the analysisof the raw sensor data in order to obtaininformation about operators physiological condition
DATA LOGGER MODULE provides support forstoring the monitored data.
VISULAIZATION MODULE provides user interfacefor the supervisors
8/2/2019 7200518-Blue-Eye
21/25
Data security
Only registered mobile devicescan connect to the system
Bluetooth connection authentication Bluetooth connection encryption
Access rights restrictions
Personal and physiological data encryption
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
System
implementationFutureimprovements
Project worksummary
Systemdemonstration
ObjectivesSystemoverview
DAUCSU
8/2/2019 7200518-Blue-Eye
22/25
IBM research
BLUE EYE EMOTIONAL MOUSEsensors in the mouse ,sense the physiological
attributes which are correlated to emotions
using correlation model-by simply touching the mouse ,the computer
will be able to determine a personsemotional state.
BLUE EYE enabled TELEVISION couldbecome active when the user makes an eyecontact.
8/2/2019 7200518-Blue-Eye
23/25
Conclusion
In the near future ,ordinary householddevices- such as television ,
refrigerators ,ovens may be able to dotheir jobs when we look at them andspeak to them.
Future applications of blue eyetechnology is limitless
8/2/2019 7200518-Blue-Eye
24/25
References
www.seminar4u.com
www.howstuffswork.com
www.cs.put.poznan.com
www.whitepapers.com
www.ibmresearchcenter.com
www.almaden.ibm.com
http://www.seminar4u.com/http://www.howstuffswork.com/http://www.cs.put.poznan.com/http://www.whitepapers.com/http://www.ibmresearchcenter.com/http://www.almaden.ibm.com/http://www.almaden.ibm.com/http://www.ibmresearchcenter.com/http://www.whitepapers.com/http://www.cs.put.poznan.com/http://www.howstuffswork.com/http://www.seminar4u.com/8/2/2019 7200518-Blue-Eye
25/25
Thank you
BlueEyesHuman-Operator
Monitoring System
MotivationWhat isBlueEyes ?
Physiologicalfoundations
Systemdesign
Systemimplementation
Systemdemonstration
Futureimprovements
Project work
summary