2-Axis 2-Axis Electroencephalogram Electroencephalogram

ControllerControllerDr. Boris Hyle ParkDr. Boris Hyle Park

Group FGroup FJoseph Steven FletcherJoseph Steven Fletcher

Ryan Alan LaCroixRyan Alan LaCroixGary Matthew StroupGary Matthew Stroup

Kenneth Gerard SugermanKenneth Gerard Sugerman

Presentation OverviewPresentation Overview

PurposePurpose– Compatible with pre-existing devicesCompatible with pre-existing devices

Proposed SolutionProposed Solution– NeuroSkyNeuroSky– Electrode PlacementElectrode Placement– Conditioning CircuitConditioning Circuit

ResultsResults– PrototypePrototype– Device UseDevice Use

PurposePurpose Produce a two dimensional Produce a two dimensional

Electroencephalogram (EEG) controller for Electroencephalogram (EEG) controller for widespread applicationwidespread application– Mechanical armMechanical arm– Hands free light for DentistHands free light for Dentist– Wheel ChairWheel Chair

Adapted from www.toysrus.com Adapted from www.fotosearch.com/bthumb

http://blogs.static.mentalfloss.com

PurposePurpose

Electroencephalogram (EEG)Electroencephalogram (EEG)– Measure net brain activity through voltage Measure net brain activity through voltage

measurements by surface electrodemeasurements by surface electrode– No physical movement necessaryNo physical movement necessary

PurposePurpose

Interface DeviceInterface Device– EEG MeasurementsEEG Measurements

Brain ActivityBrain Activity

– Device of choiceDevice of choice

http://www.ipmc.cnrs.frwww2.latech.edu

?

Project OverviewProject Overview

http://www.ipmc.cnrs.fr www2.latech.edu

Measure Brain Activity (EEG)

Translate into signal usable by a device (wheelchair, robotic arm, etc)

Proposed SolutionProposed Solution

Reverse engineer two existing Reverse engineer two existing inexpensive productsinexpensive products– Force TrainerForce Trainer– MindFlexMindFlex

www.unclemilton.comhttp://mindflexgames.com

Proposed Solution

2 Independent Axes– 3 Levels of control

•Off

•Med

•High

•Off

•Med

•High

Adapted From http://blogs.static.mentalfloss.com/blogs/archives/22329.html?cnn=yes

Project OverviewProject Overview

http://www.ipmc.cnrs.fr www2.latech.edu

Measure Brain Activity (EEG)

Translate into signal usable by a device (wheelchair, robotic arm, etc)

Electrode Placement PlanElectrode Placement Plan

~1in ~4 in

~5 in

~2.5 in

Frontal LobeFrontal Lobe– Devices already Devices already

locatedlocated Premotor CortexPremotor Cortex

– Motor Control Motor Control (Ohno et al)(Ohno et al)

Occipital LobeOccipital Lobe– Visual stimuli? Visual stimuli?

(Quick, D)(Quick, D)

MindFlexMindFlex

Force TrainerForce Trainer

Electrode PlacementElectrode Placement

Force TrainerForce Trainer– Occipital LobeOccipital Lobe

MindflexMindflex– Frontal Lobe Frontal Lobe

~1in ~4 in

~5 in

Project OverviewProject Overview

http://www.ipmc.cnrs.fr www2.latech.edu

Measure Brain Activity (EEG)

Translate into signal usable by a device (wheelchair, robotic arm, etc)

What inputs can a device read

Device InteractionDevice Interaction

Three Levels of Control Per AxisThree Levels of Control Per AxisOutput vs. Time

-1

0

1

2

3

0 10 20 30 40 50

Time (sec)

Ou

tpu

t (m

V)

MicrocontrollerMicrocontroller

What is a MicrocontrollerWhat is a Microcontroller– Small computerSmall computer

MemoryMemoryProcessing CoreProcessing CoreProgrammable inputsProgrammable inputs

– true, falsetrue, false

PurposePurpose

One ChannelOne Channel Three LevelsThree Levels

Two ChannelsTwo Channels Two LevelTwo Level

Output vs. Time

-1

0

1

2

3

0 10 20 30 40 50

Time (sec)

Ou

tpu

t (m

V)

High Cutoff

0

1

0 10 20 30 40 50

Time (sec)

Ou

tpu

t

Low Cutoff

0

1

0 10 20 30 40 50

Time (sec)

Ou

tpu

t

Project OverviewProject Overview

http://www.ipmc.cnrs.fr www2.latech.edu

Measure Brain Activity (EEG)

Translate into signal usable by a device (wheelchair, robotic arm, etc)

What do the Brain Activity Measurements give us

Proposed SolutionProposed Solution

Existing ProductsExisting Products– Force TrainerForce Trainer– MindFlexMindFlex

CommonalitiesCommonalities– NeuroSky ChipNeuroSky Chip

www.neurosky.com

NeuroSkyNeuroSky

NeuroSky chip outputNeuroSky chip output– DC Motor ControlDC Motor Control

Pulse width ModulationPulse width Modulation

Fan HighFan MediumFan Off

NeuroskyNeurosky

Increase Brain ActivityIncrease Brain Activity

Increase Pulse WidthIncrease Pulse Width

Fan High

http://www.ipmc.cnrs.fr

Project OverviewProject Overview

http://www.ipmc.cnrs.fr

www2.latech.edu

Measure Brain Activity (EEG)

Translate into signal usable by a device (wheelchair, robotic arm, etc)

Conditioning CircuitConditioning Circuit

Two CharacteristicsTwo Characteristics– Pulse width to Analog Voltage Pulse width to Analog Voltage

MagnitudeMagnitude– Analog to Digital (2 bit)Analog to Digital (2 bit)

Prototype: Brain Operated Remote Prototype: Brain Operated Remote Interface System (BORIS)Interface System (BORIS)– BORIS-1BORIS-1– BORIS-2BORIS-2

Conditioning CircuitConditioning Circuit

Pulse Width to Analog Voltage Pulse Width to Analog Voltage Magnitude (BORIS-1&2)Magnitude (BORIS-1&2)

Vin +

Vin --9V

+

-

-9V

+

-+9V +9V

-9V

+

-+9V

Vout

Conditioning CircuitConditioning Circuit

Analog to DigitalAnalog to Digital

High Cutoff 3.25VLow Cutoff 2.2V

Conditioning CircuitConditioning Circuit

Analog to DigitalAnalog to Digital– BORIS-1BORIS-1

LabView Script with ELVIS-1LabView Script with ELVIS-1

Conditioning CircuitConditioning Circuit

Analog to DigitalAnalog to Digital– BORIS-2BORIS-2

Voltage ComparatorVoltage Comparator Supplied Supplied

Source/DrainSource/DrainVdd

+

-Vout

1

Vout 2

+9V

Vdd

+9V

+

-

Vss

Vss

Vin

PrototypePrototype BORIS-1BORIS-1

– TetheredTethered– External Power SourceExternal Power Source– Requires a Desktop PCRequires a Desktop PC http://mindflexgames.com www.unclemilton.com

PrototypePrototype

BORIS-2BORIS-2– WirelessWireless– Battery PoweredBattery Powered

High Cutoff 2V

Low Cutoff 1.5V

High Cutoff 3.25VLow Cutoff 2.2V

Results (BORIS-2)Results (BORIS-2)Force Trainer MindFlex

How to use the DeviceHow to use the Device

OutputOutput– Pin1/2Pin1/2

Axis 1Axis 1

– Pin3/4Pin3/4Axis 2 Axis 2

Mic

roco

ntr

olle

r

How to use the DeviceHow to use the Device

OutputOutput– Pin5Pin5

GNDGND

– Pin6Pin6 +9 Volts+9 Volts

– Pin7Pin7 -9 Volts-9 Volts

– Pin8Pin8 Digital offDigital off

– Pin9Pin9 Digital onDigital on

Mic

roco

ntr

olle

r

Supply Voltage

Drain Voltage

Future WorkFuture Work

BORIS-3BORIS-3– Floating cutoff valuesFloating cutoff values– Use the NeuroSky chip onlyUse the NeuroSky chip only

As opposed to integrated into a As opposed to integrated into a MindFlex/Force Trainer circuit boardMindFlex/Force Trainer circuit board

– Have circuit printed on a circuit boardHave circuit printed on a circuit board

Improved efficiency (size, power)Improved efficiency (size, power)

ConclusionConclusion

Successful in the Proof of ConceptSuccessful in the Proof of Concept– Developed a 2-axis EEG ControllerDeveloped a 2-axis EEG Controller

Live DemonstrationLive Demonstration

AcknowlegementsAcknowlegements

Dr. Boris Hyle ParkDr. Boris Hyle Park– Assistant Professor, BioengineeringAssistant Professor, Bioengineering

Hong XuHong Xu– Development EngineerDevelopment Engineer

Ron PoutreRon Poutre– FunFly HobbyFunFly Hobby

Dr. Jerome SchultzDr. Jerome Schultz– Department Chair, BioengineeringDepartment Chair, Bioengineering

Abolfathi, Peter Puya. Abolfathi, Peter Puya. Toyota makes a wheelchair steered by brainwavesToyota makes a wheelchair steered by brainwaves. 2 July 2009.. 2 July 2009.http://www.gizmag.com/toyota-wheelchair-powered-brain-waves/12121/. 8 April 2010. http://www.gizmag.com/toyota-wheelchair-powered-brain-waves/12121/. 8 April 2010.

Blain, Loz. Blain, Loz. Honda’s Brain-Machine Interface: controlling robots by thought aloneHonda’s Brain-Machine Interface: controlling robots by thought alone. 2 April 2009. 2 April 2009http://www.gizmag.com/honda-asimo-brain-machine-interface-mind-control/11379/. http://www.gizmag.com/honda-asimo-brain-machine-interface-mind-control/11379/. 8 April 2010.8 April 2010.

Galan, F. et al. “Continuous Brain-Actuated Control of an Intelligent Wheelchair byGalan, F. et al. “Continuous Brain-Actuated Control of an Intelligent Wheelchair by Human EEG”. ftp://ftp.idiap.ch/pub/papers/2008/galan-grazBCI2008-2008.pdf. Human EEG”. ftp://ftp.idiap.ch/pub/papers/2008/galan-grazBCI2008-2008.pdf. Murph, Darren. Murph, Darren. Thought-control research brings mental channel changing ever closerThought-control research brings mental channel changing ever closer. 24 Feb. . 24 Feb.

2010. http://www.engadget.com/2010/02/24/thought-control-research-brings-mental2010. http://www.engadget.com/2010/02/24/thought-control-research-brings-mental-channel-changing-ever-clo/?icid=engadget-iphone-url. 8 April 2010.-channel-changing-ever-clo/?icid=engadget-iphone-url. 8 April 2010.

Ohno, K. et al. Ohno, K. et al. Analysis of EEG signals in Memory Guided Saccade TasksAnalysis of EEG signals in Memory Guided Saccade Tasks. Nagoya Institute. Nagoya Instituteof technology. http://www.springerlink.com/content/q647qh703mpl4352/fulltext.pdf.of technology. http://www.springerlink.com/content/q647qh703mpl4352/fulltext.pdf.8 April 2010.8 April 2010.

Provost, Sheldon, J. Lucas McKay. “A real-time EEG Based Remote Control of a RadioProvost, Sheldon, J. Lucas McKay. “A real-time EEG Based Remote Control of a Radio -Shack Car”. http://www.lems.brown.edu/~scp/eegremotecontrolcar.pdf.-Shack Car”. http://www.lems.brown.edu/~scp/eegremotecontrolcar.pdf.Quick, Darren. Quick, Darren. What’s on your mind-microelectrodes offer poke free brain controlWhat’s on your mind-microelectrodes offer poke free brain control. 3 July 2009.. 3 July 2009.

http://www.gizmag.com/brain-microelectrodes/12141/. 8 April 2010.http://www.gizmag.com/brain-microelectrodes/12141/. 8 April 2010.Quick, Darren. Quick, Darren. Brain to Brain communication over the internetBrain to Brain communication over the internet. 6 October 2009.. 6 October 2009.

http://www.gizmag.com/brain-to-brain-communication/13055/. 8 April 2010.http://www.gizmag.com/brain-to-brain-communication/13055/. 8 April 2010.The Local. “Scientists develop helmet to control toy cars via brain waves”. The Local. “Scientists develop helmet to control toy cars via brain waves”. Science &Science & TechnologyTechnology. 19 Jun 2008. http://www.thelocal.de/sci-tech/20080619-12577.html.. 19 Jun 2008. http://www.thelocal.de/sci-tech/20080619-12577.html.Dr. Boris Hyle Park Assistant Professor, Bioengineering Dr. Boris Hyle Park Assistant Professor, Bioengineering

A211 Bourns Hall, Riverside, CA 92521A211 Bourns Hall, Riverside, CA 92521Hong Xu, Development Engineer in Bioengineering at UCR Hong Xu, Development Engineer in Bioengineering at UCR

A217 Bourns Hall, Riverside, CA 92521A217 Bourns Hall, Riverside, CA 92521Phone: 951-827-7235Phone: 951-827-7235

  Ron PoutreRon PoutreFunfly HobbyFunfly Hobby6950 Indiana Avenue Suite #1, Riverside, CA 925066950 Indiana Avenue Suite #1, Riverside, CA 92506

References

Questions?

http://www.istockphoto.com

Floating Cutoff ValuesFloating Cutoff Values

Floating Cutoff ValuesFloating Cutoff Values