NON-MEDICAL USES OF BCI TECHNOLOGY

NON-MEDICAL USES OF BCI TECHNOLOGY

BRAIN-COMPUTER INTERFACE

http://www.epe.tuiasi.ro/2010/pdf/EPE2010_BCI_EN.html

OUTLINE

1. Improvements in BCI technology

2. Real-time decoding of mental states

3. BCI for entertainment

DRY ELECTRODES

1. Improvements in BCI technology

http://neurogadget.com/2011/03/21/neurofocus-reveals-mynd-the-first-wireless-full-brain-eeg-headset/1416

MINIMAL USER TRAINING

1. Improvements in BCI technology

● from training the user to machine learning● with stimuli from outside, less training● machine learning helps a lot, faster calibration

STUDY (2008):● which proportion of users can use it in the first session● 14 subjects, never used BCI● SMR-based BCI● offline calibration + online feedback

MINIMAL USER TRAINING

1. Improvements in BCI technology

MINIMAL USER TRAINING

1. Improvements in BCI technology

MINIMAL CALIBRATION:

SUBJECT INDEPENDENT CLASSIFIERS

1. Improvements in BCI technology

1. No calibration:Data from previous sessions -> classifier

2. Zero-training classifier:2009SMR-basedmany subject-dependent experiments togetherset of voting classifiers

BCI DEFICIENCY

1. Improvements in BCI technology

● for some it just doesn’t work● deficiency rate about 15-30% (SMR-based BCI)● correlations with gamma-waves found

STUDY (2010):● Cat I - successful training + successful feedback (6)● Cat II - successful training + unsuccessful feedback (2)● Cat III - unsuccessful everything (3)● online feedback calibration tried with them

BCI DEFICIENCY

1. Improvements in BCI technology

BCI DEFICIENCY

1. Improvements in BCI technology

GUIDED PRACTICE FOR A FAST-DECISION BCI

1. Improvements in BCI technology

20098 subjects

3 runs (slow->fast)

GUIDED PRACTICE FOR A FAST-DECISION BCI

1. Improvements in BCI technology

EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE

1. Improvements in BCI technology

● mental states affect how we perform with BCI● some states are better for some tasks

STUDY (2010):● 30 subjects● SMR-based BCI● left-right motor imagery● split in two by prestimulus band-power (high/low)

EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE

1. Improvements in BCI technology

EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE

1. Improvements in BCI technology

OUTLINE

1. Improvements in BCI technology

2. Real-time decoding of mental states

3. BCI for entertainment

MENTAL STATE MONITORING2. Real-time decoding of mental states

● to optimize human performance● usually done with other measures● fatigue, emotion, workload● applications:

○ medical○ user interface evaluation○ help the user

● offline vs online

ATTENTION2. Real-time decoding of mental states

● safety-critical applications● blink and heart rate monitoring● alpha-waves - no visual information processed● detect microsleep before it

ATTENTION2. Real-time decoding of mental states

STUDY (2008):● 11 male drivers● 3 tasks:

○ K0 - fixate at a cross○ K1 - cross replaced by a video○ K2 - active driving

● sound played at the same time (high-low), had to react

RESULTS:● K2 larger reaction● alpha and gamma wave power decreased from K0-K2

MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states

MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states

WORKLOAD2. Real-time decoding of mental states

● Improve design of products.● Usability studies.

STUDY (2007):● 12 male, 5 female● driving on a highway 100 km/h (primary task)● auditory reaction every 7.5 s (left/right) (secondary task)● workload task (tertiary task)

○ mental calculation○ auditory task

WORKLOAD2. Real-time decoding of mental states

WORKLOAD2. Real-time decoding of mental states

COGNITION OF MUSIC2. Real-time decoding of mental states

STUDY (2010):● 13 subjects● major triads in root position● repeated 7-11 times before changing the chord (randomly)● subject rated the fit of the new chord on scale 1-7● neuronal patterns also analyzed

COGNITION OF MUSIC2. Real-time decoding of mental states

OUTLINE

1. Improvements in BCI technology

2. Real-time decoding of mental states

3. BCI for entertainment

MEDIA APPLICATIONS3. BCI for entertainment

MEDIA APPLICATIONS3. BCI for entertainment

GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment

GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment

GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment

GAMES WITH ADDITIONAL INPUT FROM BCI

3. BCI for entertainment

● BCI as additional input device● needs to be working well● tailor the game to the gamer

CONCLUSION

● Have to improve BCI so that it works for all● Support human performance● Usability tests● Entertainment● What has happened in 2010 - 2014?

Thanksfor

listening!