Brain Imaging in Natural Cognition• Sit still! Nearly all brain imaging studies (MEG,

PET, fMRI, and EEG) are conducted in rigidly static seated or prone positions with only the most

minimal finger movements allowed.

• In all modalities but EEG, the sensors are heavy.

• Muscle and movements contribute (‘noise’) signals.

• But this is artificial. Nearly all our tasks involve complex, motivated behaviors, and interactions with a 3-D space.

• Our brains have evolved for this – but brain activity during free movement in 3-D space has never been observed or modeled!

PET

MEG

fMRIEEG

Amp+ADC+Wireless65 x 40 mm

1G Mobile Wireless EEG Cap

DSP and Display module

65 x 40mm

...

MEMS Dry Electrode

Dynamic Motion Platform

Hydraulic Hexapod Steward Platform– Provides kinesthetic stimuli– Realistic driving sensation

A real vehicle- Provides realistic driving handling

VR-based Driving SimulatorVR-based Driving Simulator

360o Surrounded Virtual-Reality Highway Scenes

– Provides a safe and realistic driving environment

– Full field of view

VR-based Dynamic VR-based Dynamic Driving SimulatorDriving Simulator

EEG-based Drowsiness Monitoring

Wet Electrodes Dry Electrodes

Mobile Wireless EEG in the StarCAVE of UCSDEEG signals are acquired by dry MEMS sensor EEG cap and

transmitted to and recorded by a cell phone via BlueTooth.