Mind Readers

TJ StrzeleckiMatt Waldersen

Rick Schuman (Presenting)Krishna Jharjaria

What We’re Doing

The proposed project will be a mobile brain-computer interface.

Computer applications will be presented to the user through commercially available video glasses.

An EOG and commercially available EEG will be mounted inside of a common enclosure and will enable the user to navigate and select various applications.

A dsPIC microcontroller will be used to acquire the EOG and EEG signals, the EEG signals will be analyzed by an FPGA and a BeagleBoard XM will control the virtual reality environment as well as execute all of the computer applications

Project-Specific Success Criteria

1) An ability to encode/decode data packets from a NeuroSky EEG.

2) An ability for a user to select applications based on signals from a NeuroSky EEG.

3) An ability for a user to navigate between different applications on a display using EOG signals.

4) An ability for the system to interactively train the user to effectively operate the device.

5) An ability to display a live video stream from an external camera module, and integrate applications into the video system.

Block Diagram

BeagleBoard – Software Considerations

SPI Micro communication 16-bit SPI

USB Webcam 640 x 480 resolution 30 – 60 Hz

S-Video out

Ubuntu Linux dist.

Software Modules OpenCV▪ Frame capture▪ Possible Image Processing

~ Posix Threads Gtk or OpenGL

Beagleboard - Flowchart

Beagleboard - Interface

MicroController – Software Considerations

SPI EOG (2) BeagleBoard-xM 8 word Fifo

Timer for Interrupts

UART EEG dongle

DSP library FFT function Derivative of EOG

signals

GPIO pins for FPGA

External ADC

MicroController - Flowchart

FPGA – Software Considerations GPIO I/O

Vertical input EOG (5) Horizontal input EOG (5) Direction output signal

(4) N_Reset

Clock on the board

5 Hidden Layers Out to 4 binary outputs

Each Neuron Multiplier Lookup Table Non-linear

sigmoid function Muxed Inputs

10-bit Floating Point generated

FPGA - Flowchart

FPGA Preliminary Block Diagram

Questions