Date post: | 26-Jun-2018 |
Category: |
Documents |
Upload: | nguyennhan |
View: | 215 times |
Download: | 0 times |
The Wetware-Hardware Interface:Three ways of interfacing our brain to a computer
Rudy Lauwereins
Vice President Smart Systems Technology Office
Professor Katholieke Universiteit Leuven
Overview
Rudy Lauwereins IMEC restricted 2010 3
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
Overview
Rudy Lauwereins IMEC restricted 2010 4
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
Why interfacing computers to the brain?
Rudy Lauwereins IMEC restricted 2010 5
What 40 years “More Moore” brought to us…
From 200 bytes filling a big room…
To 32 Gbytes filling your pocket…
Rudy Lauwereins IMEC restricted 2010 6
Nevertheless, input/output remained the same…
Input: keyboard
Output: screen
Rudy Lauwereins IMEC restricted 2010 7
From a computer-in-your-pocket to hidden-electronics-everywhere:
autonomous interfaces to the real-world needed
Internet Internet –– 7x24, Every Modality of Life7x24, Every Modality of Life
The Embedded Internet: 4th Generation 15B15BDevicesDevices
15B15BDevicesDevices
ResearchersResearchers
MainframesMainframes
ResearchersResearchers
MainframesMainframes Cell PhonesCell Phones
UbiquitousUbiquitous
Cell PhonesCell Phones
UbiquitousUbiquitous
Cell PhonesCell Phones
UbiquitousUbiquitous
PervasivePervasive
EmbeddedEmbedded
PervasivePervasive
EmbeddedEmbedded
PervasivePervasive
EmbeddedEmbeddedServers, Servers, PCPC’’ss
ManyMany
Servers, Servers, PCPC’’ss
ManyMany
Servers, Servers, PCPC’’ss
ManyMany
Source: Intel
Heterogeneous interfaces needed
Revolution enabled byMore than Moore
© Intel
Rudy Lauwereins IMEC restricted 2010 8
For health care related hidden-electronics-everywhere, we need
interfacing with electrogenic characteristics of the body
System level –electrical activity of all neuronsmeasured outside the body
Macro level –electrical activity of a region of neuronsstimulated inside the body
Micro level –electrical activity of one neuronmeasured/stimulated inside the body
Too bulkyToo uncomfortable
Too coarseNo feedback loop
Non existent
Overview
Rudy Lauwereins IMEC restricted 2010 9
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
System level interfaces
Rudy Lauwereins IMEC restricted 2010 10
What miniaturization can bring you:
See your heart activity… comfortably and continuously
Not this… but this…
Rudy Lauwereins IMEC restricted 2010 11
What miniaturization can bring you:
Hear your brain activity… comfortably and continuously
Not this…
0 10 20 30 40 50 60 70 80 90
-20
-10
0
10
20
30
40
50
60
Frequency (Hz)
Pow
er/
frequency (
dB
/Hz)
PSD Eyes Closed all electrodes dry (C4 magnetic)
F3
C3
P3
O1
F4
C4
P4
O2
but this…
Listen to your brain activity
Rudy Lauwereins IMEC restricted 2010 12
What miniaturization can bring you:
Hear your brain activity… comfortably and continuously
Overview
Rudy Lauwereins IMEC restricted 2010 13
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
Macro level interfaces
Rudy Lauwereins IMEC restricted 2010 14
Challenges for DBS implantable devices
MRI complianceElectrodestability
More contacts
Smaller contacts
Stimulation &Recording Steering &
calibration
Easy handling
Test path-Therapy finding-Approval-Human use
Rudy Lauwereins IMEC restricted 2010 15
VISION: in vivo
Medical DBS practice today IMEC approach
[Medtronic DBS implant]
Rudy Lauwereins IMEC restricted 2010 16
Wafer-level micro fabrication & packaging
of neural probes
ASIC
NeuroprobePCB
Flip-chip
connections Wire-bond
connections
Rudy Lauwereins IMEC restricted 2010 17
Broad choice of topologies & materials
characterized in solution, in vitro, in vivo
227um50 μm
TiN
Black Pt
IrOx
CNT
Rudy Lauwereins IMEC restricted 2010 18
Efficient design cycle using experimental
characterization – modeling – simulation
-200 -100 0 100 200 300 400 5000
5
10
15
Distance from electrode surface top (=0) in um
Ele
ctr
ical
po
ten
tial
in V
acute, <50>-50-<50>
chronic, <50>-50-<50>
acute, <100>
chronic, <100>
acute, <50>-50-<50>, 2xj
chronic, <50>-50-<50>, 2xj
<50>-50-<50>, 2xj
<50>-50-<50>
Rudy Lauwereins IMEC restricted 2010 19
Achieving compliance for (bio)medical use:
Biocompatibility, MRI compliance, insertion behavior
14 DIV14 DIV
cap
with KULeuven
Rudy Lauwereins IMEC restricted 2010 20
Signal processing & electronics for simultaneous
multi-channel recording & stimulation
stimulation
recording
pulse length: 200 ms
Stimulus (1/10)
Received signal
after analog
compensation
Template
Digital interpol.
Time (s)
Vo
lta
ge
(V
)
with KULeuven with KULeuven
Rudy Lauwereins IMEC restricted 2010 21
From components to a fully integrated implantable
micro system for small animal (and human) use
Stretchableinterconnect
Flexiblepackaging
Bi-directionalMixed-signal
ASIC
Active neuroprobe
High-density2D/2.5D/3D
or flex probe
Wireless (OTS)
DSP/uC (OTS)
Wireless link
Battery (OTS)
Ultra-thinchip tech.
Power-Performance scalable wireless link
Selective field-steeredneuronal stimulation and
recording
Imp
lan
tab
le P
ack
ag
ing
& I
nte
rco
nn
ect
Stretchableinterconnect
Flexiblepackaging
Bi-directionalMixed-signal
ASIC
Active neuroprobe
High-density2D/2.5D/3D
or flex probe
Wireless (OTS)
DSP/uC (OTS)
Wireless link
Battery (OTS)
Ultra-thinchip tech.
Power-Performance scalable wireless link
Selective field-steeredneuronal stimulation and
recording
Imp
lan
tab
le P
ack
ag
ing
& I
nte
rco
nn
ect
Human case
Small animalAcute case
Small animalchronic case
Overview
Rudy Lauwereins IMEC restricted 2010 22
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
Micro level interfaces
Rudy Lauwereins IMEC restricted 2010 25
Technology paves the way from cell to
computer
SAM PLLCrosslinker EnzymeSAM PLLCrosslinker Enzyme
ASIC
NeuroprobePCB
Flip-chip
connections Wire-bond
connections
Rudy Lauwereins IMEC restricted 2010 26
Via functional cell-IC interfacing towards novel
in vitro and in vivo tools for life sciences and healthcare
signal
NanoIONICS NanoELECTRONICS
Rudy Lauwereins IMEC restricted 2010 27
VISION: in vitro
• From classical neuroscience to probing and controlling the brain at the level of a single cell and even single synapse
Classical method(patch clamp) IMEC approach
Rudy Lauwereins IMEC restricted 2010 28
3D electrodes: nails
Flat vs. nail-like:
• Increase electrode-membrane coupling
• Increase Rseal better signal quality
IMECClassical planar
Rudy Lauwereins IMEC restricted 2010 29
Tuning hardware to fit biology
• Replace planar electrodes with 3D cellular probes
On chip “ENGULFMENT” Improved signal coupling(reduced signal leakage,reduced parasitics)
Rudy Lauwereins IMEC restricted 2010 30
Applications: in vitro
• R&D tools for basic science (e.g. understanding cellular signaling, communication, disease mechanisms)
• Drug screening
• Biosensors
• Actuation and sensing of prosthesis
IMEC’s NEURAY chip
Rudy Lauwereins IMEC restricted 2010 31
Tuning hardware to fit biology
• Full system integration (customized for application)
CMOS readout/control electronicsIn situ amplificationTSMC 0.18 µm technology
+
Cellular probes: needles & syringes
syringe
needle
Rudy Lauwereins IMEC restricted 2010 32
From technology to the complete prototype system
for in vitro micro nail array recording & stimulation
• Process development for nails• CMOS design• Packaging• System setup
Rudy Lauwereins IMEC restricted 2010 33
Cellular responses
Increased actin concentrationaround nails ENGULFMENT
Axon guidance due to nail spacing CELL TAXIS
Overview
Rudy Lauwereins IMEC restricted 2010 35
Why interfacing computers to the brain?
System level interfaces
Macro level interfaces
Micro level interfaces
From Science Fiction to Science Fact?
From Science Fiction to Science Fact?
Rudy Lauwereins IMEC restricted 2010 36
From micro-level in-vitro to in-vivo…
Sensing and steering individual neurons will enablethe coupling of prostheses to the human nervous system
Rudy Lauwereins IMEC restricted 2010 37
From micro-level in-vitro to in-vivo… and back to in-
vitro: the scary part
V2.0
Will the data centersof the future looklike this?