neuroscience + machine intelligence

@thefreemanlab | NYAI

about me: neuroscientist open source + open science

@thefreemanlab

janelia.org

star fleet academy

there’s a lot we don’t know (2016)

loudon county public library

hubel and wiesel (1959)

V1

V3d

V2d

V3v

V2vTH

TF

CITvAITv

PITv

PITd

MT

CITdAITd

STPa

FSTSTPp

MSTl

MSTd

V4dV4t

V3A 7aDP

LIP

PIPVIP

POMDP

MIP Somato-sensory

Orbito-frontal

Lateralprefrontal

Auditory

Olfa

ctor

y

Motor

46

36

FEF

Dorsal prefrontal

Medial prefrontal

Cingulate

V4v

VOTER

ER

HC

LGN

Retina SC

MLI

1 cm

Pulvinar

rosenblatt

PERCEPTRON

(1957)

(1980)fukushima

NEOCOGNITRON

(1985)lecun

HIERARCHICAL LEARNING MACHINE

(1986)rumelhart et al.

BACK PROPAGATION

but humans are way better than neural nets, right?? (2007)

V1

V3d

V2d

V3v

V2vTH

TF

CITvAITv

PITv

PITd

MT

CITdAITd

STPa

FSTSTPp

MSTl

MSTd

V4dV4t

V3A 7aDP

LIP

PIPVIP

POMDP

MIP Somato-sensory

Orbito-frontal

Lateralprefrontal

Auditory

Olfa

ctor

y

Motor

46

36

FEF

Dorsal prefrontal

Medial prefrontal

Cingulate

V4v

VOTER

ER

HC

LGN

Retina SC

MLI

1 cm

Pulvinar

V1

V3d

V2d

V3v

V2vTH

TF

CITvAITv

PITv

PITd

MT

CITdAITd

STPa

FSTSTPp

MSTl

MSTd

V4dV4t

V3A 7aDP

LIP

PIPVIP

POMDP

MIP Somato-sensory

Orbito-frontal

Lateralprefrontal

Auditory

Olfa

ctor

y

Motor

46

36

FEF

Dorsal prefrontal

Medial prefrontal

Cingulate

V4v

VOTER

ER

HC

LGN

Retina SC

MLI

1 cm

Pulvinar

????

corey ziemba david heeger eero simoncelli tony movshon @nyu

Prop

ortio

n of

cel

lsPr

opor

tion

of c

ells

V1n = 102

V2n = 103

Modulation index

−0.5 0 0.50

0.4

−0.5 0 0.50

0.4

while we were in the lab… (2012)

science / engineering

(2015)

(2015)

matthias bethge leon gatys

(2000)

javiar portilla eero simoncelli

(2011)

open source has enabled and democratized machine intelligence

… and science needs to catch up!

what’s next? (2016-?)

@sofroniewn

two photon mesoscope

nicholas sofroniew dan flicking karel svoboda

tactile virtual reality

nicholas sofroniew

crowdsourcing human intelligence

HEXAWORLD!

labyrinth / cool deep mind papers

labyrinth / cool deep mind papers

science / engineering

science + engineering

thanks!