1 2Models of Narran FiorinaGeneralizers areas MODELS...

Eric

1 2

Eric

ESCAPE

Eric

Noise

Eric

"Models of Narran Fiorina

Eric

A

Eric

ND

Eric

Generalizers areas MODELS.

Eric

_ _

Eric

• Start with...

Eric

integrated fire model

Eric

w! = fly) t I [t)

Eric

I-D

Eric

model for

Eric

voltage

Eric

mm

Eric

vet).

Eric

_ - - - - _

Eric

n

Eric

N

Eric

VA)

Eric

_

Eric

*

Eric

*

Eric

integrate fine

Eric

of

Eric

"hand as threshold...

Eric

Spike when

Eric

cross Wth.

Eric

• Try this experimentally...

Eric

Fig 9.3 are there a text.

Eric

See... tiny black histogram... is range

Eric

_

Eric

_ _ _

Eric

• almost invisible in plot

Eric

of V vatu

Eric

v values in time

Eric

at time she before measured

Eric

spike. Fact: -This

Eric

This small

Eric

histogram

Eric

is s

Eric

pread out r

Eric

u

Eric

Do not have single [

Eric

Vth

Eric

Instead...

Eric

define:

Eric

for.

Eric

= Pr

Eric

Spinel

Eric

n)

Eric

1

Eric

loosely, Spite at end of

Eric

1 2 ' \

Eric

that times this.

Eric

fire

Eric

Wth)

Eric

deriving the escape

Eric

^ rate"

Eric

of firing from data,

Eric

Gerstner Fig.

Eric

I

Eric

Plot: _

Eric

in gray's (tiny) black

Eric

histograms:

Eric

N

Eric

"fire)

Eric

Phil no fire)

Eric

want! B free 14) = plus" fire). p _

Eric

(five) _ ply)

Eric

Now: _

Eric

pex2=

Eric

Pl

Eric

VI

Eric

fire

Eric

).

Eric

p

Eric

is fire

Eric

plus fire) _ pl

Eric

1 t

Eric

p lol no five

Eric

) in five)

Eric

• p (fire) • Phno five)

Eric

so.. -

Eric

B

Eric

La an a REY

Eric

plfirelif)=

Eric

- _

Eric

Beach (4) _

Eric

Benchley) + are4 (4)

Eric

I or same at

Eric

from "

Eric

V measurement.

Eric

•

Eric

.

Eric

3

Eric

D

Eric

her there it al Fig. 9.3

Eric

_

Eric

See...

Eric

fl

Eric

4-0) well-app

Eric

= L

Eric

to

Eric

c,

Eric

•

Eric

-2 l

Eric

flat-o))

Eric

"Soft threshold"

Eric

Recover

Eric

hard threshold as

Eric

P 1 as

Eric

as.

Eric

Say:

Eric

spiking is a

Eric

point me as with

Eric

intensity _

Eric

flush)

Eric

-0), re to bar (spinet

Eric

(titrate)

Eric

glut)

Eric

o)

Eric

Ex

Eric

pit)

Eric

cist, in small at him it.

Eric

~ ~

Eric

dt3)

Eric

dt

Eric

dt

Eric

Vth)

Eric

wth)

Eric

Vtn)dt

Eric

at

Eric

• Further

Eric

work relating

Eric

It F and point process

Eric

process in text:

Eric

Arrhenius

Eric

approximation to S.D.E.,

Eric

Pleaser (06'?)

Eric

•

Eric

In

Eric

I

Eric

I n Future A DD MORE Here !!!

Eric

*o

Eric

k

Eric

ihelihood of a spike

Eric

train

Eric

(Sec. 9=2)

Eric

\ o

Eric

L I

Eric

ininininn

Eric

at

Eric

_

Eric

wrasse

Eric

U

Eric

•

Eric

so o

Eric

1000000000 t

Eric

U o

Eric

|

Eric

of

Eric

"

Eric

P

Eric

It)

Eric

[ ]

Eric

Proba=

Eric

of

Eric

is

Eric

pita)

Eric

4 t)

Eric

]

Eric

-3 t

Eric

)

Eric

~ ~

Eric

Define

Eric

# spikes

Eric

in

Eric

each bin

Eric

b in =

Eric

n

Eric

t

Eric

n I _

Eric

follows Poisson

Eric

- distribution

Eric

I I

Eric

"I I I..."

Eric

z

Eric

<

Eric

At

Eric

u at

Eric

at

Eric

00

Eric

'

Eric

00 0

Eric

plant) =

Eric

k)

Eric

_

Eric

z

Eric

dt.plt3

Eric

[

Eric

]

Eric

[

Eric

N:

Eric

at bins - at

Eric

•

Eric

1

Eric

plt).dt

Eric

y

Eric

(N.

Eric

n ty

Eric

In')

Eric

(Binomial dig that ia

Eric

)

Eric

_ _

Eric

5

Eric

pit)

Eric

N

Eric

pit)

Eric

k

Eric

k

Eric

k

Eric

It

Eric

!

Eric

in limn

Eric

dot's

Eric

0

Eric

•

Eric

that a Spice 5 I Do not It are a spike

Eric

DEFINE: =

Eric

Eric

#

Eric

spike Train: Sequence of o's and is

Eric

Temporal

Eric

Do

Eric

N

Eric

point) =0 =

Eric

=0) =

Eric

5

Eric

pit)

Eric

pluton) =

Eric

e

Eric

-pit).

Eric

pit)

Eric

at

Eric

b to

Eric

{

Eric

]

Eric

DE

Eric

D

Eric

t

Eric

At

Eric

of

Eric

" -

Eric

at

Eric

Nt)

Eric

nt

Eric

nt

Eric

~

Eric

Call this object

Eric

3 (for data)

Eric

an particular,

Eric

{

Eric

And,

Eric

for future use:

Eric

lay

Eric

y

Eric

in the) =

Eric

7

Eric

~ptt)

Eric

P It) at

Eric

k

Eric

log(

Eric

phot)

Eric

to;

Eric

e.g(k:)

Eric

)

Eric

+ nt

Eric

nt

Eric

!

Eric

|

Eric

Likelihood of whole Spite

Eric

Log.

Eric

Spite

Eric

he train =

Eric

PhD)

Eric

TI t

Eric

part)

Eric

r

Eric

hog-likelihood

Eric

"

Eric

= log PhD) =

Eric

{ t log put)

Eric

_ _

Eric

{

Eric

~

Eric

pit)

Eric

1 t

Eric

+

Eric

nt

Eric

log

Eric

plt)

Eric

+

Eric

nt to got

Eric

_ loglnt!

Eric

)

Eric

_

Eric

-

Eric

-1 t

Eric

pit)

Eric

at + nt

Eric

t log pit) +

Eric

k

Eric

went

Eric

IN DER. of plt)

Eric

c

Eric

In limit At +0,

Eric

log PSD)

Eric

_

Eric

'

Eric

o

Eric

T

Eric

pat)

Eric

d

Eric

t

Eric

☹

Eric

n ty

Eric

long

Eric

pit)

Eric

1

Eric

n to

Eric

=

Eric

for

Eric

t

Eric

%

Eric

{

Eric

t;

Eric

Y

Eric

set of spike

Eric

times

Eric

n to

Eric

tell

Eric

Etic

Eric

= fist at

Eric

the

Eric

+ {

Eric

j

Eric

boy pit;)

Eric

h

Eric

e

Eric

log PhD)

Eric

Eric

Eric

(10.22)

Eric

P

Eric

& is

Eric

Next,

Eric

given it)

Eric

pit),

Eric

|

Eric

pit)

Eric

}

Eric

*r Be

Eric

Flog pipit)

Eric

leit)=

Eric

)

Eric

h

Eric

pit))

Eric

_

Eric

Goal in.

Eric

Parameters Isamar-he on

Eric

For spikina moose as

Eric

Given *

Eric

as,

Eric

) and

Eric

form of

Eric

of

Eric

phi that

Eric

depends an parameter

Eric

list &

Eric

of

Eric

spiking model.

Eric

E.g.

Eric

pit) =

Eric

fl

Eric

V1t7-Vth

Eric

)

Eric

) above

Eric

|

Eric

b

Eric

depends an o

Eric

o via of a _

Eric

solution

Eric

Find _

Eric

most likely parameters a

Eric

9,

Eric

is

Eric

anyway

Eric

•

Eric

plop)

Eric

_

Eric

_

Eric

argument

Eric

p(D

Eric

10)

Eric

•

Eric

p (0)

Eric

pa)

Eric

Bayes Rule

Eric

•

Eric

_ _

Eric

anginas

Eric

P(D\o)

Eric

O

Eric

ploy

Eric

then

Eric

P(D

Eric

belt) = polo)

Eric

"Flat prior case:

Eric

phot = wrist.)

Eric

11

Eric

For _

Eric

= anginas

Eric

•

Eric

pesto)

Eric

For later: = any more log pcDio) @

Eric

PARAMETERIZING spit

Eric

SPikina NEURON Moses u a

Eric

at

Eric

(6.4)

Eric

another it al text a.

Eric

spike RESPONSE model.

Eric

I IF Model

Eric

Think...

Eric

.

Eric

no.

Eric

-4 t

Eric

It it)

Eric

mm

Eric

vet)

Eric

-m-a-.i-.i-Wth

Eric

*

Eric

in

Eric

_ _ _ _ _ -

Eric

N

Eric

spike

Eric

RESET

Eric

Before spike,

Eric

soft

Eric

Vtt)=

Eric

'

Eric

e"

Eric

she

Eric

o

Eric

r

Eric

*

Eric

Time to last spike

Eric

I let-sods

Eric

After spite: Vet-a vet)

Eric

_

Eric

cu

Eric

V

Eric

the

Eric

-

Eric

reset)

Eric

-a....

Eric

- . " Went

Eric

(san]

Eric

SAM

Eric

Captures these effects via:

Eric

V(t)=

Eric

!

Eric

as

Eric

Some differences from I IF...

Eric

Upper limit a integral =

Eric

post-spike effects to build up...

Eric

across several Spikes.

Eric

Kiss

Eric

I it-sy)

Eric

ds

Eric

nine filter

Eric

+

Eric

{

Eric

t;

Eric

Y

Eric

It;)

Eric

p

Eric

After-spike

Eric

voltage joup

Eric

for IF me above,

Eric

yet is):

Eric

-cure

Eric

Vth)

Eric

At I

Eric

tty)

Eric

p Heaviside

Eric

_

Eric

•

Eric

Upper limit

Eric

an

Eric

Kls) is as... allow

Eric

stimulus history

Eric

to in part

Eric

voltage

Eric

aero s several spites.

Eric

These could

Eric

Boas or Features?

Eric

Depends an how

Eric

orig. gating variables evolve.

Eric

|

Eric

•

Eric

•

Eric

• e

Eric

-It-tile)

Eric

|

Eric

~

Eric

|

Eric

r

Eric

....i o

Eric

- I _ - - _

Eric

Viet

Eric

an nit-tin)

Eric

• t;

Eric

Not the.

Eric

4.1 of Gersturtext!

Eric

can incorporate time _ dep. Threshold

Eric

in to of

Eric

y:

Eric

shift

Eric

•

Eric

voltage

Eric

relative to fixed Vths

Eric

_

Eric

, together with:

Eric

and decay

Eric

)

Eric

and decay 1 o

Eric

(Mallow.

Eric

(2)

Eric

It r

Eric

}

Eric

It

Eric

_

Eric

(k

Eric

#

Eric

_

Eric

_

Eric

>

Eric

I I

Eric

R AND

Eric

+11 l (

Eric

I I I

Eric

spikes

Eric

\

Eric

_

Eric

t*

Eric

Z

Eric

of

Eric

_

Eric

4

Eric

41 t

Eric

For same, • =

Eric

6

Eric

s),

Eric

yes)

Eric

}.

Eric

Discrete time

Eric

formulation.

Eric

(10.21, austerity

Eric

Time bins dt

Eric

• •

Eric

Limit kiss, 415) to

Eric

be supported

Eric

over T.dt the

Eric

•

Eric

0= {

Eric

12 Cdt)

Eric

by

Eric

K(J.dt)

Eric

y

Eric

n at

Eric

of

Eric

.....

Eric

n(J.dt))

Eric

}

Eric

Beginning...

Eric

w

Eric

It:

Eric

(

Eric

It's

Eric

tat-dots."

Eric

I

Eric

t-J~dt

Eric

'dt )

Eric

nt.dt,

Eric

• • . ,

Eric

mt-J.dt

Eric

)

Eric

is

Eric

o or 1 s

Eric

pike count

Eric

{

Eric

pit)

Eric

- _

Eric

fl

Eric

it. o u

Eric

J.Notatim:

Eric

so the

Eric

w

Eric

in text

Eric

The fate )

Eric

Then... -

Eric

lay

Eric

ps

Eric

a lo)

Eric

_ _

Eric

C to

Eric

-E

Eric

L

Eric

•

Eric

f (the T). at

Eric

+ [ t;

Eric

in to

Eric

log

Eric

the

Eric

Y

Eric

)

Eric

(10.32)

Eric

units.

Eric

*side:

Eric

convexity (Boyd t Vander... )

Eric

Consider of 65),

Eric

scalar-valued f,

Eric

F is convex

Eric

if...

Eric

Consequence.

Eric

Fed

Eric

7

Eric

berghe

Eric

| Convex optimization)

Eric

x

Eric

X,

Eric

I B

Eric

(1-0)*

Eric

7 s

Eric

•

Eric

F

Eric

Exist

Eric

t

Eric

(on Fri!

Eric

for of

Eric

[o,i]

Eric

u

Eric

8 •

Eric

~

Eric

X,

Eric

XL

Eric

Fix)

Eric

Equivalent

Eric

I

Eric

co

Eric

nditian:

Eric

F

Eric

is

Eric

convex

Eric

IFF

Eric

Hessian

Eric

Matrix

Eric

"

Eric

• F _ oxide's

Eric

3]

Eric

is

Eric

pos. dug

Eric

def. _ -

Eric

_

Eric

For

Eric

unconstrained

Eric

•

Eric

So m

Eric

of convex functions is convex.

Eric

optimization problem anguish Fax), x

Eric

any

Eric

point to s.t. Fly to is global optimum.

Eric

_ _

Eric

_ ~ •

Eric

4 Can find

Eric

global optimum,

Eric

if exists

Eric

a

Eric

,

Eric

via

Eric

grade so.

Eric

desk.

Eric

at

Eric

type methods.

Eric

an ex. _

Eric

Exp (I

Eric

] is convex

Eric

•

Eric

-

Eric

_

Eric

u Kott

Eric

(linear F)

Eric

-affine)

Eric

+ e

Eric

is convex

Eric

G

Eric

if

Eric

_

Eric

_

Eric

Fl

Eric

x) is convex then so is FC

Eric

Fl

Eric

k.y

Eric

"X

Eric

~

Eric

-to)

Eric

6

Eric

If

Eric

= F

Eric

Convex,

Eric

m in.

Eric

is

Eric

concave if • -f

Eric

S is

Eric

convex.

Eric

F

Eric

-F

Eric

Same as above...

Eric

i F is concave....

Eric

is global Maximum.

Eric

ps

Eric

a lo)

Eric

_ _

Eric

C to

Eric

-E

Eric

L

Eric

•

Eric

f (the T). at

Eric

+ [ t;

Eric

in to

Eric

log

Eric

the

Eric

Y

Eric

)

Eric

log

Eric

Say

Eric

fl

Eric

x) = ex p Ex)

Eric

is ^

Eric

4

Eric

Then...

Eric

in

Eric

concave

Eric

in

Eric

concave

Eric

t

Eric

cow

Eric

ex (linear)

Eric

or... fix) concave's long convex (same answer).

Eric

it

Eric

log p (Dio) is convex

Eric

.

Eric

Can care in _

Eric

is.

Eric

_

Eric

AnD...

Eric

easily computable

Eric

gradient t Hessian

Eric

1

Eric

standard

Eric

algorithms for

Eric

mimmtutia y. New tat

Eric

or New team.

Eric

Raphson.

Eric

£

Eric

•

Eric

It r

Eric

}

Eric

It

Eric

_

Eric

(k

Eric

#

Eric

_

Eric

HI I

Eric

_

Eric

>

Eric

I I

Eric

R AND

Eric

+11 l (

Eric

I I I

Eric

spikes

Eric

\

Eric

_

Eric

t*

Eric

Z

Eric

of

Eric

_

Eric

4

Eric

41 t

Eric

• - •

Eric

Allowing more new at without a's...

Eric

It r

Eric

}

Eric

It

Eric

_

Eric

(k

Eric

#

Eric

_

Eric

HI I

Eric

_

Eric

>

Eric

I I

Eric

R AND

Eric

+11 l (

Eric

I I I

Eric

spikes

Eric

\

Eric

_

Eric

t*

Eric

Z

Eric

of

Eric

_

Eric

4

Eric

41 t

Eric

|

Eric

: ☺ | ; |

Eric

•

Eric

i

Eric

j

Eric

euros" =

Eric

: | \

Eric

¥ !

Eric

I \

Eric

as

Eric

-----------

Eric

_ _ _ _ _ $ - -

Eric

T

Eric

|

Eric

_

Eric

~

Eric

Ei

Eric

ji

Eric

7:

Eric

jilt)

Eric

B

Eric

Redefine X=

Eric

X={

Eric

I

Eric

u

Eric

)

Eric

n

Eric

-

Eric

w |

Eric

p neuron ¥

Eric

"...an

Eric

]

Eric

hi

Eric

- _

Eric

(

Eric

~

Eric

E

Eric

Of

Eric

*

Eric

u

Eric

Ki,

Eric

Fit

Eric

J

Eric

}

Eric

J

Eric

"j'

Eric

i

Eric

i,

Eric

4

Eric

2

Eric

1

Eric

~

Eric

in... ]

Eric

and... problem stays convex!

Eric

car cause

Eric

Wow at

Eric

!

Eric

Lots any

Eric

of parameters.

Eric

Protect again at oversitting...

Eric

Re-introduce

Eric

prior.

Eric

log

Eric

polis =

Eric

!

Eric

p (8) ] =

Eric

log

Eric

yo le) + log

Eric

pro)

Eric

to concave

Eric

..

Eric

if this is

Eric

concave

Eric

) to enforce

Eric

C)

Eric

smooth

Eric

"

Eric

"filters

Eric

or other

Eric

Revalorizing

Eric

constraints

Eric

. - •

Eric

whole problem stays

Eric

concave.

Eric

(2)

Eric

Allow for parameterized _

Eric

form of filters, eg via Basis Fine this.

Eric

[Shit he

Eric

(Witten

Eric

1shojaie

Eric

S )

Eric

Pillow

Eric

etal 20083

Eric

e.g.,

Eric

k

Eric

(s)

Eric

1

Eric

3

Eric

•

Eric

j

Eric

Bj(s)

Eric

it,

Eric

B

Eric

for B basis vectors, B

Eric

Beat

Eric

It

Eric

1

Eric

(

Eric

I

Eric

(t).

Eric

l

Eric

-s) B;

Eric

1(s)ds,... )

Eric

Stet-serosa's, : )

Eric

k

Eric

w

Eric

u

Eric

(o.

Eric

s...' *3, ...

Eric

]

Eric

and likewise for

Eric

• in

Eric

spike internet in filters.

Eric

SAME To m of p(olD) u Stays concave!

Eric

• to test a given Model,

Eric

Connections to

Eric

_

Eric

u Allow

Eric

stimulus to

Eric

have

Eric

spatial

Eric

_

Eric

component:

Eric

It I)

Eric

i,

Eric

X,Y,

Eric

t)

Eric

Receptive field nose is:

Eric

+ filters

Eric

Kls) skis

Eric

Xiy.s)

Eric

8 (often):

Eric

give

Eric

complex spatiotemporal

Eric

garssian noise

Eric

I to fit

Eric

felt as

Eric

• The resulting

Eric

4

Eric

X.y.s)

Eric

is

Eric

receptive field.

Eric

est. of

Eric

\ \

Eric

Panin shiet al 2003.

Eric

Compere with "L N" models

Eric

P

Eric

(t]=

Eric

N C

Eric

Llx.y.s). I (x. y, s)

Eric

1 fit by" spoke trichinas stratus."

Eric

Result: _

Eric

K

Eric

Xiyis)

Eric

is equivalent to a "weighted"

Eric

spite tri

Eric

ggeved average

Eric

,

Eric

with

Eric

• ' L <

Eric

via

Eric

fill)

Eric

Nit.

Eric

' So...

Eric

Can be

Eric

similarly used to discover

Eric

receptive fields.

Eric

_ 6

Eric

_

Eric

G connection

Eric

to R hehe

Eric

Lecture ¥

Eric

identify receptive fields for retinal ganglion cells.

Eric

• Q:

Eric

Get

Eric

better (

Eric

more predefine an "

Eric

test" data)

Eric

fit

Eric

for

Eric

an add

Eric

additional

Eric

nonlinear stage of processing...

Eric

(11-2.1,

Eric

Text)

Eric

I(Xiy,s)+

Eric

Nupstream (I

Eric

(x.y,s))

Eric

G or I

Eric

we-pta is postulated:

Eric

u can it be fit? _

Eric

Freemen t Silvered'

Eric

Vanatianal

Eric

approach

Eric

or, fit a scar

Eric

FEW cascade of

Eric

Gin

Eric

models

Eric

? SRM

Eric

De carne (Ch. 11.3) _

Eric

a text)

Eric

o

Eric

Fit G an

Eric

"test" set of data

Eric

x

Eric

u

Eric

/

Eric

_

Eric

pl

Eric

of for new

Eric

held-out

Eric

"test

Eric

u " data x

Eric

pl

Eric

k

Eric

{I

Eric

w )

Eric

- n

Eric

}

Eric

)

Eric

To

Eric

]

Eric

1

Eric

spikes

Eric

n

Eric

Unknown Stim

Eric

+

Eric

Known

Eric

fitters,etc.

Eric

r Form spikes to stimulus. _

Eric

)

Eric

know

Eric

,

Eric

consider

Eric

as function of I

Eric

w •

Eric

By exact

Eric

Same argents as above,

Eric

this is

Eric

can care ferreter aft

Eric

~ •

Eric

So... day

Eric

do Max-likelihood

Eric

Decoding

Eric

l prediction of E.

Eric

(Fig. 11.8, Text).

Eric

12

Date post:	18-Sep-2020
Category:	Documents
Upload:	others
View:	0 times
Download:	0 times

1 2Models of Narran FiorinaGeneralizers areas MODELS...

Documents