+ All Categories
Home > Documents > lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion...

lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion...

Date post: 09-Oct-2020
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
39
Brownian motion 18.S995 - L03 & 04
Transcript
Page 1: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Brownian motion18.S995 - L03 & 04

Page 2: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

[email protected]

Typical length scales

http://www2.estrellamountain.edu/faculty/farabee/BIOBK/biobookcell2.html

Page 3: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Brownian motion

Page 4: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

“Brownian” motionUbersichtBrownsche Bewegung - Historischer Uberblick

Relativistische Di�usionsprozesseFazit

Jan Ingen-Housz (1730-1799)

1784/1785:

http://www.physik.uni-augsburg.de/theo1/hanggi/History/BM-History.html

Jorn Dunkel Di�usionsprozesse und Thermostatistik in der speziellen Relativitatstheorie

Page 5: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

UbersichtBrownsche Bewegung - Historischer Uberblick

Relativistische Di�usionsprozesseFazit

Robert Brown (1773-1858)

1827: irregulare Eigenbewegung von Pollen in Flussigkeit

http://www.brianjford.com/wbbrownc.htm

Jorn Dunkel Di�usionsprozesse und Thermostatistik in der speziellen Relativitatstheorie

irregular motion of pollen in fluid

Linnean society, London

Page 6: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be
Page 7: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

!"#$%& $' (%$)*+,* -$.+$*!"#$%&!$'!(%$)*+,*!-$.+$*!"#$%&'()*+,-#./0102/3//4 5"#67,8&(7,#./0932/3114 :"#$;<*%='<>8?7#

./09@2/3/94

!"#$%&' ((()*+&,-&)%".),# !"#$%&' (/0/1&2/,)"$- !"#$%&' (/0/1&2/,)"$-!"#$%&'!((()*+&,-&)%".),# !"#$%&'!(/0/1&2/,)"$- !"#$%&'!(/0/1&2/,)"$-

RTD !

RTD

1!

mcD

232

!Ca"#6 PkN "6 R

D"$243

A'7*"#:+B"#!C#90/#./3D14 5,,"#A'E8"#"#C#1F3#./3D14 5,,"#A'E8"#$"C#91G#./3DG4

Page 8: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

UbersichtBrownsche Bewegung - Historischer Uberblick

Relativistische Di�usionsprozesseFazit

Jean Baptiste Perrin (1870-1942, Nobelpreis 1926)

Mouvement brownien et realite moleculaire, Annales de chimie et dephysique VIII 18, 5-114 (1909)

Les Atomes, Paris, Alcan (1913)

� colloidal particles ofradius 0.53µm

� successive positionsevery 30 secondsjoined by straight linesegments

� mesh size is 3.2µm

Experimenteller Nachweis der atomistischen Struktur der Materie

Jorn Dunkel Di�usionsprozesse und Thermostatistik in der speziellen Relativitatstheorie

experimental evidence for atomistic structure of matter

Nobel prize

Page 9: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Norbert Wiener(1894-1864)

MIT

Page 10: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

[email protected]

Relevance in biology

• intracellular transport

• intercellular transport

• microorganisms must beat BM to achieve directed

locomotion

• tracer diffusion = important experimental “tool”

• generalized BMs (polymers, membranes, etc.)

Page 11: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

[email protected]

Polymers & filaments (D=1)

Drosophila oocyte

Goldstein lab, PNAS 2012

Dogic Lab, Brandeis

Physical parameters(e.g. bending rigidity)

from fluctuation analysis

Page 12: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Brownian tracer particles in a bacterial suspension

PRL 2013

Bacillus subtilis Tracer colloids

Page 13: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

http://web.mit.edu/mbuehler/www/research/f103.jpg

Page 14: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Basic idea

Split dynamics into

• deterministic part (drift)

• random part (diffusion)

Page 15: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Typical problems

Determine

• noise ‘structure’

• transport coefficients

• first passage (escape) times http

://w

ww

.pna

s.or

g/co

nten

t/10

4/41

/160

98/F

1.ex

pans

ion.

htm

l

D

Page 16: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Probability space

A[0, 1]

B

P[;] = 0

Page 17: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Expectation values of discrete random variables

Page 18: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Expectation values of continuous random variables

Page 19: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Chapter 1

Di↵usion and SDE models

Excellent reviews of the topics discussed in this chapter can be found in Refs. [CPB08,HTB90, GHJM98, HM09].

1.1 Random walks

1.1.1 Unbiased random walk (RW)

Consider the one-dimensional unbiased RW (fixed initial position X0 = x0, N steps oflength `)

XN

= x0 + `

NX

i=1

Si

(1.1)

where Si

2 {±1} are iid. random variables (RVs) with P[Si

= ±1] = 1/2. Noting that 1

E[Si

] = �1 · 12+ 1 · 1

2= 0, (1.2)

E[Si

Sj

] = �ij

E[S2i

] = �ij

(�1)2 · 1

2+ (1)2 · 1

2

�= �

ij

, (1.3)

we find for the first moment of the RW

E[XN

] = x0 + `

NX

i=1

E[Si

] = x0 (1.4)

1By definition, for some RV X with normalized non-negative probability density p(x) = d

dx

P[X x],we have E[F (X)] =

Rdx p(x)F (x). For discrete RVs, we can think of p(x) as being a sum of suitably

normalized �-distributions.

2

Random walk model

Page 20: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Chapter 1

Di↵usion and SDE models

Excellent reviews of the topics discussed in this chapter can be found in Refs. [CPB08,HTB90, GHJM98, HM09].

1.1 Random walks

1.1.1 Unbiased random walk (RW)

Consider the one-dimensional unbiased RW (fixed initial position X0 = x0, N steps oflength `)

XN

= x0 + `

NX

i=1

Si

(1.1)

where Si

2 {±1} are iid. random variables (RVs) with P[Si

= ±1] = 1/2. Noting that 1

E[Si

] = �1 · 12+ 1 · 1

2= 0, (1.2)

E[Si

Sj

] = �ij

E[S2i

] = �ij

(�1)2 · 1

2+ (1)2 · 1

2

�= �

ij

, (1.3)

we find for the first moment of the RW

E[XN

] = x0 + `

NX

i=1

E[Si

] = x0 (1.4)

1By definition, for some RV X with normalized non-negative probability density p(x) = d

dx

P[X x],we have E[F (X)] =

Rdx p(x)F (x). For discrete RVs, we can think of p(x) as being a sum of suitably

normalized �-distributions.

2

Page 21: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Chapter 1

Di↵usion and SDE models

Excellent reviews of the topics discussed in this chapter can be found in Refs. [CPB08,HTB90, GHJM98, HM09].

1.1 Random walks

1.1.1 Unbiased random walk (RW)

Consider the one-dimensional unbiased RW (fixed initial position X0 = x0, N steps oflength `)

XN

= x0 + `

NX

i=1

Si

(1.1)

where Si

2 {±1} are iid. random variables (RVs) with P[Si

= ±1] = 1/2. Noting that 1

E[Si

] = �1 · 12+ 1 · 1

2= 0, (1.2)

E[Si

Sj

] = �ij

E[S2i

] = �ij

(�1)2 · 1

2+ (1)2 · 1

2

�= �

ij

, (1.3)

we find for the first moment of the RW

E[XN

] = x0 + `

NX

i=1

E[Si

] = x0 (1.4)

1By definition, for some RV X with normalized non-negative probability density p(x) = d

dx

P[X x],we have E[F (X)] =

Rdx p(x)F (x). For discrete RVs, we can think of p(x) as being a sum of suitably

normalized �-distributions.

2

Page 22: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Chapter 1

Di↵usion and SDE models

Excellent reviews of the topics discussed in this chapter can be found in Refs. [CPB08,HTB90, GHJM98, HM09].

1.1 Random walks

1.1.1 Unbiased random walk (RW)

Consider the one-dimensional unbiased RW (fixed initial position X0 = x0, N steps oflength `)

XN

= x0 + `

NX

i=1

Si

(1.1)

where Si

2 {±1} are iid. random variables (RVs) with P[Si

= ±1] = 1/2. Noting that 1

E[Si

] = �1 · 12+ 1 · 1

2= 0, (1.2)

E[Si

Sj

] = �ij

E[S2i

] = �ij

(�1)2 · 1

2+ (1)2 · 1

2

�= �

ij

, (1.3)

we find for the first moment of the RW

E[XN

] = x0 + `

NX

i=1

E[Si

] = x0 (1.4)

1By definition, for some RV X with normalized non-negative probability density p(x) = d

dx

P[X x],we have E[F (X)] =

Rdx p(x)F (x). For discrete RVs, we can think of p(x) as being a sum of suitably

normalized �-distributions.

2

Page 23: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Second moment (uncentered)

Page 24: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Second moment (uncentered)

Page 25: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Second moment (uncentered)

Page 26: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Second moment (uncentered)

Page 27: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Second moment (uncentered)

Page 28: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit

Let

Chapter 1

Di↵usion and SDE models

Excellent reviews of the topics discussed in this chapter can be found in Refs. [CPB08,HTB90, GHJM98, HM09].

1.1 Random walks

1.1.1 Unbiased random walk (RW)

Consider the one-dimensional unbiased RW (fixed initial position X0 = x0, N steps oflength `)

XN

= x0 + `

NX

i=1

Si

(1.1)

where Si

2 {±1} are iid. random variables (RVs) with P[Si

= ±1] = 1/2. Noting that 1

E[Si

] = �1 · 12+ 1 · 1

2= 0, (1.2)

E[Si

Sj

] = �ij

E[S2i

] = �ij

(�1)2 · 1

2+ (1)2 · 1

2

�= �

ij

, (1.3)

we find for the first moment of the RW

E[XN

] = x0 + `

NX

i=1

E[Si

] = x0 (1.4)

1By definition, for some RV X with normalized non-negative probability density p(x) = d

dx

P[X x],we have E[F (X)] =

Rdx p(x)F (x). For discrete RVs, we can think of p(x) as being a sum of suitably

normalized �-distributions.

2

Page 29: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit

and for the second moment

E[X2N

] = E[(x0 + `

NX

i=1

Si

)2]

= E[x20 + 2x0`

NX

i=1

Si

+ `2NX

i=1

NX

j=1

Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

E[Si

Sj

]

= x20 + 2x0 · 0 + `2

NX

i=1

NX

j=1

�ij

= x20 + `2N. (1.5)

The variance (second centered moment)

E⇥(X

N

� E[XN

])2⇤

= E[X2N

� 2XN

E[XN

] + E[XN

]2]

= E[X2N

]� 2E[XN

]E[XN

] + E[XN

]2]

= E[X2N

]� E[XN

]2 (1.6)

therefore grows linearly with the number of steps:

E⇥(X

N

� E[XN

])2⇤= `2N. (1.7)

Continuum limit From now on, assume x0 = 0 and consider an even number of stepsN = t/⌧ , where ⌧ > 0 is the time required for a single step of the RW and t the total time.The probability P (N,K) := P[X

N

/` = K] to be at an even position x/` = K � 0 after Nsteps is given by the binomial coe�cient

P (N,K) =

✓1

2

◆N

✓N

N�K

2

=

✓1

2

◆N

N !

((N +K)/2)! ((N �K)/2)!. (1.8)

The associated probability density function (PDF) can be found by defining

p(t, x) :=P (N,K)

2`=

P (t/⌧, x/`)

2`(1.9)

and considering limit ⌧, ` ! 0 such that

D :=`2

2⌧= const, (1.10)

3

Page 30: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit

yielding the Gaussian

p(t, x) 'r

1

4⇡Dtexp

✓� x2

4Dt

◆(1.11)

Eq. (1.11) is the fundamental solution to the di↵usion equation,

@t

pt

= D@xx

p, (1.12)

where @t

, @x

, @xx

, . . . denote partial derivatives. The mean square displacement of the con-tinuous process described by Eq. (1.11) is

E[X(t)2] =

Zdx x2 p(t, x) = 2Dt, (1.13)

in agreement with Eq. (1.7).

Remark One often classifies di↵usion processes by the (asymptotic) power-law growthof the mean square displacement,

E[(X(t)�X(0))2] ⇠ tµ. (1.14)

• µ = 0 : Static process with no movement.

• 0 < µ < 1 : Sub-di↵usion, arises typically when waiting times between subsequentjumps can be long and/or in the presence of a su�ciently large number of obstacles(e.g. slow di↵usion of molecules in crowded cells).

• µ = 1 : Normal di↵usion, corresponds to the regime governed by the standard CentralLimit Theorem (CLT).

• 1 < µ < 2 : Super-di↵usion, occurs when step-lengths are drawn from distributionswith infinite variance (Levy walks; considered as models of bird or insect movements).

• µ = 2 : Ballistic propagation (deterministic wave-like process).

4

(pset1)

Page 31: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

yielding the Gaussian

p(t, x) 'r

1

4⇡Dtexp

✓� x2

4Dt

◆(1.11)

Eq. (1.11) is the fundamental solution to the di↵usion equation,

@t

pt

= D@xx

p, (1.12)

where @t

, @x

, @xx

, . . . denote partial derivatives. The mean square displacement of the con-tinuous process described by Eq. (1.11) is

E[X(t)2] =

Zdx x2 p(t, x) = 2Dt, (1.13)

in agreement with Eq. (1.7).

Remark One often classifies di↵usion processes by the (asymptotic) power-law growthof the mean square displacement,

E[(X(t)�X(0))2] ⇠ tµ. (1.14)

• µ = 0 : Static process with no movement.

• 0 < µ < 1 : Sub-di↵usion, arises typically when waiting times between subsequentjumps can be long and/or in the presence of a su�ciently large number of obstacles(e.g. slow di↵usion of molecules in crowded cells).

• µ = 1 : Normal di↵usion, corresponds to the regime governed by the standard CentralLimit Theorem (CLT).

• 1 < µ < 2 : Super-di↵usion, occurs when step-lengths are drawn from distributionswith infinite variance (Levy walks; considered as models of bird or insect movements).

• µ = 2 : Ballistic propagation (deterministic wave-like process).

4

Page 32: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

non-BrownianLevy-flight

Brownian motion

Page 33: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

1.1.2 Biased random walk (BRW)

Consider a one-dimensional hopping process on a discrete lattice (spacing `), defined suchthat during a time-step ⌧ a particle at position X(t) = `j 2 `Z can either

(i) jump a fixed distance ` to the left with probability �, or

(ii) jump a fixed distance ` to the right with probability ⇢, or

(iii) remain at its position x with probability (1� �� ⇢).

Assuming that the process is Markovian (does not depend on the past), the evolution ofthe associated probability vector P (t) = (P (t, x)) = (P

j

(t)), where x = `j, is governed bythe master equation

P (t+ ⌧, x) = (1� �� ⇢)P (t, x) + ⇢ P (t, x� `) + �P (t, x+ `). (1.15)

Technically, ⇢, � and (1� �� ⇢) are the non-zero-elements of the corresponding transitionmatrix W = (W

ij

) with Wij

> 0 that governs the evolution of the column probabilityvector P (t) = (P

j

(t)) = (P (t, y)) by

Pi

(t+ ⌧) = Wij

Pj

(t) (1.16)

or, more generally, for n steps P (t + n⌧) = W nP (t). The stationary solutions are theeigenvectors of W with eigenvalue 1. To preserve normalization, one requires

Pi

Wij

= 1.

Continuum limit Define the density p(t,x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

5

Page 34: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Master equations

1.1.2 Biased random walk (BRW)

Consider a one-dimensional hopping process on a discrete lattice (spacing `), defined suchthat during a time-step ⌧ a particle at position X(t) = `j 2 `Z can either

(i) jump a fixed distance ` to the left with probability �, or

(ii) jump a fixed distance ` to the right with probability ⇢, or

(iii) remain at its position x with probability (1� �� ⇢).

Assuming that the process is Markovian (does not depend on the past), the evolution ofthe associated probability vector P (t) = (P (t, x)) = (P

j

(t)), where x = `j, is governed bythe master equation

P (t+ ⌧, x) = (1� �� ⇢)P (t, x) + ⇢ P (t, x� `) + �P (t, x+ `). (1.15)

Technically, ⇢, � and (1� �� ⇢) are the non-zero-elements of the corresponding transitionmatrix W = (W

ij

) with Wij

> 0 that governs the evolution of the column probabilityvector P (t) = (P

j

(t)) = (P (t, y)) by

Pi

(t+ ⌧) = Wij

Pj

(t) (1.16a)

or, more generally, for n steps

P (t+ n⌧) = W nP (t). (1.16b)

The stationary solutions are the eigenvectors of W with eigenvalue 1. To preserve normal-ization, one requires

Pi

Wij

= 1.

Continuum limit Define the density p(t,x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

5

Page 35: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit Define the density p(t, x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

with drift velocity u and di↵usion constant D given by2

u := (⇢� �)`

⌧, D := (⇢+ �)

`2

2⌧. (1.19b)

We recover the classical di↵usion equation (1.12) from Eq. (1.19a) for ⇢ = � = 0.5. Thetime-dependent fundamental solution of Eq. (1.19a) reads

p(t, x) =

r1

4⇡Dtexp

✓�(x� ut)2

4Dt

◆(1.20)

Remarks Note that Eqs. (1.12) and Eq. (1.19a) can both be written in the current-form

@t

p+ @x

jx

= 0 (1.21)

with

jx

= up�D@x

p, (1.22)

reflecting conservation of probability. Another commonly-used representation is

@t

p = Lp, (1.23)

where L is a linear di↵erential operator; in the above example (1.19b)

L := �u @x

+D @xx

. (1.24)

Stationary solutions, if they exist, are eigenfunctions of L with eigenvalue 0.

2Strictly speaking, when taking the limits ⌧, ` ! 0, one requires that ⇢ and � change such that u andD remain constant. Assuming that ⇢+ � = const, this means that (⇢� �) ⇠ `.

6

Page 36: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit Define the density p(t, x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

with drift velocity u and di↵usion constant D given by2

u := (⇢� �)`

⌧, D := (⇢+ �)

`2

2⌧. (1.19b)

We recover the classical di↵usion equation (1.12) from Eq. (1.19a) for ⇢ = � = 0.5. Thetime-dependent fundamental solution of Eq. (1.19a) reads

p(t, x) =

r1

4⇡Dtexp

✓�(x� ut)2

4Dt

◆(1.20)

Remarks Note that Eqs. (1.12) and Eq. (1.19a) can both be written in the current-form

@t

p+ @x

jx

= 0 (1.21)

with

jx

= up�D@x

p, (1.22)

reflecting conservation of probability. Another commonly-used representation is

@t

p = Lp, (1.23)

where L is a linear di↵erential operator; in the above example (1.19b)

L := �u @x

+D @xx

. (1.24)

Stationary solutions, if they exist, are eigenfunctions of L with eigenvalue 0.

2Strictly speaking, when taking the limits ⌧, ` ! 0, one requires that ⇢ and � change such that u andD remain constant. Assuming that ⇢+ � = const, this means that (⇢� �) ⇠ `.

6

Page 37: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit Define the density p(t, x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

with drift velocity u and di↵usion constant D given by2

u := (⇢� �)`

⌧, D := (⇢+ �)

`2

2⌧. (1.19b)

We recover the classical di↵usion equation (1.12) from Eq. (1.19a) for ⇢ = � = 0.5. Thetime-dependent fundamental solution of Eq. (1.19a) reads

p(t, x) =

r1

4⇡Dtexp

✓�(x� ut)2

4Dt

◆(1.20)

Remarks Note that Eqs. (1.12) and Eq. (1.19a) can both be written in the current-form

@t

p+ @x

jx

= 0 (1.21)

with

jx

= up�D@x

p, (1.22)

reflecting conservation of probability. Another commonly-used representation is

@t

p = Lp, (1.23)

where L is a linear di↵erential operator; in the above example (1.19b)

L := �u @x

+D @xx

. (1.24)

Stationary solutions, if they exist, are eigenfunctions of L with eigenvalue 0.

2Strictly speaking, when taking the limits ⌧, ` ! 0, one requires that ⇢ and � change such that u andD remain constant. Assuming that ⇢+ � = const, this means that (⇢� �) ⇠ `.

6

Page 38: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit Define the density p(t, x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

with drift velocity u and di↵usion constant D given by2

u := (⇢� �)`

⌧, D := (⇢+ �)

`2

2⌧. (1.19b)

We recover the classical di↵usion equation (1.12) from Eq. (1.19a) for ⇢ = � = 0.5. Thetime-dependent fundamental solution of Eq. (1.19a) reads

p(t, x) =

r1

4⇡Dtexp

✓�(x� ut)2

4Dt

◆(1.20)

Remarks Note that Eqs. (1.12) and Eq. (1.19a) can both be written in the current-form

@t

p+ @x

jx

= 0 (1.21)

with

jx

= up�D@x

p, (1.22)

reflecting conservation of probability. Another commonly-used representation is

@t

p = Lp, (1.23)

where L is a linear di↵erential operator; in the above example (1.19b)

L := �u @x

+D @xx

. (1.24)

Stationary solutions, if they exist, are eigenfunctions of L with eigenvalue 0.

2Strictly speaking, when taking the limits ⌧, ` ! 0, one requires that ⇢ and � change such that u andD remain constant. Assuming that ⇢+ � = const, this means that (⇢� �) ⇠ `.

6

Time-dependent solution

Page 39: lec03 04 BM - MIT Mathematicsdunkel/Teach/18.S995_2017F/slides/lec03_04_… · Chapter 1 Di↵usion and SDE models Excellent reviews of the topics discussed in this chapter can be

Continuum limit Define the density p(t, x) = P (t, x)/`. Assume ⌧, ` are small, so thatwe can Taylor-expand

p(t+ ⌧, x) ' p(t, x) + ⌧@t

p(t, x) (1.17a)

p(t, x± `) ' p(t, x)± `@x

p(t, x) +`2

2@xx

p(t, x) (1.17b)

Neglecting the higher-order terms, it follows from Eq. (1.15) that

p(t, x) + ⌧@t

p(t, x) ' (1� �� ⇢) p(t, x) +

⇢ [p(t, x)� `@x

p(t, x) +`2

2@xx

p(t, x)] +

� [p(t, x) + `@x

p(t, x) +`2

2@xx

p(t, x)]. (1.18)

Dividing by ⌧ , one obtains the advection-di↵usion equation

@t

p = �u @x

p+D @xx

p (1.19a)

with drift velocity u and di↵usion constant D given by2

u := (⇢� �)`

⌧, D := (⇢+ �)

`2

2⌧. (1.19b)

We recover the classical di↵usion equation (1.12) from Eq. (1.19a) for ⇢ = � = 0.5. Thetime-dependent fundamental solution of Eq. (1.19a) reads

p(t, x) =

r1

4⇡Dtexp

✓�(x� ut)2

4Dt

◆(1.20)

Remarks Note that Eqs. (1.12) and Eq. (1.19a) can both be written in the current-form

@t

p+ @x

jx

= 0 (1.21)

with

jx

= up�D@x

p, (1.22)

reflecting conservation of probability. Another commonly-used representation is

@t

p = Lp, (1.23)

where L is a linear di↵erential operator; in the above example (1.19b)

L := �u @x

+D @xx

. (1.24)

Stationary solutions, if they exist, are eigenfunctions of L with eigenvalue 0.

2Strictly speaking, when taking the limits ⌧, ` ! 0, one requires that ⇢ and � change such that u andD remain constant. Assuming that ⇢+ � = const, this means that (⇢� �) ⇠ `.

6(useful later when discussing Brownian motors)


Recommended