+ All Categories
Home > Documents > Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne...

Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne...

Date post: 15-Jan-2016
Category:
View: 213 times
Download: 0 times
Share this document with a friend
43
Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth Sciences October 24th 2011
Transcript
Page 1: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

Page 1

The Construction and Use of Linear Models in Large-scale Data Assimilation

Tim Payne

Large-Scale Inverse Problems and Applications in the Earth Sciences

October 24th 2011

Page 2: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 2Page 2

Part I.

The Construction of Linear Models in Data Assimilation

Page 3: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 3Page 3

Notation

Page 4: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 4Page 4

Update-Prediction Cycle

Page 5: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 5Page 5

First Strategy – exact evolution of covariances

Page 6: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 6Page 6

Second strategy – EKF using tangent-linear

Page 7: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 7Page 7

Third strategy – EKF using best linear approximation

Page 8: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 8Page 8

Explicit formula for best linear approximation

Page 9: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 9Page 9

Basic properties of best linear approximation

Page 10: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 10Page 10

Cloud function

T

Seek a rational basis on which to 'regularise' in 4D-Var the Smith cloud scheme of 1990,

where cloud fraction is expressed as a function of

( , )=

(1 ) ( , )

Cloud fraction and its de

sat LN

c sat L

C

q q T pQ

RH q T p

N

212

212

rivative w.r.t. Q are

0 1 0 1

(1 ) 1 0 (1 ) 1 0'

1 (1 ) 0 1 (1 ) 0 1

1 1 0 1

How should one regularise this function?

Met Office ha

N N

N N N N

N N N N

N N

for Q for Q

Q for Q Q for QC C

Q for Q Q for Q

for Q for Q

21N2d used regularisation [1 tanh(2 )] with derivativeC'=sech (2Q )NC Q

Page 11: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 11Page 11

Smith Cloud Scheme with ‘ad hoc’ Regularisation

212

212

0 1

(1 ) 1 0

1 (1 ) 0 1

1 1

N

N N

N N

N

for Q

Q for QC

Q for Q

for Q

0 1

(1 ) 1 0'

(1 ) 0 1

0 1

N

N N

N N

N

for Q

Q for QC

Q for Q

for Q

12Standard regularisation [1 tanh(2 )]NC Q 2' sech (2 )NC Q

Page 12: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 12Page 12

Smith Cloud Scheme with ‘Optimal’ Regularisation

1

. 1 Gaussian

~ (0, )

1 | |pdf ( ) exp

2

Eg p

Q N

xf x

| |

Opt reg LS:

E{C(Q+ )}

1( )exp( )

2x

Q

C Q x dx

2

| |3

E{C(Q+ ) Q}Opt reg PF:

1( ) exp( )

2x

Q

C Q x x dx

N N N N N

N N NN N N N N 2

N

Optimal regularisation: C(Q + Q ) F(Q )+T(Q ) Q

E[C(Q + Q ) Q ]If E( Q ) 0 then F(Q )=E[C(Q + Q )] and T(Q )=

E[ Q ]

Page 13: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 13Page 13

Incremental 4D-Var

Page 14: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 14Page 14

Options for linearisation step required for incremental 4D-Var

Page 15: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 15Page 15

Gain matrix implied by each option

Page 16: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 16Page 16

Advantage of BLA over TL in incremental 4D-Var

Page 17: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 17Page 17

Pseudo Chain-rule for best linear approximation

Page 18: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 18Page 18

Use of best linear approximation in EKF

Page 19: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 19Page 19

The prior covariance implied by different approximations

Page 20: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 20Page 20

Prior covariance using best linear estimate

Page 21: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 21Page 21

Prior covariance using the best linear estimate always underestimates the true prior

Page 22: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 22Page 22

The Duffing Map

Page 23: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 23Page 23

100,000 iterates of Duffing Map

Page 24: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 24Page 24

Reminder of EKF algorithm

Page 25: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 25Page 25

Prior covariance for Duffing Map

Page 26: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 26Page 26

Mean square analysis error in Duffing map: TL and best linear estimate compared

Page 27: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 27Page 27

Part II.

The Use of Linear Models in Data Assimilation

Page 28: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 28Page 28

Linearisation error in 4D-Var as used in real numerical weather prediction models

Page 29: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 29Page 29

Page 30: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 30Page 30

Linear model for evolution of increments

Page 31: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 31Page 31

Linearisation error as a stochastic error

Page 32: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 32Page 32

Issues in forming EKF

Page 33: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 33Page 33

Signal model for system with time correlated linearisation error

Page 34: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 34Page 34

EKF with time correlated linearisation error

Page 35: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 35Page 35

Parameters for filter including linearistion error

Page 36: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 36Page 36

Example: L95, nearly perfect full model, persistence for linear model

Page 37: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 37Page 37

Example: L95, nearly perfect full model, persistence for linear model, results

Page 38: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 38Page 38

Variational version: weak constraint 4D-Var allowing for time correlated linearisation error

Page 39: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 39Page 39

Remarks on variational form

Page 40: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 40Page 40

Long window weak constraint 4D-Var allowing for linearisation error, same example

Page 41: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 41Page 41

Summary to Part I

Page 42: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 42Page 42

Summary to Part II

Page 43: Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

© Crown copyright 2011 Page 43Page 43

The End


Recommended