© Crown copyright 2007 Page 1Page 1
Assimilation of clouds and precipitationGeneral issues and prospects from future
sensors
Stephen J. English Met Office
© Crown copyright 2007 Page 2Page 2
Outline
Cloudy radiances – the basicsExisting sensors
Applications of existing sensors1D-var analysis of cloud from AIRS
Assimilation of cloudy AMSU-A microwave radiances
The impact of ice cloud on MHS and AMSU-B
Assimilation of cloudy geostationary IR radiances (SEVIRI)
Future sensorsSub-mm sensors
Geostationary MW
Polametric radiometers (including wind vector potential)
© Crown copyright 2007 Page 3Page 3
Cloudy radiances - basics
Wavelength
< 0.1 mm
< 1 mm
< 10 mm
< 100 mm
~ 100 mm
Polar Orbit 830 km FOV size
< 1 km
> 1 km
> 10 km
> 100 km
Infrared
Sub-mm
Microwave
RadiowaveAMSR
MHS
MODIS
CIWSIR
Visible channels (e.g. 0.6 μm) ignored in this presentation though as clouds are non-absorbing in Vis bulk quantities e.g. LWP can be analysed.
© Crown copyright 2007 Page 4Page 4
Microwave “window” channels: schematic
00.20.40.60.8
1
18 23 31 89 150
Frequency GHz
Water vapourCloud liquid water
00.20.40.60.8
1
18 23 31 89 150
Frequency GHz
Surface Water vapourCloud liquid water
00.20.40.60.8
1
18 23 31 89 150
Frequency GHz
Surface Water vapourCloud liquid waterIce scattering
00.20.40.60.8
1
18 23 31 89 150
Frequency GHz
Water vapour
Nor
mal
ised
sen
sitiv
ity
© Crown copyright 2007 Page 5Page 5
SEVIRI/AMSU-A/MHS composite image
Green to red to yellowCloud liquid water derived from 23/31 GHz
(AAPP)
Blue to purple Heavy rain derived from 23/89 GHz or 89/150 GHz
(AAPP)
Gray scale = IR image.
White lines denote high cloud LWP.
© Crown copyright 2007 Page 6Page 6
Clouds and precipitation: issues
Sounding (IASI, AIRS, AMSU, MHS)
Surface (ASCAT, QuikSCAT, WindSat, SSM/I,AVHRR, MODIS)
Sounding (IASI, AIRS, AMSU, MHS)
Surface (ASCAT, QuikSCAT, WindSat, SSM/I,AVHRR, MODIS)
© Crown copyright 2007 Page 7Page 7
AIRS: cloud impact
© Crown copyright 2007 Page 8Page 8
QuikScat, WindSat, ERS-2 over Hurricane Katrina
Both Ku-band (14 GHz) and WindSat (10 & 18 GHz) struggle near storm centre.
C-band (6 GHz) OK.
© Crown copyright 2007 Page 9Page 9
Low level microwave AMSU Ch.5, peak 750 hPa
© Crown copyright 2007 Page 10Page 10
There is a clear motivation to model cloud effects on satellite data not just to reject cloudy
radiances
© Crown copyright 2007 Page 11Page 11
Approaches
Coping with presence of cloud and rain1D-var analysis of cloud and pass cloud information to assimilation system with radiances (e.g. Pavelin).
EOF regularisation e.g. NESDIS MIRS system (Boukabarra, Weng, Zhao & Ferraro).
Extracting cloud/rain informationAnalyse cloudy radiances in 1D-var; assimilate 1D-var geophysical product. e.g. Deblonde and Mahfouf 2007, Peter Bauer, today!
Incrementing cloud operator in 4D-var and direct assimilation of cloudy microwave radiances (e.g. UnaO’Keeffe (MW), Dingmin Li (IR) at Met Office).
© Crown copyright 2007 Page 12Page 12
Assimilation of cloudy AIRS radiances
(Ed Pavelin)
© Crown copyright 2007 Page 13Page 13
Simplified processing flowchart
AIRS 1D-var
• Cloud retrieval• Channel selection
4D-Var
Cloud-affectedradiances
CTP, Cloud Fraction,channel selection
1
2
3
Analysis Increments
© Crown copyright 2007 Page 14Page 14
Example cloudy weighting functions (∂Bi/∂Tj)
Mid-level cloud• Use 26 of 94 channels
Low cloud•Use 67 of 94 channels
Retrieved CTP
© Crown copyright 2007 Page 15Page 15
Example: Simulation for mid-level cloud
“Mid-level” cases: CTP 400-600 hPa
• 28% of 13495 cases
• Analysis improved above cloud
• Significant temperature information below cloud (from semi-transparent cloud + vertical correlations)
• Humidity analysis well-behaved below cloud (follows background)
© Crown copyright 2007 Page 16Page 16
Coverage: Clear AIRS
© Crown copyright 2007 Page 17Page 17
Retrieved effective cloud fraction
© Crown copyright 2007 Page 18Page 18
Aside: Validation of cloud retrievals
CALIPSO: Spaceborne LIDAR (CALIOP)Flies in A-Train close behind AquaAccurate cloud top height measurements
Latitude
Latitude
CTP
(hP
a)C
TH (k
m)
Qualitativecomparison!
Section of one orbit
AIRS 1DVar
CALIOP Lidar
© Crown copyright 2007 Page 19Page 19
Cloudy AIRS radiances trial
Average impact ~ 2 x cloud-free AIRS.
Some big impacts on forecast “busts” (as does clear AIRS) e.g. here z500 SH day 2 & 3
2 day forecast
3 day forecast
© Crown copyright 2007 Page 20Page 20
NOAA/NESDIS Microwave Integrated Retrieval System - MIRS
(Sid Boukabara, Fuzhong Weng, Limin Zhao, Ralph Ferraro)
© Crown copyright 2007 Page 21Page 21
Introduction to MIRS Concept
Algorithm valid in all-weather conditions, over all-surface types
Variational Assimilation Retrieval (1DVAR)
Cloud & Precip profiles retrieval (no cloud top, thickness, etc)
Emissivity spectrum is part of the retrieved
state vector
CRTM as forward operator, validity-> clear,
cloudy and precipconditions
Sensor-independent
EOF decomposition
Highly Modular Design
Flexibility and Robustness
Modeling & Instrumental Errors are input to algorithm Selection of Channels to use,
parameters to retrieve
© Crown copyright 2007 Page 22Page 22
MIRS: Retrieval in Reduced Space (EOF Decomposition)
Covariance matrix(geophysical space)
Transf. Matrx(computed offline)
Diagonal Matrix(used in reduced space retrieval)
LBTLΘ ××=
All retrieval is done in EOF space, which allows:Retrieval of profiles (T,Q, RR, etc): using a limited number of EOFsMore stable inversion: smaller matrix but also quasi-diagonalTime saving: smaller matrix to invert
Mathematical Basis:EOF decomposition (or Eigenvalue Decomposition)
By projecting back and forth Cov Matrx, Jacobians and X
© Crown copyright 2007 Page 23Page 23
MIRS: Assessment in a Precipitating Case
Iter#0 Iter#1 Iter#2 Iter#3
0 1 2 3
Tem
pera
ture
Wat
er V
ap.
CL
WR
WP
IWP
Scattering OFF Scattering ON
When scattering is OFF, Water vapor performance is hit.When ON, ‘precip-clearing’ takes place
In precipitation, cross-compensation is affecting retrievalRadiometric solution reached but is not the geophysical one
CLW underestimated
Rain goesundetected
© Crown copyright 2007 Page 24Page 24
MIRS: N-18 Profiling In Active Areas
0 15 30
0.2 Hrs2.6 Kms 0.30 Hrs
11.1 Kms0.7 Hrs4.2 Kms
RetrievalGDAS
DropSonde Profile of DS Distance Departure
[Deg. C][Kms]
0 15 30 0 15 30
700 mb 700 mb700 mb
© Crown copyright 2007 Page 25Page 25
Assimilation of cloudy radiances in 4D-var using a total water control variable and a cloud incrementing
operator
(Una O’Keeffe, Dingmin Li and Martin Sharpe)
© Crown copyright 2007 Page 26Page 26
Assimilating cloudy microwave radiances in 4D-var (Martin Sharpe/Una O’Keeffe)
Total moisture analysis variable used in 4D-Var
Need cloud incrementing operator that relates liquid water and specific humidity to the total water control variable
Cx+ = Cx + KCw’
Cx = model state (T,p,q,qcl,qci,cf)Cw’ = analysis increment (T’,p’,qT’)K = incremental transform variable between control variable space and
model parameter space (uses linearised physics).
© Crown copyright 2007 Page 27Page 27
Information on cloud liquid water (Una O’Keeffe)
NOAA-16 ObsRTTOV8 with clw emission
RTTOV8 without clw emission23GHz
31GHz
© Crown copyright 2007 Page 28Page 28
Aircraft validation
© Crown copyright 2007 Page 29Page 29
Approach
1. Test liquid cloud part only with microwave 23 and 31 GHz observations. Validate radiative transfer.Compare increments and check impact on fit to observations in next cycle.Run simplified assimilation experiment (NOAA-16 only).
2. Extend to GeoIR cloudy radiances using ice cloud and cloud fraction in incrementing operator.
© Crown copyright 2007 Page 30Page 30
Cloudy 23 & 31 GHz Analysis Increments
Specific humidity at 850 hPa.
© Crown copyright 2007 Page 31Page 31
Specific humidity at 850 hPa.
Cloudy 23 & 31 GHz Analysis Increments
© Crown copyright 2007 Page 32Page 32
Impact on large scale fields fit to analysis
NH | TROPICS | SH50hPa height
500hPa and 250hPa temp
Most fields improved in SH
850hPa humidity
8% 6%
4% 2%
0 -2% -4%
-6% -8%
-10% -12%
-14%
Neutral impact in NH
© Crown copyright 2007 Page 33Page 33
Ice incrementing operator: GeoIR assimilation
Observation minus background
Observation minus analysis
© Crown copyright 2007 Page 34Page 34
Use of AMSU-B and MHS data in the presence of ice cloud and precipitation
(Amy Doherty)
© Crown copyright 2007 Page 35Page 35
Effect of ice at microwave frequencies
Courtesy of Frank Evans
© Crown copyright 2007 Page 36Page 36
Ice signal in AMSU-B channel 20 Brightness Temperatures: 10s of Kelvin.
Simulation without ice Simulation with ice
183 ± 7 GHz
© Crown copyright 2007 Page 37Page 37
Data actually assimilated from one AMSU-B channel
© Crown copyright 2007 Page 38Page 38
Interface between forecast model and RTM
Definition of snow and ice different in forecast model and RTTOV
Ice hydrometeor density assumptions do not match
Size distributions do not match
Fall speed assumptions do not match
Deblonde et al. (MWR 2007) noted that moist physics schemes are very different between NWP centres and this significantly affects results.
Do we need to go back to more fundamental model quantities e.g. moisture fluxes and make RTM do more to ensure consistency?
Peter Clark said a recent intercomparison of NWP systems showed moisture fluxes are consistent but derived quantities e.g. ice water content are not.
© Crown copyright 2007 Page 39Page 39
Given IWC, RTM tuned DSD (ARTS) compared to fixed DSD (RTTOV)
AMSU Channel 20 (183 ± 7 GHz)
Observation ARTS simulationRTTOV-8 simulation
Brightness Temperature (K)
© Crown copyright 2007 Page 40Page 40
Results for Experiment 6
Observation Experiment 6
183.3±7 GHz
PSD = Function of T and IWC (Field et al.,2005)
Density = 0.132 D-1 (Wilson and Ballard, 1999)
© Crown copyright 2007 Page 41Page 41
Use of sub-mm for ice cloud
(Stefan Buehler, Clare Lee etc.)
© Crown copyright 2007 Page 42Page 42
Sub-mm (from Stefan Buehler, Kiruna Univ.)
IR sees only smallest particles, radar only largest particles
© Crown copyright 2007 Page 43Page 43
Ice Clouds in Climate ModelsClimatology of zonal, annual mean IWP from various models in the IPCC AR4 data archive shows difference up to an order of magnitude.Delta-IWP after a CO2 doubling shows also vast differences. IWP observations are needed to resolve model differences.
(Figure by Brian Soden, University of Miami)
© Crown copyright 2007 Page 44Page 44
Possible future instruments to exploit sub-mm…
CIWSIR: multi-channel sub-mm instrument matching WV sensitivity with difference ice cloud sensitivity. LEO, resolution ~ 15 kms.
GOMAS: Geostationary MW and sub-mm imager/sounder. From 81 km spatial resolution at 54 GHz to 10 km at 425 GHz. An IGeoLabconcept.
Geostar: similar to GOMAS with synthetic aperture. JPL proposal.
(but GOMAS & Geostar really precipitation missions)
© Crown copyright 2007 Page 45Page 45
Polarimetric radiometry
(Brett Candy)
© Crown copyright 2007 Page 46Page 46
Error analysis based on model fit to actual WindSatand QuikSCAT suggests WindSat comparable to QuikSCAT > 5 ms-1
Amplitude and linear polarisation
SSM/I etc.=> wind speed
3rd/4th elements ofStokes vector
WindSat=> wind direction
© Crown copyright 2007 Page 47Page 47
Extra-tropical pmsl impact of QuikSCAT high and low windspeed wind vectors
-1.5
-1
-0.5
0
0.5
1
1.5
2
2.5
3
3.5
4
T+24 T+48 T+72 T+96 T+120 T+144
Impr
ovem
ent i
n Fo
reca
st E
rror
(%)
Qscat WindSat LowWindsHighWinds
© Crown copyright 2007 Page 48Page 48
Ambiguities: QuikSCAT and WindSat
QuikScat
2% 1 wind
43% 2 winds
33% 3 winds
22% 4 winds
WindSat
<0.01% 1 wind
<0.01% 2 winds
28% 3 winds
72% 4 winds
© Crown copyright 2007 Page 49Page 49
Wind Speed and Direction
8.6 9.0 B1.42 1.49 B10+
10.5 9.81.34 1.339-10
13.9 12.11.19 1.24 B7-8
16.8 14.21.20 1.26 B6-7
21.0 17.2 1.26 1.29 B5-6
Wind Direction (°)Wind speed (m/s)
Standard Deviation of Observation – Background Wind Speed Range (m/s)
WindSat Mission Requirements: 2m/s 20deg
Phase 1 suggested useful retrievals down to around 8m/s
© Crown copyright 2007 Page 50Page 50
How does this compare to other observing systems?
0
0.5
1
1.5
2
2.5
3
Bg Er
ror
Synop
s
Ships
Buoys
ERS-2Qui
kSca
tW
indSat
ASCAT
Obs
erva
tion
- Bac
kgro
und
RMS D
iffer
ence
(m/s
)
© Crown copyright 2007 Page 51Page 51
WindSat assimilation experiments
• As Met Office operations in mid-2005 except control had Scat, SSM/I, TC bogus withdrawn.
• Model Resolution N216 ~60km in mid-latitiudes, model top at 40km.
• 4D-Var Analysis scheme, four analyses per day with data windows of 6 hours.
• Period August-September 2005 (active TS season – over 20 different storms in 34 days!)
• WindSat treated identically to QuikSCAT (e.g. same ambiguity removal, thinning etc.)
© Crown copyright 2007 Page 52Page 52
Analysis Increments
QuikScat
WindSat
© Crown copyright 2007 Page 53Page 53
WindSat 1 Impact
PMSL improvements (%)
0
0.5
1
1.5
2
2.5
3
24 48 72 96 120 144
Forecast time (hours)
QuikScat WindSat
5% of parameters improved, <0.5% degraded
© Crown copyright 2007 Page 54Page 54
Tropical Cyclone Errors in Analysis Results from 19 cyclones –206 “events”
0
20
40
60
80
100
120
Control QuikScat WindSat1 WindSatMore QC
Mea
n P
ositi
onal
E
rror
(km
)21% 6% 8%
Much smaller study for ERS-2 in 2001 suggested improvement ~10%
© Crown copyright 2007 Page 55Page 55
Summary
Cloud and rain limit the use of sounding and surface observations.
More sophisticated analysis can partly mitigate this loss.
Analysing cloud prior to assimilation has worked with AIRS.
Considerable progress has been achieved with direct assimilation of cloudy radiances: both MW and IR.
Sub-mm sensors could provide new information on bulk ice cloud properties from polar or geo orbit.
Polarimetric radiometry can replicate much of the information from scatterometers but scatterometers remain the best source of near surface wind vector information, especially for tropical storms.
© Crown copyright 2007 Page 56Page 56
Questions?
© Crown copyright 2007 Page 57Page 57
Cloud tests: rain and thick cirrus tests
Radar
AVHRR IR image
AMSU-B cirrus cost test
Bennartzrain test
K
0 4 8 12 16 20
© Crown copyright 2007 Page 58Page 58
MIRS: Microwave TPW Extended over Land
snow-covered surfaces need better handling
MIRS Retrieval
GDAS Analysis
Retrieval over sea-ice and most land areas
capturing same features as GDAS
© Crown copyright 2007 Page 59Page 59
Assimilation of cloudy imagery products
(Ruth Taylor)