Institut für Umweltphysik/Fernerkundung Physik/ElektrotechnikFachbereich 1

SQWG Planning for Operational Algorithm UpdatesSADDU, 16./17.6.2008, Bremen

Heinrich Bovensmann on behalf of SWQG team

Institut für Umweltphysik/Fernerkundung Physik/ElektrotechnikFachbereich 1

SQWG Overview

SQWG Goals

• Maintain and improve SCIAMACHY operational data processing, by intensify and condense all activities around the evolution of the operational processing into one group which takes care of the evolution and improvements of the operational data processing chain from Level 0 to Level 2.

• SQWG is a an interagency effort of ESA, DLR and NIVR to maintain and improve the SCIAMACHY algorithm baseline, as described in the statement of work.

SQWG - SADDU

• SQWG‘s is contracted by agencies to work on improvements of operational algorithms along a concrete work plan agreed with agencies

• SADDU and SSAG is mandated to recommend on operational algorithm development towards agencies

• SADDU is mandated to stimulate the development of scientific algorithms to maximise the scientific outcome of the SCIAMACHY mission

SQWG Project Structure

WP 3000L0 – L1c

WP 4000L1c - L2

Key Data

Algorithm Maintenance

Algorithm Evolution

WP 1000 CoordinationPlanning, Staffing, Reporting, Project Monitoring

WP2000 AlgorithmBaseline

Documentation

Prototype Processor

SCICAL

SCIA L1C

Verification

M-Factors

Data Bases

Algorithm Maintenance

Algorithm Evolution

Data Bases

Support to Anomaly

Investigation

Test Data

Support to Anomaly

Investigation

Data Bases

SQWG – Teaming

L0 – L1c L1c - L2

BIRA

Coordination: IUP

IUP

IMF

SRON

IUP

IMF

Core Team:IUP, IMF, SRON

AlgorithmBaseline

IMF

SRON

IUP

BIRA

ESA DLR NIVR

KNMI KNMI

Workplan: Level 1 ActivitiesLevel 1 Requirement Investigation Implementation

(WP 3000) (WP 2000)M-factor algorithm R-36

Short term solution Year 1 Year 1Full solution Year 2 Year 2

Tangent height monitoring R-37 Year 1 Year 2Dynamical bad and dead pixel mask R-38 Year 1 Year 1Nadir reflectance correction R-40 Year 1 Year 1 / 2Limb reflectance correction R-41 Year 2 Year 2Key-Data improvements R-42

Recalculate polarisation key data Year 1 / 2 Year 2Reanalyse radiometric key data Year 1 Year 1 / 2

Ch. 2: Year 1 Ch. 2: Year 1Other: Year 2 Other: Year 2Ch. 2: Year 1 Ch. 2: Year 1

Other: Year 2 Other: Year 2

SMR calibration R-44 Year 2 Year 2Channel 6 detector calibration R-45 Year 1 Year 2Dark current correction last limb (SciaL1c) R-46 Year 1 Year 1

Stray light key data

Reanalyse ghost and uniform stray-lightcorrection

R-43

Workplan: Level 2 ActivitiesLevel 2 Requirement Investigation (WP 2000)

(WP 4000)Nadir ProductAbsorbing Aerosol Index R-47/R-57 Year 1 Year 1

Ozone total column evolution R-49 Year 1 Year 1NO2 total column evolution R-50 Year 1 Year 1

BrO slant column implementation R-51 Year 1 Year 1BrO total column preparation Year 2 -

SO2 slant column implementation R-52 Year 1 Year 1

SO2 total column preparation Year 2 -OClO slant column scientific prep. R-53 Year 2 -H2O total column implementation R-54 Year 1 Year 2

CO total column implementation R-55 Year 1/2 Year 2Cloud parameter evolution R-56 Year 1 Year 1

Limb ProductsOzone profile evolution R-58 Year 1 Year 1

upper stratosphere extension of O 3

profiles R-48/58 Year 2 Year 2

NO2 profile evolution R-59 Year 1 Year 1

BrO profile implementation R-60 Year 1 Year 2Limb cloud flagging (NLC, PSC, etc.)scientific prep.

R-61 Year 2 -

Other Activities

• Maintenance of Calibration and Optical Monitoring• Monitoring:

– Light path– Detectors– Tangent Height

• Anomaly Support on request• Agency Support on request• Communication with Agency

Change Request Form CR No:

Change Request

Operational SCIAMACHY Data

Issue:

Title:

Description of Request (in case longer than 1/3 page, please provide detail in a short TN): Data Set: Processor Version: Change to be verified by: Affected Data/Processing L0: L1: L2: Key Data: Aux Files:

Originator: Date of Issue: Signature/Ref.:

Preliminary Assessment of SQWG: Classification:

SQWG Responsible:

SQWG: Date: Signature/Ref.:

In case SQWG recommends further investigations:

ESA: Date: Signature/Ref.:

Detailed Analysis by SQWG (incl. Implementation Options): SQWG Responsible:

Date: Signature/Ref.:

Approval of Proposed Implementation: Information to Originator: Date: Signature/Ref.:

SQWG Approval: Date: Signature/Ref.::

Decision/Approval (by Agencies), in case implementation is recommended the SCR will be opened: ESA: Date: Signature/Ref.:

Change Request

Preliminary CRCheck

Agencies,QWG,

SSAG,Users

CRDatabase

Investigation?

Investigation wrt Science and

Implementation

SCR?

No further investigations

Further investigation

CR AssessmentReport

Evolution/Improvement Studies on Algorithm Baseline

Opening CR

QWG

QWG

QWG

Agencies and QWG

Agencies and QWG

Opening SCR

From SCR to Implementation

Delivery of Algorithm Baseline &

Opening of CIF

UpdateAlgorithm Baseline

Verification ofAlgorithm Baseline

UpdateVerification Report

Verification accepted?

Opening of SCR

Agencies

Agencies & QWG

QWG

QWG

Institut für Umweltphysik/Fernerkundung Physik/ElektrotechnikFachbereich 1

Activities Year 2 (2008/2009)

Summary Year 2 Level 1

• Tangent height monitoring• Improving Bad and dead pixel masks• m-factors, Nadir reflectance correction, • Limb reflectance• Spectral stray light implementation• Sun Mean Reference investigations• Channel 6 calibration• Key Data Update (spectral straylight, radiometric,

polarisation) • NEW (tbc): Scan angle dependent degradation• NEW (tbc): Spatial stray light investigations

Level 2

Nadir DOAS products: Year 2

Status Year 2

O3 M-factors appliedEstimate the possible

temporal trend in OL4.0

NO2

New settings

Ad-hoc offset removedOffset needed in early 2003?

BrO Slant columns: new Total column preparation

SO2 Slant columns: newVerification on full data set

Total column preparation

• improvement of the data products based on the outcome of validation activities

• nadir cloud parameter algorithm will be improved w.r.t. surface albedo and minimum reflectance databases.

• There are remaining effects of instrument degradation on the globally averaged AAI:

• Remaining trend in globally averaged AAI over the years despite m-factor correction

• scan-angle dependence is growing with time at an increasing rate

Nadir Absorbing Aerosol Index Product

Further improvement shall also include:

• correction for calibration offset at t=0

• correction of FOV blockage (affects data until April 2003)

• sunglint filter/flagging

Level 2 Nadir Year 2 - New

• implementation of nadir H2O

– Validated algorithm (AMC-DOAS) ready for implementation

• implementation of nadir CO– Data quality will be “noisy” – proper averaging need to

make use of the data– Algorithm ready for implementation– Warning: Channel 8 detector degradation may have a

strong impact on percentage of “good” CO data

Level 2 Limb Year 2

• improving O3 profiles – in the upper stratosphere (usage of UV wavelength) – or in the lower stratosphere (impact of clouds and

aerosol) – Trade-off w.r.t. implementation options ongoing

• improving NO2 profiles – Study to improve in UTLS w.r.t. clouds, aerosols

• New: implementing BrO

• implementation limb cloud flag

V4p4 V4p3

O3 : Verification with SAGE II

V3.01

• The difference between ozone profile is improved with V4p3, mainly in the lower stratosphere

• V4p4 gives best results with differences of less than 10% for most of the height range

• A small impact of the missing AUX-FRA correction (V4) can be expexted

Limb Cloud Flagging Database

Stored in database:- Index of tangent height- tangent height of maximum Color Index Ratio (CIR)- CIR value

=> 3 sets for cloud top height, cloud phase and PSC are stored in the new database version 1.0.

Reprocessing 2002 – 2007 using L1 v6.03 is nearly finished.

Contact: Kai-Uwe Eichmann (IUP)eichmann@iup.physik.uni-bremen.de

Institut für Umweltphysik/Fernerkundung Physik/ElektrotechnikFachbereich 1

Potential Activities Year 3-4 (2009 – 2011)

Currently not „contracted“

Note

• Current SQWG contract is running until spring 2009

• Agencies intends continuation • All proposed improvements are preliminary w.r.t.

to continuation of the involved contracts/funding lines

• Feedback of SADDU on proposed activities explicitly welcomed

Overall Goals 2009 ff.

• The main goal for SQWG Year 3-4 (ff.) should be, to establish L1 and L2 data quality of the full SCIAMACHY data set, which allows substantial contributions to long term atmospheric data sets in the areas of:

– the development of the O3 layer

– global air pollution – Global Greenhouse gas observations– Solar-Terrestrial interactions

• In addition, the data set shall allow to investigate new scientific methods and products.

Summary Level 1 Year 3-4

• M-factor full implementation evolution

• Scan angle dependent degradation correction• Spatial stray light correction• Bad and dead pixel correction improvements• Calibration adaptation for mission extension due to

orbit change• Key data and SciCal updates• Improved polarisation correction (incl. Limb)

• Improving data products based on outcome of validation activities

• Adaptation of Level 1-2 algorithms w.r.t. sensor degradation

• Adaptation of Level 1-2 algorithms w.r.t. orbit changes beyond 2010

Level 2 Year 3-4: General

• Adaptation of Nadir NO2 and O3 TC algorithms to be comparable in quality with GOME/GOME2 (GDP 5)

• Implementation of the total column BrO and SO2• Implementation of a tropospheric NO2 product• Implementation of total column HCHO• Implementation nadir ice/snow-cloud discrimination product• Implementation of XCH4• …

Level 2 Nadir Year 3-4

• Improving Limb O3 to allow vertical coverage from the UTLS to the mesosphere

• Improving Limb NO2 in the UTLS (fit window)

• Improving Limb BrO in the UTLS (clouds, aerosol etc.) • Implementation Limb Cloud Identification Product (PSC,

NLC, Ice/water) • …

Level 2 Limb Year 3-4 (tbc)

Institut für Umweltphysik/Fernerkundung Physik/ElektrotechnikFachbereich 1

The End