AMSR-E / AMSR2 Team Lead Science Computing Facility

September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer

AMSR-E / AMSR2 Team Lead Science Computing Facility

TLSCF at UAH

Dr. Roy SpencerDr. Danny Braswell

Dr. Elena LoblMr. Don Moss

Ms. Dawn Conway


AMSR-E / AMSR2 TLSCF

TLSCF at UAH

• Overview of TLSCF tasks• TLSCF Data Flow• TLSCF Operating Environment• Science Team Software Delivery

Requirements• TLSCF Science Software Integration and

Test (SSI&T) Procedures• Current AMSR-E Science Software• AMSR-E / AMSR2 Schedule



Overview of Tasks

• Support Science Team• Integrate and test science software• Maintain metadata, QA software, and

ESDT’s• Prepare all software for operations

environment• Deliver DAP to the SIPS• Support the SIPS in resolving processing

anomalies• Support NSIDC (user inquiries and

documentation)• Documentation and web pages



AMSR-E / AMSR2TLSCF

Science Team

GHCCSIPS

NSIDC DAAC

Algorithm, documentation, QA, and ECS metadata updates

Documentation, ESDT’s, user support

Browse images, anomaly resolution, Provenance metadata, LANCE product review

Delivered Algorithm Package (DAP)

Data Flow



Current AMSR-E AMSR2 /Future AMSR-E

Operating System RHEL 5 - 32 bit RHEL 6 - 64 bit

C compiler gcc gcc

Fortran compiler Lahey gfortran

HDF 4.2r1 5

HDF-EOS 2.14 5

TLSCF Operating Environment



Science Team Software Delivery Requirements

• Update from the latest DAP• Software

o HDF versiono HDF-EOS Geo fieldso Use current version of input data

• Delivery notes o Documenting science software changeso Describing the products and the ancillary fileso Documenting all third party software usedo Documenting known issues / bugs

• Include test input / output data



Science Software Integration & Test Procedures

• Review each science team delivery o Begin with current DAP?o Document changes in software and ancillary files?o Output file meets ECS requirements?o Known issues, bug fixes

• Compile and run the science softwareo Document changes necessary to compile at TLSCFo Compare output with that provided by the

scientist




• Update the metadata, QA, and operational codeo Document changeso Integrate the science software o Compile and run the completed software

packageo Compare output

• Update Provenance metadata• Provide documentation to NSIDC• Update the ESDT




• Deliver DAP to the SIPSo Science, metadata, & QA softwareo Makefile and wrapper scriptso Delivery noteso Static ancillary fileso Checksums

• Support SIPS in resolving processing anomalies



Delivered Algorithm Package

• A package containing software and documentation sufficient to allow a user to recreate the associated standard product

• 1 DAP per science software delivery• DAP version = file version• Delivered and installed at SIPS for

processing• Available to users from NSIDC



Delivery Notes

• Describes the software changes, including new requirements

• Lists known issues associated with the release

• Describes the file naming convention• Includes input and output file descriptions• Identifies the required operating system,

compilers, and libraries • Lists and describes all routines and ancillary

files, identifying the ones that have changed

• Contacts• Operating instructions



Current AMSR-E Science Software

Data Product

Current Version Current Status

L2A Tb’s V12 New version coming soon L2 Ocean V07 Updates expected L2 Land V10 New algorithms due Oct 2014 L2 Rain V11 V12 awaiting documentation L3 Sea Ice V15 Reprocessing completed Jul 2014

Updates for Bootstrap at TLSCF L3 Ocean V05 Updates expected L3 Land V07 Updates due following L2 Land L3 Snow V10 Updates due L3 Rain V07 New algorithm; monthly? L3 Sea Ice Drift B03 Updates due




• All operational software was updated in 2010 for LANCE processing

• All operational software will be updated to includeo New ISO metadata, updated ECS metadatao New ESDTo New L2A Readero Digital Object Identifier (DOI)




• L2A Brightness Temperatureso V12 reprocessing completed July 2013 (RSS v07)o Recalibrated Brightness Temperatureso Improved RFI flags; format changes

• L3 Sea Ice V15o Reprocessing completed August 2015• Update Southern Hemisphere sea ice

mask • Update the algorithm to correct

internal land / ocean flag that conflicted with the new sea ice mask

o Updates expected based on new L2A?




• L2 Ocean o Last algorithm updates were in V05, April 2007o Updates expected; will utilize latest TB’s and

record new RFI flags

• L3 Ocean o Last algorithm updates were in V04, May 2010o Updates expected; will utilize the latest RFI flagso Reprocessing after L2 Ocean reprocessing




• L2 Land o New delivery due October 2014 o Combined Single Channel Algorithm (SCA) and

Normalized Polarization Difference (NPD) algorithm

o New formato Unified ancillary files

• L3 Land o Updates expected after L2 Land deliveryo Reprocessing after L2 Land reprocessing




• L2 Raino V11, July 2010 updates for LANCE processingo GPROF 2010 currently in SSI&T (V12)• Awaiting documentation

• L3 Raino New algorithm; derived from L2 Rain (GPROF

2010)o Monthly; 0.25 degree resolution




• L3 Snow • Last algorithm update B05, November 2005• Updates?

• L3 Sea Ice Drift • Last algorithm update B03, October 2013• Replacement algorithm expected from science

team



AMSR2 Science Software

• Integration at TLSCF equivalent to AMSR-E products

• JAXA L1Ro Reader written and tested by Bruce Beaumont of

the SIPS (LANCE) and available to science team now

o Data available from SIPS



AMSR-E Schedule2014 2015 2016 2017

Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

All Alg to

TLSCF TLSCF Integration & Testing

Algorithm

Updates due

TLSCF I&T*

Final updates to

TLSCF*

TLSCF I&T*

• Jan 2015: Algorithm updates due to TLSCFo For those algorithms with no changes, TLSCF updates

ECS metadata, ISO Lineage metadata, documentation, and DAP

o Please advise if there are no updates to the algorithms• Dec 2016: FINAL End of Mission algorithm updates due to

TLSCF

AMSR-E Senior Review Feb 1, 2016 *AMSR-E extension due to Terra-Aqua ROSES ?



AMSR2 Schedule2014 2015 2016 2017

Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

Beta version Transitional version Validated versionUnified Mask

All alg to TLSCF

TLSCF I&T

Alg Updates Due

TLSCF I&T Alg Updates due

TLSCF I&T

Date post:	03-Jan-2016
Category:	Documents
Upload:	norman-kemp
View:	22 times
Download:	1 times

AMSR-E / AMSR2 Team Lead Science Computing Facility

Documents