11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
The Aura Validation Data CenterThe Aura Validation Data Center
Bojan R. Bojkov
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
What is the AVDC?What is the AVDC?
AVDC established to support the validation of Aura• HIRDLS, MLS, OMI and TES
Archive for datasets used for the validation• Groundbased network data• Aircraft missions and large balloon campaigns• Other satellite datasets
Aura instrument data in support of validation• Station overpass and geographical subsetting• Instrument FOVs: collocation tools and 17-day predictions
Support validation field deployments/missions• AVEs, INTEX A/B, UAVs• SAUNA, WAVES campaigns
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Coordination/collaborationCoordination/collaboration
Aura instrument/product teams
Close coordination with the NDACC• Collaborative effort in data homogenization• Access to preliminary data in NRT
Coordination with measurement networks• Provide of sonde launch schedules (Aura OVP)• NRT availability of preliminary data (MSC, NOAA-CMDL)
Satellite teams• ACE mission - dataset availability and field campaign coordination• NOAA - NRT data release for validation• Envisat data exchange through OMI AO
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
AccessAccess
Access guided by data exchange protocol• NASA Research Announcement PIs• Aura instrument Science Team members• OMI Announcement of Opportunity (AO) PIs
Special arrangements:• NDACC - Network for the Detection of Atmospheric
Composition Change (former NDSC)• Specific PIs: MSC, station PIs, etc.• Satellite teams: NOAA, ACE, OSIRIS
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
ImplementationImplementation
Central facility at NASA GSFC• http://avdc.gsfc.nasa.gov/
Five 2-CPU Xserve cluster, ~10TB storage capability
Combination of relational database and flat file tree
Correlative data requirements• Follow rigid metadata and nomenclature requirements• Compliance check on all incoming files (format, metadata and
nomenclature)• Maintains backward compatibility with Envisat Cal/Val• Follow NDACC instrument data reporting protocols
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
StatusStatus
Operational since February, 2005• Supporting Aura Validation Experiments since October 2004• Full system failure March 30, 2006 … back online April 6
~230 registered users• Europe, Asia and North America• NRAs, ESA OMI AO, and NDACC PIs, validation contributors
Statistics:• 2.9+ TB total, 300+ GB of validation data• ~1,000,000 web hits (~1,800/day)• 200+GB web transfers
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
DataData
Aura datasets• Instrument subsets (stations, geographic)• Exclusive access point to provisional Aura data
for ex. HIRDLS later this month
• Experimental products for example OMI L3, early TES v4 in IDL safe format
Validation data:• NASA aircraft/balloon mission data (AVE, INTEX, etc.)• NRA (and OMI-AO?) data• Satellite data: ACE/MAESTRO, SBUV/2, Odin…
planning Calipso and CloudSat as identified during ST
• Groundbased network data: NDACC, CMDL, MSC, …
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Groundbased data (from Aug. ‘04)Groundbased data (from Aug. ‘04)
6,000+ MWR O3 profiles
700+ MWR water vapor profiles
6,000+ Brewer days (MSC)
~1,000+ NDACC LIDAR O3 profiles
~1,000+ ozonesondes from 36 stations (~2,000 add. shortly)
~100 water vapor sondes
and growing…
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
ToolsTools
Fully searchable archive• Archived validation data and Aura datasets
Aura instrument data subsetting• Station OVPs, regional subsets, aircraft tracks, etc.
Aura instrument FOVs• 17-day FOV predictions• Actual instrument FOV coincidences
Data conversion tools (read/write), data formulation, search and web automatization tools
Web portal for validation• News, meeting proceedings, documentation, etc.
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
LIDAR search exampleLIDAR search example
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
FOV predictionsFOV predictions
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Location
Date
OMI coincidence with De BiltOMI coincidence with De Bilt
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
OMI coincidence with De BiltOMI coincidence with De Bilt
5 coincidences
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
OMI specific supportOMI specific support
Distribution of:• Limited L1b (preliminary - soon…)• L2 station OVP files• L2 distribution (specific days, orbits, …)
AVDC stores all OMI L2 data
• Regional datasets - O3, NO2• AVE flight path coincidences for O3, NO2, aerosols• …
AVDC manpower for OMI support: ~1FTE
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
OMI overpass dataOMI overpass data
Daily OVP updates for:• 511 stations for OMTO3 and OMDOAO3 products• 164 for OMAERUV• 94 for OMUVB• 91 for OMNO2• 35 for OMBRO, OMHCHO and OMOCLO
File contents selected by product PIs
Something missing? • Product, period, region, specific parameter…
…just ask!
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Regional subsetting exampleRegional subsetting example
OMNO2 trop. column• 2005 average
US north-east corridor• Gridded: 0.1o - 0.1o
Criteria• Cloud fraction < 0.25
Delivery time line• Order placed: Fri. June 16 @ 17:00• Delivered: Sat. June 17 @ 14:00
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Closing remarksClosing remarks
To ensure the success of the AVDC (and to benefit the Aura community as a whole) we need…
• Good communication, particularly regarding: Product updates and version release schedules Product issues information and validation results Latest readme files Future validation planning Data needs
• AO validation data
11th OMI Science Team MeetingDe Bilt, June 2006http://avdc.gsfc.nasa.gov/
Contact informationContact information
http://avdc.gsfc.nasa.gov/