UWG 2015 Annual Meeting
NSIDC Distributed Active
Archive Center (DAAC) Update
NSIDC Distributed Active Archive Center
Outline
Overview
Setting DAAC priorities
Focus Areas for 2015
Highlights and key accomplishments
Data Center move
Looking ahead
What we do …
NASA NSIDC DAAC is responsible for maintaining and
curating cryospheric and related environmental data
datasets created from EOS satellites, NASA field and
airborne campaigns, and other non-EOS data ensuring that
these datasets are preserved, well-documented, accessible
and data quality and integrity are preserved.
Snow
Sea Ice
Glaciers
Ice Sheets
Soil Moisture
Permafrost
Data products and information
NSIDC Distributed Active Archive Center
NSIDC Distributed Active Archive Center
Overview of Activities
10.07%
11.42%
13.59%
2.33%31.79%
12.94%
17.86%
administra on
engineering
infrastructure
itsecurity
missionsupport
opera ons
userservices
In our 3rd (option year 2) year of a five year contract
NSIDC Distributed Active Archive Center
All remote sensing and in-situ data
Liaison with science and user communities
Science support for data users
Data management
4.28%2.21% 3.84% 0.22%
0.37%
4.98%
6.27%
2.12%
6.36%
0.00%8.30%
3.15%20.28%
17.33%
15.49%
4.79%AMSR-E
AMSR2
Aquarius
AVHRR
GLIMS
ICESat
ICESat-2
LegacyDAACData
MEaSUREs2006
MEaSUREs2012
MODIS
Nimbus
Opera onIceBridge
PassiveMicrowave
SMAP
VIIRS
March 2015 – NSIDC data users
6 NSIDC Distributed Active Archive Center
Data Archive
7
ECS–EOSDISCoreSystemV0–NSIDCheritagesystem
Totalof25.3millionfilesinthearchive
NSIDC Distributed Active Archive Center
NSIDC Distributed Active Archive Center
NASA EOSDIS components & initiatives
Earthdata login – centralized and simplified
mechanism for user registration and profile
management for all EOSDIS system components
Common Metadata Repository (CMR) – new
metadata system merging all existing capabilities and
metadata from ECHO and GCMD
Big Earth Data Initiative (BEDI) – NASA’s effort to
improve discovery, access and use of Earth
observations by broader community
NSIDC Distributed Active Archive Center
Other ESDIS and community activities
Earthdata Search Client – a new client under
development for discovering, searching, visualizing,
and retrieving Earth science data
Virtual Collections
Cloud Services/High performance Computing
Setting Priorities
Ongoing
work
New
Missions
work
Statement of work
New
directed
projects
DAAC Product
Teams
Technical
Service Group
Science
Comm. Group
Software Dev.
Group
New ESDIS
Designated
Projects
NASA
Cryosphere
Program
DAAC
MGMT Team
ESDIS review and direction
DAAC
MGMT Team
DAAC
Team
Changing
mission
needs
DAAC review and direction
Create tasks Set Priorities Create Work
Plan Do work/re-
prioritize
Focus areas for the year
NASA ESDIS Priorities
Key mission milestones
NASA Cryosphere
Priorities
Operations performance
User community priorities
UWG Recommendations
Work Priorities
Data operations
User support
Development
Outreach
Sustainment & evolution
NSIDC Distributed Active Archive Center
Identify initiatives/focus areas/projects
NSIDC
UWG
Guidance
User Services
feedback &
ACSI results
DAAC
MGMT Team
NSIDC Distributed Active Archive Center
Focus Areas for 2015
SMAP mission support and data management
Earthdata login implementation (CY2015)
BEDI/OPeNDAP/GIBS project (FY2015/2016)
Operation IceBridge support and OIB portal
Data center UPS replacement or move
Focus areas intended to guide work because they are
priorities within NASA ESDIS, have key milestones in
the year and/or align with DAAC strategic direction:
NSIDC Distributed Active Archive Center
Focus Areas – 2nd tier
Common Metadata Repository (CMR) support
DAAC Data Access and Services project (DAS)
Virtual collection & Data analytics
Increasing level of data science support
- SMAP postdoc support
- Passive microwave and sea ice products
HIGHLIGHTS &
ACCOMPLISHMENTS
NSIDC Distributed Active Archive Center
SMAP launches …
Public release:
SMAP L1A Radiometer Time-Ordered Parsed Telemetry
SMAP L1B Radiometer Half-Orbit Time-Ordered Brightness Temperatures
SMAP L1C Radiometer Half-Orbit 36 km EASE-Grid Brightness Temperatures
Ingesting approx. 47 GB/day
NSIDC Distributed Active Archive Center
NSIDC Distributed Active Archive Center
Operation IceBridge – ARISE campaign
New FLIR imagery
CAMBOT
With many data providers using
MetGen and reformatting data to
conform to NASA standards ECS
for data management
ARISE campaign: data to NSIDC and
ASDC DAACs
2 new campaigns: ARISE and melt
season with focus on mid-season
snow and ice dynamics
NASA LVIS
Operation IceBridge – the portal development
Development focused on
data products (rather than
flight lines)
Driven by user feedback
Enabled by “rich” metadata
Exploring DropBox and
Google-drive delivery
method
Flight line
“Schwab socks”
granule browse image
Data order
Digital Mapping System (DMS) example
NSIDC Distributed Active Archive Center
Passive Microwave – code update
Additions to ice masks
Code updates to improve stability
and maintenance, and provide
greater consistency across multiple
sea ice data sets
Reduce missing data around pole
NSIDC Distributed Active Archive Center
SOAC: added Sea Ice Age
NSIDC Distributed Active Archive Center
NSIDC Distributed Active Archive Center
Accomplishments/highlights
ICESat-2
- Hosted 2 ATDB meetings
- on-going testing with SIPS and EDOS using GridFTP transfer protocol
MODIS Collection 6 Sea Ice reprocessing began on 19 Feb 2015 (data
2000 to 2011)
Migrating MEaSUREs data sets to ECS to access richer data services,
easier for long term management
- Improved self-describing metadata for snow and sea ice for GIS
Nimbus 4 Image Dissector Camera System satellite data recovered &
added to the timeline (spans April 1969 - Apr 1971)
Our use of virtual machines and servers continues to bring greater
stability to core operations, and gain efficiencies in maintenance and
deployment of software applications
In past year, average 515 user request each month & 91 notices for
updates to/releases of 129 data sets
20
NSIDC Data Center Study
Problem: Data center uninterruptible power supply (UPS) has
been in operations for 17 years and is nearing its end of life
in June 2016. Manufacturer no longer supporting
maintenance & repair. Challenges:
Already at the weight limit of floor (limits solutions, growth)
Costly to replace and maintain new unit (> $150K; ~$20k per
year)
Requires some asbestos remediation (schedule and cost
risk)
What we’re doing: An alternative solution to move the
NSIDC data center has costs advantage over replacing the
UPS.
NSIDC Distributed Active Archive Center
Locations
21
NSDIC
CU Space Science Data Center
NSIDC Distributed Active Archive Center
Data Center Move - schedule
Schedule
Evaluate costs and risk Jan. to Apr. 2015
Preliminary decision May 2015
University agreements finalized July 2015
Begin facility preparation August 2015
Readiness review Nov. 2015
Non-ECS hardware move Jan. 2016
ECS hardware move Feb. 2016
NSIDC Distributed Active Archive Center
NSIDC Distributed Active Archive Center
Looking Ahead
SMAP release of higher-level data products
ICESat-2 pre-launch preparation
- Start of ground readiness testing
- Data services/tools definition & development
- Launch planned for late-2017
2 new OIB missions in Greenland and Antarctica
Distribution of SNPP VIIRS snow and ice products
- Expected Feb. 2016 for snow products
Contingency plan for DMSP SSMIS F17 F19
JPSS J1 VIIRS snow products (launch 2nd QTR FY 2017?
Other areas?