Date post: | 02-Jan-2016 |
Category: |
Documents |
Upload: | caitlin-simon |
View: | 214 times |
Download: | 1 times |
11
ECHO Overview and Status
Enabling Interoperability with NASA Earth Science Data and Services
GES DISC User Working Group May 10, 2011
Andrew E. MitchellNASA/[email protected]
Encouraging Partners and Brokers
ECHO is EOSDIS’s middleware layer between EOS data and science data users via a service-oriented architecture. Designed to improve the discovery and access of NASA data.
Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their EOS data holdings and other Earth science-related data holdings.
User-defined specialized “clients” can be easily developed to give science data users of their community access to EOS data and services using ECHO’s open APIs.
2
Developed as a part of
NASA’s core data systems
but fully adaptable to
the needs/requir
ements of science
communities.
3
Current ECHO Data Partners
Data currently accessible in ECHO:
• Collections: 3,186
• Granules: 89 million
• Browse images: 43 million
EOSDIS Data Centers participating in ECHO• ASDC: Radiation Budget, Clouds, Aerosols and Tropospheric Chemistry
• ASF: Synthetic Aperture Radar (SAR), Sea Ice, Polar Processes, Geophysics
• GES DISC: Atmospheric Composition and Dynamics, Global Precipitation, Model Output, Solar Irradiance
• GHRC: Global Hydrology, Global Temperatures, and Lightning
• LP-DAAC: Land Processes
• NSIDC: Snow and Ice, Cryosphere and Climate
• ORNL: Biogeochemical Dynamics, Ecological Data, Environmental Processes
• PO-DAAC: Oceanic Processes, Air-Sea Interactions
• SEDAC: Population, Sustainability
Other EO Data Centers• USGS: Landsat
Metadata
4
5
ECHO Client Partner Status
Current ECHO Clients• Variety of client types
• Web-based clients, Installed applications
• User interactive, machine-to-machine
• Variety of purposes• General purpose geospatial and temporal searching
• Customized user interfaces to facilitate specific communities and tasks
• Additional value-added processing by clients (e.g. subset, stitch, resample, reproject, reformat)
• Middleware components
Client Partner metrics (May 2011)
• Operational Public: 7• Active Development: 3
Warehouse Inventory Search Tool (WIST)
Provides search and order capabilities across the full set of data provider holdings in the ECHO catalogue.
One of the primary access points to EOSDIS and other Earth science data holdings
Users are able to submit cross-discipline queries using spatial and temporal criteria, examine search results for relevancy using built-in tools, and submit orders via ECHO to the appropriate data provider(s).
Based on the EOS Data Gateway (EDG) user interface
https://wist.echo.nasa.gov
6
Next Generation Client - REVERB
Provides search and order functionality built on the ECHO API that improves end user experience of the WIST client in user satisfaction and performance.
Exposes the ECHO service registry with relevant ECHO metadata and incorporate a modern dynamic user interface using current web development technology.
• Leverages newer technologies (Ruby on Rails web application framework) and performance enhancements
Operational Release May 2011
7
Reverb Overview
• New Paradigm• Utilize modern technology to provide an enhanced look & feel & improved sustainability• Utilize modern web standards including a new REST-based ECHO API• Provide an extendible platform that will allow for simpler incorporation of new user interfaces
capabilities.• Requirements
• Derived from WIST functionality, previous NCRs, and new enhancements.• Tracked entirely in TestTrack Pro
Improved Client Features• Enhance Dataset Discovery• Improve Search Criteria Entry & Validation• Utilize of Cloud Cover metadata value • Facilitate Bulk Download• Facilitate Service Discovery & Invocation• Utilize new Calendar API configured through PUMP• Utilize enhanced Data Quality Summaries configured through PUMP• Provide browse thumbnail images during browsing
ESA’s eoPortal Catalogue - ECHO Client
Similar to WIST, the eoPortal Catalogue Client allows users to query Earth Science products from diverse data providers using spatial and temporal boundaries. Some of the catalogs currently represented in their client are NASA (via ECHO), German Space Agency (DLR), Korea Aerospace Research Institute (KARI), and the European Space Agency (ESA).
9
ECHO and GCMD Interoperability
The GCMD ECHO Portal offers the users a virtual subset of the GCMD to gain direct access to granule-level data in ECHO.
• The GET DATA link sends a search to WIST based on the search criteria selected in the GCMD and automatically pre-populates the WIST form but does not execute the query.
ECHO adopted the GCMD Science Keyword structure for use in the ECHO metadata model
WIST and the ECHO-OpenSearch client reference GCMD Dataset Definitions.
10
Recent ECHO Improvements
ECHO was re-architected to provide full redundancy of all critical components, virtually eliminating need for preventive maintenance downtime, and increased stability. Operational availability has been dramatically improved:
• Average operational availability over past 6 months: 99%
ECHO search performance has been significantly improved in the past 2 years: Average query time now 7 seconds (from 30 seconds)
Average Ingest performance improved by a factor of 10
ECHO is working to simplify efforts of Client developers:
• Added 2 new API formats: OpenSearch and REST
ECHO’s Ingest functionality is being enhanced to support multiple metadata formats including ISO 19115 and allowing the discovery of the catalog query results in these formats;
• Reverb will be able to output data in the ISO 19115 metadata standard.
11
ECHO and the GES DISC
Reverb supports batch download of online data (w/o ordering)
• The critical ingredient for ECHO to be relevant to GES DISC users
• Also looks and works better than WIST
GES DISC is working on several clients through ECHO’s OpenSearch interface
• Mirador external search
• Simple Subset Wizard
• Community-based Giovanni
• Giovanni for YOTC
Also cooperating (with EED) on EOSDIS Service Interface
• Generalization of the Simple Subset Wizard agent interface
12