+ All Categories
Home > Documents > A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A...

A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A...

Date post: 27-Oct-2019
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
19
SCOOP Data Management: SCOOP Data Management: A Standards A Standards - - based Distributed System based Distributed System for Coastal Data and Modeling for Coastal Data and Modeling Helen Conover, Bruce Beaumont, Marilyn Drewry, Helen Conover, Bruce Beaumont, Marilyn Drewry, Sara Graves, Ken Keiser, Manil Maskey, Matt Smith Sara Graves, Ken Keiser, Manil Maskey, Matt Smith The University of Alabama in Huntsville The University of Alabama in Huntsville Philip Bogden, Joanne Bintz Philip Bogden, Joanne Bintz Southeastern Universities Research Association Southeastern Universities Research Association Presented by Rahul Ramachandran (UAH) Presented by Rahul Ramachandran (UAH) IGARSS 2006 IGARSS 2006 http:// http:// scoop.sura.org scoop.sura.org
Transcript
Page 1: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

SCOOP Data Management:SCOOP Data Management:A StandardsA Standards--based Distributed System based Distributed System

for Coastal Data and Modelingfor Coastal Data and ModelingHelen Conover, Bruce Beaumont, Marilyn Drewry, Helen Conover, Bruce Beaumont, Marilyn Drewry, Sara Graves, Ken Keiser, Manil Maskey, Matt Smith Sara Graves, Ken Keiser, Manil Maskey, Matt Smith

The University of Alabama in HuntsvilleThe University of Alabama in Huntsville

Philip Bogden, Joanne BintzPhilip Bogden, Joanne BintzSoutheastern Universities Research AssociationSoutheastern Universities Research Association

Presented by Rahul Ramachandran (UAH)Presented by Rahul Ramachandran (UAH)IGARSS 2006IGARSS 2006

http://http://scoop.sura.orgscoop.sura.org

Page 2: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

National Oceanographic Partnership Program (NOPP)National Oceanographic Partnership Program (NOPP) 15 federal 15 federal agencies providing leadership and coordination of national agencies providing leadership and coordination of national research and education programsresearch and education programs http://http://www.nopp.orgwww.nopp.org//Ocean.USOcean.US -- National Office for Integrated and Sustained Ocean National Office for Integrated and Sustained Ocean ObservationsObservations coordinates development of an operational coordinates development of an operational Integrated Ocean Observing System (IOOS)Integrated Ocean Observing System (IOOS)

http://www.ocean.us/http://www.ocean.us/National Federation of Regional Associations National Federation of Regional Associations provide a provide a framework for orchestrating regional collaborations framework for orchestrating regional collaborations http://http://www.usnfra.orgwww.usnfra.org//NSF Ocean Research Interactive Observatory Networks (ORION)NSF Ocean Research Interactive Observatory Networks (ORION)an emerging network of complimentary research infrastructure an emerging network of complimentary research infrastructure that provides a research foundation for IOOS applications that provides a research foundation for IOOS applications http://http://www.orionprogram.org/default.htmlwww.orionprogram.org/default.htmlInteroperabilityInteroperability so that national and regional activities can so that national and regional activities can integrate into a seamless tapestry of observations and predictiointegrate into a seamless tapestry of observations and predictions, ns, e.g., e.g., OpenIOOSOpenIOOS http://http://www.openioos.orgwww.openioos.org//

established

informationresources

commongoal

relatedresearch

Integrated Ocean Observing:Integrated Ocean Observing:A Key Component of IEOSA Key Component of IEOS

Page 3: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

Key StandardsKey Standards--based based Interoperability EffortsInteroperability Efforts

Ocean.USOcean.US Data Management and Communications Data Management and Communications (DMAC) Plan(DMAC) Plan provides the framework for provides the framework for interoperabilityinteroperabilityhttp://dmac.ocean.us/dacsc/imp_plan.jsphttp://dmac.ocean.us/dacsc/imp_plan.jsp

Open Geographic Information Systems (GIS) Open Geographic Information Systems (GIS) Consortium (OGC)Consortium (OGC) an open consortium of industry, an open consortium of industry, government, and academia developing interface government, and academia developing interface specifications to support interoperability specifications to support interoperability http://http://www.opengis.orgwww.opengis.org

Marine Metadata InteroperabilityMarine Metadata Interoperability a community effort a community effort to make marine metadata easier to find, access and to make marine metadata easier to find, access and useuse http://http://www.marinemetadata.orgwww.marinemetadata.org//

Page 4: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

What is SCOOP ? What is SCOOP ?

Southeastern Universities Research Association (SURA) Southeastern Universities Research Association (SURA) program to program to create an infrastructurecreate an infrastructure for a distributed for a distributed Integrated Ocean Observing System (IOOS) Integrated Ocean Observing System (IOOS) in the in the southeastern regionsoutheastern region

Provides a shared means for the acquisition of observational Provides a shared means for the acquisition of observational datadataEnables modeling, analysis and delivery of information in realEnables modeling, analysis and delivery of information in real--timetime

The SCOOP program is a The SCOOP program is a SURA Coastal Research SURA Coastal Research initiativeinitiative that is deploying cutting edge IT to advance that is deploying cutting edge IT to advance the science of environmental prediction and hazard the science of environmental prediction and hazard planning for our nationplanning for our nation’’s coasts. s coasts.

SCOOP will SCOOP will serve as a modelserve as a model for the national effort in for the national effort in integrating ocean observing systemsintegrating ocean observing systems

http://scoop.sura.org/http://scoop.sura.org/

Page 5: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

A Distributed LaboratoryA Distributed Laboratory

CommunityCommunity--based prototypebased prototype of a of a distributed national distributed national laboratorylaboratory for coastal research and applications for coastal research and applications

OpenOpen--access, distributed facility supported by access, distributed facility supported by university university researchersresearchers in partnership with in partnership with government agenciesgovernment agenciesand the and the private sectorprivate sector. .

Combining coastal science & ITCombining coastal science & IT to enable revolutionary to enable revolutionary science in environmental prediction & hazard planning.science in environmental prediction & hazard planning.

Implementing partners:Implementing partners:GoMOOSGoMOOS –– OpenIOOS (user interface), WW3 & SWAN (wave models) OpenIOOS (user interface), WW3 & SWAN (wave models) UAHUAH –– Catalog & Related Services (Data Portal) & SCOOP web siteCatalog & Related Services (Data Portal) & SCOOP web siteUFUF –– Regional Inundation Models (CH3D), Virtualization, & Wind Regional Inundation Models (CH3D), Virtualization, & Wind EnsembleEnsembleLSULSU –– Distributed Archive Design & Compute Resource UtilizationDistributed Archive Design & Compute Resource UtilizationU MiamiU Miami –– Hurricane Forcing & ProductHurricane Forcing & Product--Info DevelopmentInfo DevelopmentUNCUNC –– Regional Inundation (ADCIRC) & USACE & Grid ComputingRegional Inundation (ADCIRC) & USACE & Grid ComputingTAMUTAMU –– Archive and Visualization Services (Smorgasbord Portal)Archive and Visualization Services (Smorgasbord Portal)VIMSVIMS –– Regional Inundation Models (ELCIRC) & Regional Inundation Models (ELCIRC) & OOSTechOOSTech FollowFollow--onon

Page 6: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

TAMULSU

UM

UF

UAH

UNC

VIMS

GoMOOS

SCOOP NearSCOOP Near--realreal--time Data time Data Transport NetworkTransport Network

All datafor archive

SCOOP net

All datafor archive

In situ obsMM5

windsADCIRC

win

ds ANAGFDLCH3D

ELC

IRC

Translated products

win

ds

SWANWAM Windgen

(ftp)

WW

3

External feedsGFDLCOAMPSNAMothers

BIO

archivearchive

catalog

Page 7: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

Internal Data and Metadata Internal Data and Metadata Standards and ConventionsStandards and Conventions

Standards and conventions are used across the program to Standards and conventions are used across the program to enable interoperability among SCOOP partners:enable interoperability among SCOOP partners:

SCOOP file namesSCOOP file names encode selected metadata, in encode selected metadata, in order to facilitate data file identification and order to facilitate data file identification and usability across the distributed systemusability across the distributed system

•• Basic categorizations of data: (1) inBasic categorizations of data: (1) in--situ and remotely situ and remotely observed data, (2) Wind model output, and (3) Wave/Surge observed data, (2) Wind model output, and (3) Wave/Surge model output model output

•• Observation instrument or model nameObservation instrument or model name•• Source institutionSource institution•• Time of observation or model initialization, and forecast Time of observation or model initialization, and forecast

periodperiod•• Various ancillary information Various ancillary information

netCDFnetCDF file formatfile format used for all data generated by used for all data generated by coastal models in SCOOPcoastal models in SCOOPCOARDS/CF vocabularyCOARDS/CF vocabulary used for variable names used for variable names within SCOOP data files and in the metadata Catalogwithin SCOOP data files and in the metadata Catalog

Page 8: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

The SCOOP metadata Catalog is a central The SCOOP metadata Catalog is a central metadata repository facilitating data discovery metadata repository facilitating data discovery and access.and access.The Catalog is accessed through a suite of web The Catalog is accessed through a suite of web services:services:

Support Support SOAP, WSDL SOAP, WSDL andand XMLXML standards of the standards of the World Wide Web ConsortiumWorld Wide Web ConsortiumConform to the Conform to the Basic ProfileBasic Profile specifications of the specifications of the Web Services Interoperability OrganizationWeb Services Interoperability OrganizationWritten in Java or PerlWritten in Java or PerlTested locally with both Java and Perl clients to Tested locally with both Java and Perl clients to assure crossassure cross--platform interoperabilityplatform interoperability

StandardsStandards--based based Information Management ServicesInformation Management Services

Page 9: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

data

Archives

Users

GeoSpatialOneStop

SCOOP Information ArchitectureSCOOP Information ArchitectureMetadata for data discoveryMetadata for data discovery

OpenIOOS Interoperability Demo

SCOOP Catalog& Services

SCOOPData Providers

LocalInventory

Model orApplication

FGDC Records

WMS data list & metadata

Automated Data Discovery

DataDiscovery

Metadata Population

SCOOP User Community

Data Providers

SCOOP Catalog Hurricane Search

pages

SCOOP Catalog Main search

pages

SCOOP Data Collection

Registry pages

Catalog Web Services

Ingest Svcs Query Svcs

SCOOPMetadataCatalog

Page 10: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

OpenIOOS Interoperability TestbedOpenIOOS Interoperability Testbed

Interactive visualizations of nearInteractive visualizations of near--realreal--time time coastal observations with water level, wave and coastal observations with water level, wave and surge forecastssurge forecastsWeb Map ServiceWeb Map Service and and Web Feature ServiceWeb Feature Serviceprotocols defined by protocols defined by Open Geospatial Open Geospatial ConsortiumConsortiumStandard, efficient visualization interface for Standard, efficient visualization interface for both SCOOP archivesboth SCOOP archives

No requirement to move large model output No requirement to move large model output to another siteto another siteLocal data access allows fast image creationLocal data access allows fast image creationGraphical product smaller than model outputGraphical product smaller than model output

Page 11: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

OpenIOOS Interoperability TestbedOpenIOOS Interoperability Testbed……where standards enable innovationwhere standards enable innovation

http://www.openioos.org/http://www.openioos.org/

Page 12: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

OpenIOOS Interoperability TestbedOpenIOOS Interoperability Testbed……where standards enable innovationwhere standards enable innovation

http://www.openioos.org/http://www.openioos.org/

Page 13: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

National Data and Metadata National Data and Metadata Standards EffortsStandards Efforts

The SCOOP Catalog is compliant with federal The SCOOP Catalog is compliant with federal metadata standards metadata standards

Incorporates Incorporates Federal Geographic Data Committee Federal Geographic Data Committee Content Standard for Digital Geospatial MetadataContent Standard for Digital Geospatial MetadataSupports an FGDC Clearinghouse node for SCOOPSupports an FGDC Clearinghouse node for SCOOP

UAH represents SCOOP in several data and UAH represents SCOOP in several data and metadata standards efforts metadata standards efforts

Metadata and Data Discovery Expert Team for Metadata and Data Discovery Expert Team for Data Data Management and CommunicationsManagement and Communications within IOOS.within IOOS.Marine Metadata InteroperabilityMarine Metadata Interoperability projectproject

Page 14: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

HurricaneHurricane--based Data Searchbased Data Search

http://http://scoop.sura.orgscoop.sura.org//Storms/Storms/

Page 15: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

HurricaneHurricane--based Data Searchbased Data Search

http://http://scoop.sura.orgscoop.sura.org//Storms/Storms/

Page 16: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

HurricaneHurricane--based Data Searchbased Data Search

http://http://scoop.sura.orgscoop.sura.org//Storms/Storms/

Page 17: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

HurricaneHurricane--based Data Searchbased Data Search

http://http://scoop.sura.orgscoop.sura.org//Storms/Storms/

Page 18: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

HurricaneHurricane--based Data Searchbased Data Search

http://http://scoop.sura.orgscoop.sura.org//Storms/Storms/

Page 19: A Standards-based Distributed System for Coastal Data and ... fileSCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont,

http://scoop.sura.org


Recommended