Kevin Gomes and John Graybeal, MBARI

MBARI’s SSDS

OOI Cyberinfrastructure:San Diego

June 30, 2008

OOI-CYBERINFRASTRUCTURE

MBARI’s Shore Side Data System (SSDS)

• Requirements (very quick) and Architecture Overview

• Data and Metadata Model• Ingest, Processing and Provenance

OOI-CYBERINFRASTRUCTURE

High-Level Requirements

• Capture observatory and instrument lifecycle data

• Return instrument data in its native (“raw”) format

• Simple analysis tools for viewing data• Support queries for data• Support merging with other data• Retain (and return) all associated metadata

and history with data• Return data in different formats

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

ID: XParent: YData: [0110..]

<Metadata>

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

QuickTime™ and a decompressor

are needed to see this picture.

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

RawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS SIAMPortal

Inst

PU

CK Service

SIAM

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

SIAMPortal

SSDS

Metadata NetApp

HTTP

WebApp

Adapter

Adapter

Adapter

Adapter

ESB

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

Strategy

Proxy

Strategy

Proxy

Strategy

Proxy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

RawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS SIAMPortal

Inst

PU

CK Service

SIAM

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

SIAMPortal

SSDS

Metadata NetApp

HTTP

WebApp

Adapter

Adapter

Adapter

Adapter

ESB

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

Strategy

Proxy

Strategy

Proxy

Strategy

Proxy

<?xml version="1.0" encoding="UTF-8" standalone="yes"?><SensorML xmlns="http://www.opengis.net/sensorML/1.0.1" xmlns:ns2="http://www.opengis.net/gml" xmlns:ns3="http://www.w3.org/1999/xlink" xmlns:ns4="urn:us:gov:ic:ism:v2" xmlns:ns5="http://www.opengis.net/swe/1.0.1" xmlns:ns6="http://www.w3.org/2001/SMIL20/" xmlns:ns7="http://www.w3.org/2001/SMIL20/Language" version="1.0.1"> <member ns3:type="simple"> <System ns2:id="9b1ed7d4-d95c-11db-a6d9-fff1427a99d4"> <ns2:description ns3:type="simple">UW-Seahurst installation of Wetlabs ECO-BB2F</ns2:description> <keywords ns3:type="simple"> <KeywordList> <keyword>ALOHA</keyword> <keyword>ALOHA-ECO</keyword> </KeywordList> </keywords> <identification ns3:type="simple"> <IdentifierList> <identifier name="Device UUID"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:uuid"> <value>9b1ed7d4-d95c-11db-a6d9-fff1427a99d4</value> </Term> </identifier> <identifier name="Device ID"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:ID"> <value>1608</value> </Term> </identifier> <identifier name="Device Name"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:name"> <value>Wetlabs ECO-BB2F Fluorometer</value> </Term> </identifier>

<?xml version="1.0" encoding="UTF-8" standalone="yes"?><ns3:Observation xmlns:ns1="http://www.opengis.net/gml" xmlns:ns2="http://www.w3.org/1999/xlink" xmlns:ns3="http://www.opengis.net/om/1.0" xmlns:ns4="http://www.opengis.net/swe/1.0.1" xmlns:ns5="http://www.opengis.net/sensorML/1.0.1" xmlns:ns6="urn:us:gov:ic:ism:v2" xmlns:ns7="http://www.w3.org/2001/SMIL20/" xmlns:ns8="http://www.w3.org/2001/SMIL20/Language"> <ns3:result xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="ns4:RecordType"> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >539</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >1273</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >15:23:12</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >527</ns4:Item> </ns4:field>

OOI-CYBERINFRASTRUCTURE

Inst

PUCK

NetCDFOceanSites

JMSHTTP

OGCServices

WebServices

API

THREDDS

StrategyRawData

OPeNDAP

Inst

Rover

OASISTelemetry

ALOHA

(MARS/Seahurst)

Client

OASIS2 SSDSDriver

OASIS

Service

SIAM

MOOS

Proxy

SIAMPortal

Inst

PU

CK Service

SIAM

Strategy

Proxy

Inst

PUCK

Service

SIAM

FOCE

AUV

RoverPortal

AUVPortal

Strategy

Proxy

SIAMPortal

SSDS

Metadata NetApp

Adapter

Adapter

Adapter

Adapter

ESB

HTTP

WebApp

Adapter

Connector

ESB

Inst

Proxy

Adapter

Strategy

Questions?