OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture...

OOI CI LCA REVIEW August 2010

Ocean Observatories Initiative

OOI Cyberinfrastructure Architecture Overview

Michael Meisinger

Life Cycle Architecture ReviewLa Jolla, CA


Goals for this Presentation•To set the stage…

•What is … the OOI Integrated Observatory?•What is … the CI (Cyberinfrastructure)?•What is … Release 1? •What is … the role of the architecture in

Construction?•Where … can I find information about the CI design?

•What … were the main accomplishments in Elaboration?

•What … are the core implementation choices?

•… for detailed subsystem presentations


Overview

•Architecture in the System Engineering Process

•Architectural Overview

•The OOI Integrated Observatory

•CI Capabilities in Release 1

•Subsystems and Interfaces

• Implementation of the Architecture

•Current Status

•Main Choices

•Key Concepts

•Capability Integration Strategy

•Deployment: Plan and Strategy


Role of the Architecture• Blueprint for software construction

• Defines long term intent

• Defines the core structure of the system: interfaces, services, startup,

data flow

• Defines the fundamental principles

• Starting point for developers during task definition

• Daily reference for developers when making implementation decisions

• Place to document consolidated understanding and design refinement

• Ensure that the developed system meets the requirements:

• Functional capabilities, performance, security

• Maintainability, manageability, extensibility

• Supporting OOI-wide SE processes

• Requirements and interface management

• Configuration control

• Integration, test, validation


Architecture Products

•Architecture Documentation• Story, background, context (Living, consistent

documentation)

• Located on Confluence, exported to PDF

•Architecture Model• Drawings, Definitions, Tracing

• Authored in Enterprise Architect, clickable export

• Searchable PDF document of all drawings

•Technology List• Candidate technologies for integration, interfacing, reference

• Living spreadsheet and reference catalog


Enterprise ArchitectUsed to:• Define• Draw• Connect• Identify• Check• Document• Browse• Export

Examples:• Drawing

repository• Requirements

Tracing• Interface

identification

HTML Export: http://ooici.net/eaexport/


OOI Integrated Observatory


Integrated ObservatorySensor

PlatformsPhysicalInterface

MarineOperations

Shore SideOperations

End UserOperations

MobileCore

FixedCore

ResearchPlatforms

AdministratorCyber OperatorMarine Operator

User

Marine

Cyber

Operational Authority

ObservatoryOperations

Science Teams & Educators

ObservatoryManagement

MarineManagement

User EnvironmentManagement

Marine Net Observatory Net


OOI Integrated Observatory

Out of scope

for release 1

Out of scope

for release 1

Out of scope

for release 1

Out of scope

for release 1

Out of scope

for release 1


OOI Release 1

External Data

Sources (Observatorie

s, such as IOOS with GTS/IDD, individual

data producers)

Data Analysts, Numerical Modelers


Scope: Product Definition•Release 1: Data Distribution Network (May 2011)•“Ingest” data (products) from external data

sources•Characterize data sources with their metadata

attributes (format, structure) •Transform data into internal OOI data formats, for

stream-based distribution and persistence•Distribute data via streaming and DAP servers to

data analysts and numerical modelers•Provide a platform for initial instrument

integration, control and sensor data acquisition•Provide a distributed service integration and

execution platform


Release Schedule

Y 1 Y 2 Y 3 Y 4 Y 5

4 4 6 2

Release Cycle

R-1

R-2

R-3

R-4

R-5

Project Year

R-1

R-2

R-3

R-4

R-5

Data Distribution Network

Managed Instrument Network

OnDemand Measurement Processing

Integrated Modeling Network

Interactive Ocean Observatory

Kick-Off 9/09


Subsystems

2650-00008 OV2 CI

Sensing & Acquisition

DataManagement

CommonOperating

Infrastructure

CommonExecution

Infrastructure


The Capability Container

• Ingredients:

• Capability: function, service, process

• Plumbing: Messaging, security

• Container: drop it all in as needed

• Packaging: label it, tape it shut… done!


Secure Reliable Messaging

CapabilityContainer

CapabilityContainer

CapabilityContainer

CapabilityContainer

CapabilityContainer

Capability(Service)

Capability(Service)

Capability(Service)

Capability(Service)

Capability(Service)


COI Infrastructure Services

The Common Operating Infrastructure (COI) is the integration & communication environment for all the

other subsystem services

Common Operating Infrastructure

Sensing & Acquisition

Data Management

Analysis & Synthesis

Identity Management

State Management

GovernanceFramework

Resource Management

Planning & Prosecution

Exchange

Service Framework

Presentation Framework

Common Execution

Infrastructure


Integration Strategy

•Capability Container

•Secure reliable messaging via the “Exchange”

•Service-oriented architecture

•Non-central governance

•COI Infrastructure Services


CI Interfaces and Subsystems


Deployment Plan and Strategy

•Deployment of capability containers in OOI clusters

and in the Amazon cloud by leveraging

virtualization

•CyberPoP (Cyberinfrastructure Point of Presence):

physical deployment of one or multiple capability

containers

•Network connectivity

•Storage and computation (redundant)


Network Architecture


Network Deployment


Goals of Spiral Phases in Development

• Inception

• Define the objectives with stakeholders

• Perform isolated prototyping in high risk areas

• Get the development team trained in technologies and dependencies

• Define the architecture and integration plan

• Elaboration

• Build out the core interfaces and architectural components (services and message

interactions)

• Integrate services by defining end-to-end scenarios

• Refine and consolidate the architecture and design specs

• Make a realistic construction plan based on measured team performance

• Construction

• Refactor core interfaces and components based on lessons learned

• Implement services and components according to construction plan

• Continuous integration

• Successively add to the test suite in order to prove satisfaction of release use cases


Progress in Elaboration

•One primary code base “LCAarch”

•Python as primary technology for architectural

prototyping

•More than 25K lines of code

• Integration basically across all subsystems

(some exceptions)

•Presentation Platform: Web UI

• Interoperability with prototypical Java platform


LCAarch

•TBD


Goals check: Questions?

Thanks !


Scenario Walk Through

•Detailed use case message scenario:

•External entities (user/system/device)

•services with operations and events

•deployment locations

•message format

• interaction sequence


Agenda

•Subsystem Purpose

•Release 1 Product Description Use Case Overview


•Status of Progress

•Use Cases Address, Use Cases Demonstrated

•Technology Challenges and Achievements

•Plan for Construction

•Significant Risks


Agenda

•Subsystem Purpose

•Release 1 Product Description Use Case Overview


•Status of Progress

•Use Cases Address, Use Cases Demonstrated

•Technology Challenges and Achievements

•Plan for Construction

•Significant Risks


{name} Subsystem: Purpose


Release 1 Product Description Use Case Overview


Architectural Overview


Status of Progress

•Use Cases Address

•Use Cases Demonstrated


Technology Challenges and Achievements


Plan for Construction


Significant Risks


Architecture Overview


Thanks !

Questions ?


Scope of Future Releases•Release 2: Managed Instrument Network (2012)

• Fully managed instrument activation and control; ready for deployment on OOI moorings and cable infrastructure

• Qualified data products based on automated data processing•Release 3: On-Demand Measurement Processing

(2013)• Observatory management and resource scheduling• On demand and event driven measurements• Data processing workflows

•Release 4: Integrated Modeling Network (2014)• Interactive analysis and synthesis• Numerical model integration

•Release 5: Interactive Ocean Observatory (2015)• Full control of data, processes, models, instruments• Closed loop, adaptive sensing and platform control

Out of scope

for release 1


Preparing Services for Deployment

InstrumentPoint

AcquisitionPoint

IngestPoint

ApplicationPoint

StoragePoint

AccessPortal


Deployment Scenario

Out of scope

for release 1

Out of scope

for release 1

Out of scope

for release 1


External Interfaces

1604-00001 SV1 OOI


External Interfaces

Terrestrial CyberPoP

Cloud Execution

Point

Marine Management

CI Station

CI Instanceon platform

User CIInstanceOut of scope

for release 1

Out of scope

for release 1

Out of scope

for release 1


System Deployments

2660-00014 SV1 CI

Date post:	02-Jan-2016
Category:	Documents
Upload:	ethan-brown
View:	215 times
Download:	1 times

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture...

Documents