ODIP-2 May 2016 WorkshopBig Data & Model Workflows

• Update on streaming data systems (Adam Leadbetter, MI – Ireland)

• Update from Australia - Data Brokering and Visualisation (Jonathan Hodge, CSIRO – Australia)

• NOAA’s Big Data Project (Jeff Weber, UCAR – United States)• NOAA’s OneStop (David Fischman, NOAA – United States)• EVER-EST VRE (Helen Glaves, BGS – United Kingdom)

• Any other updates / Discussion

Session Outline

Reminder

“‘Big Data’ is really about having more data today than I had yesterday, such that I need to find and apply different ways and means of processing it to meet my NSF deadlines.’”

- Lesley Wyborn

Reminder

Update on streaming data systems at the Marine

Institute, IrelandAdam Leadbetter

adam.leadbetter@marine.ie

Streaming Data Philosophy

Streaming Data Philosophy

Streaming Data Architecture - I

Subsea instrumen

ts

Streaming Data Architecture - I

Subsea instrumen

ts

Seri

al

TCP/IP

Streaming Data Architecture - I

Subsea instrumen

ts

Seri

al

TCP/IP

Streaming Data Architecture - I

Subsea instrumen

ts

Seri

al

TCP/IP

Disc archi

ve

Streaming Data Architecture - II

Streaming Data Architecture - II

Streaming Data Architecture - II

Streaming Data Architecture - II

Sensor Observation Service – OM-JSON

Sensor Observation Service – OM-JSON

Internet of Things

Internet of Things

Internet of Things

Internet of Things