Observations to Information

transcript

Simon Cox | Research Scientist | Environmental Information Systems

12 December 2013

LAND AND WATER

2013 Leptoukh Lecture

Standards for observation data

• Motivation and development

• Earth-science and environmental applications

• Renewal

AGU Fall 2013 | IN42A-01 | Cox | Leptoukh2 |

Origins

A bit of history

AGU Fall 2013 | IN42A-01 | Cox | Leptoukh

• 1993-2000 AGCRC• Web-mapping

• Reporting research online

• 1995

A bit of history

• 1999-2004 XMML, ADX• Exploration data standards

A bit of history

• 1999-2004 XMML, ADX• Exploration data standards

A bit of history

• 1999-2004 XMML, ADX-2010 AuScope

• Exploration data standards

A bit of history

• 2002-2005 OGC SWE• Sensors anywhere

A bit of history

• 2005-2013 Fluid Earth• Water informatics

A bit of history

• 2005-2013 WIRADA• Water informatics

Motivation for a standard

All of society’s grand challenges require data to be shared and integrated across cultures, scales and technologies

Motivation for a standard

• Integrated analysis and modelling

• Discovery & data integration a significant challenge

• Standard vocabularyMany private contracts

one public agreement!

Remote sensing

Sensor

Parameter

Earth science

Algorithm, code, simulator

Model, field

Variable

Volume, grid

Metrology

Instrument

Measurand

Sample

Chemistry

Instrument,analytical process

Analysis

Analyte

Sample

Environmental monitoring

Gauge, sensor

Value, time-series

Parameter

Station

Observations & Measurements

procedure

result

observed property

feature of interest

SWE/O&M

OM_Observation

+ phenomenonTime

+ resultTime

+ validTime [0..1]

+ resultQuality [0..*]

+ parameter [0..*]

GF_PropertyType

GFI_Feature

OM_Process Any

+observedProperty

+featureOfInterest 1

+procedure1 +result

An Observation is an action whose result is an estimate of the value

of some property of the feature-of-interest, obtained using a specified procedure

Cox, OGC Abstract Specification – Topic 20: Observations and Measurements 2.0

ISO 19156:2011 Geographic Information – Observations and measurements14 |

• In situ observations

• Remote sensing

• Ex-situ observations

• Numerical models/simulations

• Forecasts

Any action whose result is an estimate of a property value

Specimen

Sampling features

Observation

SamplingFeature

+ Parameter

+ lineage

Feature

SpatialSamplingFeature

+ positionalAccuracy

+relatedObservation 0..*

SamplingSolidSamplingPoint SamplingCurve SamplingSurface

Intention

+sampledFeature

SamplingFeatureComplex

+ role

+relatedSamplingFeature0..*

+relatedObservation

Profile

Section

Station

Borehole

MapHorizonScene

Cox, OGC Abstract Specification – Topic 20: Observations and Measurements 2.0

ISO 19156:2011 Geographic Information – Observations and measurements

GM_Object+shape

Harmonized with

CSML, NCAR

OGC Sensor Web Enablement

• SensorML

• O&M

• Sensor Observation Service

• Sensor Planning Service

getObservation

getResult

describeSensor

getFeatureOfInterest

Sensor Observation Service

Feature

service

getFeature,

type=Observation

Gridded data

service

getCoverage

(result)

Sensor

Register

getRecordById

Feature

service

getFeature

Observations & Measurements

procedure

result

observed property

feature of interest

result time

phenomenon time

valid time

procedure

Provider or consumer?

Integrated into ISO 19100 framework

ISO dependencies • gf - Feature ISO 19109

• cv - Coverage (fields) ISO 19123

• md - Metadata ISO 19115

• gm - Geometry ISO 19107

• tm - Temporal ISO 19108

• basic - Datatypes ISO 19103

OM_Observation

+ phenomenonTime

+ resultTime

+ validTime [0..1]

+ resultQuality [0..*]

+ parameter [0..*]

GFI_PropertyTypeGFI_Feature

OM_ProcessGFI_DomainFeature Any

+observedProperty

1+propertyValueProvider

+featureOfInterest

+generatedObservation

+procedure1 +result

observed property

Parameter dictionary

procedure

Register of sensors, processes & algorithms

feature of interest

Feature-type catalogue

Feature service

result format:

GML, SWE, netCDF, JSON, SQLite...

Domain specialization

Linked vocabularies can be shared and re-used

Applications

WaterML2 specializes O&M

class Context diagram: TimeseriesObserv ation

«FeatureType»

TimeseriesObserv ation

OM_Process

«FeatureType»

Procedures::

Observ ationProcess

MD_Metadata

«Type»

Observ ationMetadata

«FeatureType»

observ ation::OM_Observ ation

+ phenomenonTime :TM_Object

+ resultTime :TM_Instant

+ validTime :TM_Period [0..1]

+ resultQuality :DQ_Element [0..*]

+ parameter :NamedValue [0..*]

«FeatureType»

cov erageObserv ation::

OM_DiscreteCov erageObserv ation

«FeatureType»

Timeseries (TVP) Observ ation::

TimeseriesTVPObserv ation

«FeatureType»

TimeseriesDomainRangeObserv ation

«FeatureTyp...

General Feature

Instance::

GFI_Feature

«metaclass»

General Feature Model::

GF_PropertyType

{root}

+ memberName :LocalName

+ definition :CharacterString

«FeatureType»

Timeseries::Timeseries

+metadata

+generatedObservation

+procedure

+propertyValueProvider

Domain

+featureOfInterest

Phenomenon

+observedProperty

Range +result

Package:

Version:

Author:

Context diagram: TimeseriesObservation

«RequirementsClass» Timeseries Observation

• Result is a time-series

• Observed-property relates to water

• Key predecessors:• CUAHSI WaterML

• WDTF

26 | AGU Fall 2013 | IN42A-01 | Cox | Leptoukh

WaterML-WQ constrains O&M and WaterML

«FeatureType»

measurement::

OM_Measurement

AnyFeature

«FeatureType»

observ ation::OM_Observ ation

+ phenomenonTime :TM_Object

+ resultQuality :DQ_Element [0..*]

+ resultTime :TM_Instant

+ validTime :TM_Period [0..1]

constraints

{observedProperty shall be a phenomenon associated with the feature of interest}

{procedure shall be suitable for observedProperty}

{result type shall be suitable for observedProperty}

{a parameter.name shall not appear more than once}

Units of Measure::Measure

{root}

+ value :Number

+ convert(UnitOfMeasure*) :Measure

«FeatureType»

General Feature

Instance::GFI_Feature

«metaclass»

GF_PropertyType

{root}

«metaclass»

GF_FeatureType

«FeatureType»

observation::

OM_Process

Metadata entity set

information::

MD_Metadata

«FeatureType»

cov erageObserv ation::

OM_DiscreteCov erageObserv ation

«FeatureType»

Timeseries Observ ation::

TimeseriesObserv ation

«FeatureType»

Timeseries (TVP) Observ ation::

TimeseriesTVPObserv ation

The XML element om:result SHALL have a uom property

that is an instance of the owl:Class

http://qudt.org/schema/qudt#Unit as defined in

http://resources.data.gov.au/water/def/water-quality/wq-

quantity.

The XML element om:observedProperty SHALL have

an xlink:href property that is an instance of the

http://qudt.org/schema/qudt#Quantity scheme as

defined in

http://resources.data.gov.au/water/def/water-

quality/wq-quantity.

The XML element om:featureOfInterest SHOULD have an xlink:href property that is an instance of

a GroundWaterML 1 GroundWaterBody feature or sub-type of HydrologicUnit feature as specified

in the XML schema at http://ngwd-bdnes.cits.nrcan.gc.ca/service/gwml/schemas/gwml.xsd

The XML element om:featureOfInterest SHOULD have an xlink:href property that is an instance of

an OGC HY_Features HY_HydroFeature or sub-type as specified at "HY_Features: a Common

Hydrologic Feature Model Discussion Paper OGC 11-039r2"

«Type»

Measurement (TVP) Timeseries::

MeasurementTimeseriesTVP

Timeseries

«FeatureType»

Interleav ed (TVP) Timeseries::

TimeseriesTVP

TimeValuePair

«Type»

Measurement (TVP) Timeseries::

MeasureTimeValuePair

+ value :Measure

«FeatureType»

WQ_Measurement::

WQ_Measurement

«FeatureType»

WQ_MeasurementTimeSeriesTVPObserv ation::

WQ_MeasurementTimeSeriesTVPObserv ation

«FeatureType»

WQ_MeasurementTimeseriesTVP::

WQ_MeasurementTimeSeriesTVP

«metaclass»

WQ_Observ ation::

WQ_PropertyType

O&M Classes

WaterML 2 Classes

Water Quality Classes

Legend

+generatedObservation 0..*

ProcessUsed

+procedure1

Phenomenon

+observedProperty

Metadata

+metadata 0..1

+result

+collection

0..*CoverageFunction

+element

+result

+propertyValueProvider

0..*Domain

+featureOfInterest

+carrierOfCharacteristics

+theGF_FeatureType

«instanceOf»• Subject is a groundwater or geofabric feature

• observed property iswater-quality property

• units of measure must match

Observables vocabulary

dissolved nitrogen

concentration

nitrogen

elemental nitrogen

(CHEBI_33267)

Concentration

MolePercent

MilliGramsPerLitre

AmountOfSubstancePerUnitVolume

nitrogen concentration

+qudt:generalization

+objectOfInterest

+exactMatch

+qudt:quantityKind

+qudt:unit

SamplingFeature

Spatial

SamplingFeatureSpecimen

GeometrySoilSample SoilSpecimen

Domain Feature

Observation

ANZSoilML extends O&M Sampling Features

SoilThematic

Object

SoilLandscape

SoilProfile

ElementSoilSurface

Stream

Channels

Climate

Vegetation

LandSurface

Anthropogenic

Activity

SoilFeature

AbstractSoil

Landform

Landscape

Feature

... also GeoSciML

Motivation

From instrument to User

Existing Activity

SWE Adoption

Seismic Profile O&M

Diviacco, P. et al. 2011 Marine Seismic Metadata for an Integrated European Scale Data Infrastructure31

Integration with existing SeaDataNet Standards

Existing Activity

SWE Adoption

Seismic

EU Air Quality Directive

INSPIRE – OM

7-May 9-May8-May6-May5-May

00Z00Z12Z00Z12Z12Z00Z12Z 00Z

result

forecast : OM_Observation

parameter.name = “analysisTime”parameter.value = 2010-05-06T00:00ZphenomenonTime.begin = 2010-05-06T00:00ZphenomenonTime.end = 2010-05-09T12:00ZresultTime = 2010-05-06T04:30ZvalidTime [optional – not specified]resultQuality [optional – not specified]

ISO19156 Observations and measurements:also suitable for numerical simulations – including forecasts

Common constraints applicable to all WMO

METCE Observation types

WMO METCE

«FeatureType»OM_ComplexObservation

(ISO 19156)

«Type»Record

(ISO 19103)

+result

«FeatureType»ComplexSamplingMeasurement

«FeatureType»Process

+procedure

«FeatureType»OM_Observation

(ISO 19156)

«FeatureType»Process

+procedure

(ISO 19156)

«FeatureType»GFI_FeatureType

+featureOfInterest

(ISO 19156)

«FeatureType»SF_SpatialSamplingFeature

(ISO 19156)

+featureOfInterest

All specialisations of OM_Observation defined in WMO METCE require:

• association role ‘featureOfInterest’ shall be of type SF_SpatialSamplingFeature

• association role ‘procedure’ shall be of type Process (from WMO METCE)

SamplingFeature as OM_Observation.featureOfInterest

In meteorology, we define a sampling regime that enables us to observe, measure or simulate the real-world. Sampling Features (from ISO 19156 ‘Observations and measurements’) provide a way to characterise this sampling regime and the relationship to the real-world.

:ComplexSamplingMeasurement03839:SF_SamplingPoint+featureOfInterest

:Point@srsName “EPSG:4326”

pos = “50.737 -3.405”

+shape

84579:NamedPlacename = “Exeter Airport” +sampledFeature

National Environmental Information Infrastructure

39 |AGU Fall 2013 | IN42A-01 | Cox | Leptoukh

NEII components

Metadata Catalog

Monitoring Sites Register

Vocabulary Service

Observing Methods Register

Data Services

Metadata Catalog

Observing Methods Register

Monitoring Sites Register

Vocabulary Service

Data Service (observations)

Data Service (geographies)

Dataset Site Geography Parameter Instrument / Method Service …

… … … … … … …

Integration through linking table

Observation

observed property

feature of interest

procedure result

sampling feature

Procedure

Observed property

Feature of Interest

result

Observation

OM_Observation

+ phenomenonTime+ resultTime+ validTime [0..1]+ resultQuality [0..*]+ parameter [0..*]

GF_PropertyTypeGFI_Feature

OM_Process Any

+observedProperty

+featureOfInterest

+procedure1 +result

- IGSN

- ResourceURI

- Registrant ID

- timeStamp

- status

IGSN Registry

- IGSN

- Registrant

- MetadataTimeStamp

- Title

- Description

- SamplingLocation

- SamplingTime

- Distributor

- Originator

- SpecimenType

- MaterialClass

- SamplingMethod

SESAR Catalog

- IGSN

- SampleEvent

- SamplePhysicalSize

- RelatedResource

- SamplingMethodDetails

- ProcessingHistory

- CurationHistory

- More local detail…

Allocating Agent CatalogISO & OGC O&M

compliant

AGU Fall 2013 | IN42A-01 | Cox | Leptoukh 43

<spec:SF_Specimen gml:id="abc123"><gml:identifier codeSpace="http://igsn.org">IGSN.SIOabc123</gml:identifier><sa:sampledFeature xlink:href="http://example.org/midAtlanticRidge"/><sa:relatedSamplingFeature>

<sa:SamplingFeatureComplex><sa:role xlink:href="http://example.org/parent"/><sa:relatedSamplingFeature xlink:href="http://handle.net/10273/IGSN.SIOxyz456"/>

</sa:SamplingFeatureComplex></sa:relatedSamplingFeature><spec:materialClass xlink:href="http://example.org/rock"/><spec:samplingTime>

<gml:TimeInstant gml:id="tim123"><gml:timePosition>2009-06-30T08:00:00.00-02:00</gml:timePosition>

</gml:TimeInstant></spec:samplingTime><spec:samplingMethod xlink:href="http://example.org/ghostbuster"/><spec:samplingLocation>

<gml:Point gml:id="loc123" srsName="http://www.opengis.net/def/crs/EPSG/0/4326"><gml:pos>45.12 -81.78</gml:pos>

</gml:Point></spec:samplingLocation><spec:size uom="kg">0.46</spec:size><spec:currentLocation xlink:href="http://example.org/Warehouse3/shelf9/box67"/><spec:specimenType xlink:href="http://example.org/splitCore"/>

</spec:SF_Specimen>

IGSN Sample in OMXML

<http://handle.net/10273/IGSN.SIOabc123>a sam:Specimen ;rdfs:label "SIO specimen abc123"^^xsd:string ;sam:currentLocation <http://example.org/various/Warehouse3/shelf9/box67> ;sam:materialClass p1:rock ;sam:preparationStep

[ sam:processOperator p1:JohnDoe ;sam:processingDetails

<http://example.org/various/sf-process/jkl987> ;sam:time <http://handle.net/10273/IGSN.SIOabc123/tim2> ] ;

sam:sampledFeature p1:midAtlanticRidge ;sam:samplingFeatureComplex

[ sam:relatedSamplingFeature <igsn:SIOxyz456> ;sam:role p1:parent ] ;

sam:samplingLocationp1:loc123 ;

sam:samplingMethod <http://ldeo.columbia.edu/sampling/ghostbuster> ;sam:samplingTime "2013-06-12T09:25:00.00+11:00"^^xsd:dateTimesam:size [ basic:uom unit:kg ;

basic:value "0.46"^^basic:Number ] ;sam:specimenType p1:splitCore .

IGSN Sample in RDF

class Specimen

SF_Specimen

+ currentLocation :Location [0..1]

+ materialClass :GenericName

+ samplingMethod :SF_Process [0..1]

+ samplingTime :TM_Object

+ specimenType :GenericName [0..1]

«estimatedProperty»

+ samplingLocation :GM_Object [0..1]

+ size :Measure [0..1]

SF_SamplingFeature

+ lineage :LI_Lineage [0..1]

GFI_Feature

SamplingFeatureComplex

+ role :GenericName

PreparationStep

+ processOperator :CI_ResponsibleParty [0..1]

+ time :TM_Object

SF_Process

OM_Observation

SF_SamplingFeatureCollection

Design

+relatedObserv ation

+processingDetails

Intention

+sampledFeature

+relatedSamplingFeature

+member 1..*

Single model underlies

different implementations

Application of O&M

• Direct• SOS + OMXML

– [Metadata for values from] data services

• Specializations

– WaterML2, WaterML-WQ, SoilML, SeaDataNet, INSPIRE, WMO ...

• Bridging vocabulary for integration • TERENO (GFZ), NEII, ODM2, IGSN/SESAR, OBOE ...

• Checklist ... • Slots for implicit explicit for x-domain use

Modernizing

XSD OWL from UML

UML Model Output in OWL

om:Observationa :Class ;rdfs:label "Observation"@en ;rdfs:subClassOf gf:AnyFeature , h2o:FeatureType ;:disjointWith om:Process ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:result ] ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:observedProperty ] ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:featureOfInterest ] ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:phenomenonTime ] ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:procedure ] ;rdfs:subClassOf [ a :Restriction ; :cardinality "1"; :onProperty om:resultTime ] .

http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation

O&M in OWL2

sam:Specimen

OM_Observation

+ phenomenonTime+ resultTime+ validTime [0..1]+ resultQuality [0..*]+ parameter [0..*]

GF_PropertyTypeGFI_Feature

OM_Process Any

+observedProperty

+featureOfInterest

+procedure1 +result

SSN ontology

Alignment

Is Observation a Social Object, or an Event?

Lessons

• Ontology for observations, models and forecasts• X-domain interoperability

• Extensible, specialize with vocabularies, link to other ontologies

• Standards • A generic model can provide a checklist for design, and a basis for

harmonization and incremental design

• Consensus introduces an overhead

• Change• Common conceptual model supports multiple implementations

• Widely used

Additional credits

O&M: Fowler & Odell; GeoSciML team; OGC; ISO/TC 211; Rob Atkinson, Rob Woodcock(CSIRO)

WaterML: CUAHSI; Gavin Walker, Pete Taylor, Laurent Lefort (CSIRO); Paul Sheahan (BOM)

Soil, WQ: Bruce Simons, Peter Wilson, Jonathan Yu (CSIRO); Alistair Ritchie (Landcare NZ)

SeaDataNet: Jordi Sorribas, Paolo Diviacco

AQD: Michael Lutz, Ale Sarretta (JRC); Kathi Schleidt (Env. Agency Austria)

WMO: Jeremy Tandy (UK Met Office); Aaron Braeckel (UCAR)

NEII: Andrew Woolf, Dom Lowe (BOM)

ODM2: Jeff Horsburgh

IGSN: Kerstin Lehnert (LDEO), Jens Klump (GFZ)

Vocabulary services: Stuart Williams (Epimorphics), Roy Lowry, Adam Leadbetter (BODC)

LAND AND WATER

Thank youCSIRO Land and WaterSimon CoxResearch Scientist

t +61 3 9252 6342e simon.cox@csiro.auw www.csiro.au/people/simon.cox

Observations to Information

Science