Use of WPS for Earth Observation

4th GEOSS Science and Technology Stakeholder Workshop

25 March 2015

Sheraton Norfolk Waterside Hotel

Agenda

• Intro WPS– Basic usage– Chaining

• Use of WPS in the Architecture Implementation Pilot Phase 8– Use of chained WPS for Data Quality Assurance

• (Mike Jackson, Didier G. Leibovici, Sam Meek - COBWEB)• Big Data Analysis

– WPS and HADOOP

Intro WPS

• Principle– Similar to Unix filter

• stdin > processing > stdout• f(x) = y

• WPS is like a “Unix filter” on the Web

Intro WPS

• Behaves like the other OGC Web Services (WMS, WFS, WCS, CSW, …)

Diagram by 52North

GetCapabilities

Diagram by Geo-Solutions.it

DescribeProcess

Diagram by Geo-Solutions.it

Execute

Diagram by Geo-Solutions.it

WPS Chaining

• Remember the Unix filter from slide 3?– Connect stdout to stdin using |

• ls -l | grep ”Mar”• ls -l | grep ”Mar" | sort +4n | more

• WPS’s can also be chained!– So you can run more complex analysis (model)

Using WPS

• Use of WPS in the Architecture Implementation Pilot Phase 8 (AIP-8)– Use of chained WPS for Data Quality Assurance

• (Mike Jackson, Didier G. Leibovici, Sam Meek – COBWEB)

SBA Technical

Organisation He Cl We Dm Ag Wa Bd En Other AuthProces

sing LD CloudWS in

GCISensor Portal App CB & BP

JAXA X X X XConnectingGEO X X X XCloudSigma ? X X X XSDI4Apps X X X XEU BON X X X XFOODIE X X X X XSmartOpenData X X X XGEOSS Water Services X X X X X X X X

Chile X X X X XFSU-Jena X X X X X X XNATO STO-CMRE X X Ocean X X X X XCIESIN X X X X XCOBWEB X X X X X XCNR X X X X X X X XStormCenter X X X X X X X X X X X X XNASA X X X X X XBen Burford X X ? XGMU X X X X X X XINCOSE X ? X XCITI-SENSE X AirQ X X X X X

AIP Participants using WPS

Example

• Use of chained WPS for Data Quality Assurance– (Mike Jackson, Didier G. Leibovici, Sam Meek – COBWEB)

• Context:– VGI – Citizen Science– Citizens Observing in Biospheres

Quality assuring data through atomic tests – 7 Pillars

System Architecture

User interface

Example workflow: Ash Dieback risk inthe Dyfi Biosphere

Reversal

• f(x) = y• We download the Earth (x) to many times a day– Data lives happily in the cloud– Bandwidth and Processing power is infinite in the cloud(s)

(almost, sort of)

• Upload f() to x, and download y!– F() is relatively small and y is expected to be small

• WPS-Transactional!– Upload the f() to the Web Service

Big Data Analysis

• WPS with HADOOP, SPARK, …• http://www.opengeospatial.org/blog/1866

• Further investigated in OGC TestBeds and AIP-8

Thank you!

• Questions?

• bdelathouwer@opengeospatial.org