WPS Application Patternsat the Workshop “Models For Scientific Exploitation Of EO Data”

ESRIN, October 2012

Albert Remke & Daniel Nüst52°North Initiative for Geospatial Open Source Software GmbH

d.nuest@52north.org

BIG DATA

theoretical investigation

laboratoryexperiment

S C I E N C E

simulation/computation

What is processing?

Output DataProcess

Input Data

control

Definition

What is web-based Processing?

Output DataProcess

Input Data

control

SOA

Definition

ProcessingEnvironment

Backend

Output DataSources

Input DataSources

Store / LoadExchange

ProcessProcess

ProcessProcess

control

What is web-based Processing?

Application Patterns

Sharing Knowledge

Sharing Processes

----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Web Processing Services

Application

Output Data

Web Processing

Service

Input Data

Data Service

Data Service

control

Organisation

Web Processing Services

Application

Output Data

Web Processing

Service

Input Data

Data Service

Data Service

control

OrganisationOrganisation

Organisation

PraaS

Web Processing Services

Application

Output Data

Web Processing

Service

Input Data

Data Service

Data Service

control

OrganisationOrganisation

Organisation

PraaS

Integration

Lazyness

Comparison

Efficiency

Sharing

Reusability

Independence

Deployment Use Cases

Processeslocal remote

remote

local

SpatialData

Everything‘s local

Process external data sources in your local

environment.

B)

Process your local data in an

external environment

Process external data sources in an

external environment

A) C)

D)

Moving Code

Process*

Environment A Environment B

* functional description, platform description, hardware description/infrastructure, explotation rights/licenses/terms of use, …

Moving Code Packages

StreamingData Processing

Environment

Process

t

Data

Data

Data

Data

Data

Data

Data

Data

Output

Output

Output

Output

Output

Foerster, Schäffer, G.Carillo

Control Layer

ProcessingEnvironment

Data(local, large)

Outputcontrol

C Scripts controlled by Python Control Layer

Local/Monolithic/LegacySoftware

ScriptScriptScriptScript

client

HTTPStandardized

Enabling Generic Views

ProcessingEnvironment

Online DataSources

Process

Web based control (mobile)

Output Document

Real-time DataSources

ProcessProcess

Wrapping Script Language

WPS4R

CommunitiesCompany

Long Term License Management

Code Repositoriesis a dissemination platform

is a service center

52°North does applied research and …is a collaboration network

http://52north.org/about/partners/

GENESISOSIRIS

UncertWebINTAMAP

DETECTGeoViQua

OWSSME

CommunitiesCollaboration

http://52north.org/about/partners/

IlwisGeoprocessingEarth Observation

Geostatistics3DMetadata Management

SecuritySemanticsSensor Web

standard

implementation

clientserver

http://xkcd.com/927/

Challenges

Exchangeability and Interoperability of Processes

Granularity

Lingua Franca for Processes across Domains?

Security

Reusability | Scalability | Performance

Documentation and Discovery

Collaboration

Coordination

Concentration

One more thing…http://geoviqua.geolabel.questionpro.com

Deadline:20th of October 2012

Talk to me about …Data Quality (Modelling, Visualisation, Review)Open DataCitizen ScienceSensor Web

Questions?

http://geoviqua.geolabel.questionpro.com

WPS4R

http://52north.org/wps4r

Expose arbitrary R scripts via WPS

Variety of input and output formats– Under development!– Vector, Raster, …

Current Use Cases: Reproducibility, Clients/Usability, Publishing

Demo

Plot Example

Report Generation - Example

ArcGIS Client

INTAMAP

• INTeroperability and Automated MAPping• “backend” R package

– http://www.intamap.org/intamap-package.php • WPS Server• O&M Input• Clients

– JAVA API– Stand-alone: http://www.intamap.org/tryGenericClient.php