Roberto Cossuroberto.cossu@esa.int

A federated e-Infrastructure for discovery and access of

multi-disciplinary data in the GEO-Hazard community

INFRA-2010-1.2.3 : Virtual Research CommunitiesDuration : May 1, 2010 – April 30, 2012

Total EC funding : 2.15 M€

EC Grant Agreement no. 261623

Digital Earth Communities

10 & 11 June 2013 2European Supersites Coordination Workshop

Outline

• Introduction to Digital Earth:– Needs of the Digital Earth Communities– Related initiatives: GEOSS and ESFRI

• GENESI-DEC: – A multidisciplinary federation for data discovery and

access

• SCIDIP-ES:– Data and knowledge preservation

Digital Earth Communities

10 & 11 June 2013 3European Supersites Coordination Workshop

Introduction to Digital Earth

• Digital Earth is a visionary concept by former US vice president Al Gore in 1998,

– virtual representation of the Earth, spatially referenced & interconnected with digital knowledge archives.

• Beijing Declaration on Digital Earth (Beijing Sept 2009 , 6th Int’l Symposium on Digital Earth)

– "Digital Earth … will be a catalyst in finding solutions to international scientific and societal issues."

– “… should play a strategic and sustainable role in addressing such challenges to human society as natural resource depletion, food and water insecurity, energy shortages, environmental degradation, natural disasters response, population explosion, and, in particular, global climate change."

Digital Earth Communities

10 & 11 June 2013 4European Supersites Coordination Workshop

Digital Earth community’s needs

Digital Earth Communities

10 & 11 June 2013 5European Supersites Coordination Workshop

Digital Earth community’s needs

• Questions and needs– How to “discover” such complex, distributed and very specific

data holdings?– How to access available “data and results” for “user defined

processing”?– How to provide a multi-disciplinary environment for “discovery

and access to data”

• Questions and needs– How to “discover” such complex, distributed and very specific

data holdings?– How to access available “data and results” for “user defined

processing”?– How to provide a multi-disciplinary environment for “discovery

and access to data”

Digital Earth CommunitiesDigital Community: GEO/GEOSS

10 & 11 June 2013 European Supersites Coordination Workshop 6

Needs of exploiting the growing potential of Earth observations to support decision making in an increasingly complex and environmentally

stressed world.

Digital Earth Communities

Digital Community: Environmental ESFRI

10 & 11 June 2013 European Supersites Coordination Workshop 7

Frontier environmental research increasingly depends on a wide range of data and advanced

capabilities to process and analyse them.

Digital Earth Communities

10 & 11 June 2013 8European Supersites Coordination Workshop 8

GENESI-DEC Overview

Earth Science e-infrastructure connecting Digital Repositories and e-Infrastructures spread all over Europe and worldwide allowing:

– Easy and fast access to heterogeneous data (airborne, in situ, satellite) to authorized users (following provider’s policies);

– Effective data and service discovery capabilities through the same interface in a transparent and homogeneous way;

– On demand processing capabilities; – Easy integration of new Digital Repositories

thanks to the standardization and scalability– Accessibility through user applications via the

exposed programming interfaces.– Bridging components for security

interoperability– Services for semantics tools

Ground European Network for Earth Science Interoperations – Digital Earth Communities

Ground European Network for Earth Science Interoperations – Digital Earth Communities

Digital Earth Communities

Satellite, airborne and in-situ products

Interferograms computed from satellite data (either on demand

computation or discovery of previously generated products)

In- Situ data

Satellite data

Semantic enriched search of heterogeneous data based on geo-spatial and temporal criteria defined by the user

GENESI-DEC: the full picture

10 & 11 June 2013 European Supersites Coordination Workshop 9

Atmospheric measures from airborne sensors

Digital Earth Communities

GENESI-DEC: the full picture

Processing services to generate added value products

Example: Earthquake Van, 23 October 2011

Interferograms, crustal deformation

WebProcessingServices, Grid, Cloud computing …

Input: satellite SAR products, auxiliary files, digital elevation

models

10 & 11 June 2013 European Supersites Coordination Workshop 10

Digital Earth Communities

11European Supersites Coordination Workshop10 & 11 June 2013

High level architecture• GENESI-DEC uses a federation of distributed catalogues

• 2-steps discovery:

•One or more Aggregator Nodes contain the metadata at series collection level

•Each federated resources exposes a catalogue containing the metadata at dataset product level

• All the GENESI-DEC catalogues can be accessed using OpenSearch protocol

• User can directly query the Catalogues using OpenSearch or through Clients, as the Generic GENESI-DEC webportal

• Data/products remain at their original location, i.e., where the Data Provider store them; the Catalogues provide the user with the link to directly access the data

• Services can be called by the portal (or other clients) for semantically enriched search, WPS execution, workflow chaining, data tagging

Digital Earth Communities

10 & 11 June 2013 12European Supersites Coordination Workshop

Big success storyImpacts

– GEO-GEOSS• GENESI-DEC technology is contributing to the

enhancement of GEOSS (in the GEOWOW EC project, Kick-off November 2011)

• GENESI-DEC technology is used by the GEO Supersite initiative to serve the needs of the GeoHazards community

– ENVironmental RIs:• ENVRI: Several ESFRI projects have started an EC project

(ENVRI) where GENESI-DEC approach is used for discovering, accessing, and sharing cross-community data

– Satellite community• ESA Grid Processing on Demand operational environment

has adopted OpenSearch standard in its catalogue

• ngEO system, which will become ESA’s new Earth Observation data access “portal”, serving new missions including GMES Sentinels will adopt a catalogue based on OpenSearch/OGC

• CEOS is considering to use OpenSearch interface for CWIC

Digital Earth Communities

1310 & 11 June 2013 13European Supersites Coordination Workshop

Big success storyImpacts

– GEO-GEOSS• GENESI-DEC technology is contributing to the

enhancement of GEOSS (in the GEOWOW EC project, Kick-off November 2011)

• GENESI-DEC technology is used by the GEO Supersite initiative to serve the needs of the GeoHazards community

– ENVironmental RIs:• ENVRI: Several ESFRI projects have started an EC project

(ENVRI) where GENESI-DEC approach is used for discovering, accessing, and sharing cross-community data

– Satellite community• ESA Grid Processing on Demand operational environment

has adopted OpenSearch standard in its catalogue

• ngEO system, which will become ESA’s new Earth Observation data access “portal”, serving new missions including GMES Sentinels will adopt a catalogue based on OpenSearch/OGC

• CEOS is considering to use OpenSearch interface for CWIC

GENESI-DEC in ENVRI will speed up the construction of several European environmental infrastructures enabling frontier environmental

research

GENESI-DEC in GEOSS is enabling stakeholders to discover and access an

increasing number of data yielding a broad range of societal benefits

GENESI-DEC will allow an easier access to satellite data for scientific and operational

purposes.

Beyond the data

• The preservation of data (the “bytes”) is useless without the preservation of the knowledge associated with the data (e.g. the “quality”, the process to generate them)

• We must: Ensure and secure the preservation of archived data and associated

knowledge for an unlimited time span. Ensure, enhance and facilitate archived data accessibility.

File specs. Level 0 Level 1

Processor Algorithm User Manual

Desc. Info

Publications

Project: SCIence Data Infrastructure for Preservation – Earth Science (SCIDIP-ES)

INFRA-2011-1.2.2 Data infrastructures for e-Science

• Project ID: 283401• Project Type: CP-CSA• Start Date: 01.09.2011• Duration: 36 Months• Website: www.scidip-es.eu

• Total Budget: 7,721,082 €• EC Funding: 6,599,992 €• Total funded effort in person/months: 605• Coordinator: European Space Agency• Contact Person: Mirko Albani (ESA)

SCIDIP-ES Objectives

1) To develop and deploy generic and sustainable digital data preservation services and toolkits.

• Validate and use them in the Earth Science domain as a start.

2) To harmonise data preservation policies and approaches, metadata and ontologies in the Earth Science domain:

• Paving the way for the set-up of an harmonized and common approach for the Long Term Preservation of Earth Science Data.

From the user’s perspective

• Ability of the user to discover earth science data using syntactic and semantic features

• Once data has been discovered users have the ability to reach the preservation network/knowledge of the selected data resource

• Chance to link different data sets belonging to different ES domains via Rep Info network - tests to be set in that direction

http://portal.genesi-dec.eu/

http://www.scidip-es.eu/

http://envri.eu/

http://www.geowow.eu/

THANKSroberto.cossu@esa.int