Copernicus Big Data Workshop 13-14 March 2014

Copernicus Space Component

Ground Segment and Data Access

P. Bargellini

Ground Segment and Mission Operations Department,

Earth Observation Programmes Directorate,

European Space Agency

Copernicus Big Data Workshop 13-14 March 2014

2

Space Component

In-Situ Component

Services Component

Copernicus (formerly known as GMES) is a European space flagship programme led by the European Union Provides the necessary data for operational monitoring of the environment and for civil security ESA coordinates the space component

The Copernicus Programme

Copernicus Big Data Workshop 13-14 March 2014

S1: Radar Mission

S2: High Resolution Optical Mission

S3: Medium Resolution Imaging and Altimetry Mission

S4: Geostationary Atmospheric Chemistry Mission

S5P: Low Earth Orbit Atmospheric Chemistry Precursor Mission

S5: Low Earth Orbit Atmospheric Chemistry Mission

S6 (Jason-CS): Altimetry Mission 3

Copernicus Space Component: Dedicated Missions

Copernicus Big Data Workshop 13-14 March 2014

Copernicus Contributing

Missions

Atmospheric missions

PROBA-V

SPOT (VGT)

MetOp Meteosat 2nd Generation

Cryosat

Jason

DMC

Deimos-2

Pléiades

RapidEye

SPOT (HRS)

COSMO-Skymed

Radarsat

TerraSAR–X

Tandem-X

Copernicus Contributing Missions

Copernicus Big Data Workshop 13-14 March 2014

Main objectives of the Sentinels operations strategy:

• Reliable provision of data to Copernicus users

• Ensure systematic and routine operational activities

Sentinels operations approach:

• Sentinels are operated via a pre-defined background observation and downlink

plan

• Scenario is updated on a regular basis (e.g. 6-months) taking into account user

requirements evolution

• All Sentinels acquired data is systematically downlinked and processed to

generate a predefined list of core products within specific timeliness

Sentinels Operations Strategy

Copernicus Big Data Workshop 13-14 March 2014

• Several Copernicus Core and Downstream services, and additional EU Agencies applications are today in ‘Pre-Operations’

• The GMES Space Component Data Access (GSCDA) System provides since 2008 comprehensive and coordinated access to EO data products from multiple satellites to Copernicus space data users across Europe

• The GSCDA manages the coordinated production of Data Sets: multi-mission coherent data collections pre-defined according to specific user needs in terms of data type and mode of operation

• The key component of the GSCDA is the Coordinated Data Access System (CDS), ensuring Data Set construction and dissemination by coordinating the CCMs production and dissemination flows

Copernicus Pre-Operations: Data Access Status

Copernicus Big Data Workshop 13-14 March 2014

Data Flows from CCMs to Copernicus Users

Copernicus Big Data Workshop 13-14 March 2014

Operating today

Copernicus Ground Segment Architecture

Copernicus Big Data Workshop 13-14 March 2014

Ground Segment Layout

Maspalomas X-Band station & NRT Centre

Matera X-Band station & NRT Centre

Svalbard X-Band station & NRT Centre

4th Polar X-Band Station

ESRIN PDMC

Madrid POD

X-Band Stations & Near Real Time Processing Centre (CGS)

Payload Data Management Centre (PDMC)

Precise Orbit Determination Service (POD)

Fight Operations Segment (FOS)

ESOC-EUM FOS

Ka-band User Ground Stations (part of EDRS Service)

Copernicus Big Data Workshop 13-14 March 2014

Ground Segment Layout

Archive and Offline Processing Centre Mission Performance Centre (MC)

CDB

CDB

CDB

CDB

CDB

Infoterra UK Farnborough

Indra

Madrid

CLS

Toulouse

Eumetsat

Darmstadt

DLR Oberpfaffenhofe

n

ACRI Nice

CDB

CLS

Brest

CDB

Copernicus Big Data Workshop 13-14 March 2014

Ground Circulation and Dissemination Network

Circulation

Network

Dissemination

Network “Internet”

Other services

Mirror Sites,

CDN, Cloud

Network Infrastructure highly scalable (10 Gbps)

Centralised data pick-up point

Users

CDB

CDB

Firewall &

CPE

Tailored access for

specific use typolgy

e.g. Core Service or

CollGS

Copernicus Big Data Workshop 13-14 March 2014

Sentinels Data Access

Overview

Copernicus Big Data Workshop 13-14 March 2014

Copernicus Data Policy

Users shall have free, full and open access to Copernicus

dedicated Sentinel data and Copernicus service information

The CSC Ground Segment architecture implements this

policy, and includes an evolutionary approach to further

enhance the data exploitation by the broad user community

13

The CSC Ground Segment features dedicated data access

infrastructure solutions, tailored to the needs of the various

user typologies

Copernicus Big Data Workshop 13-14 March 2014

Data Access – A major undertaking

A major European Earth Observation Ground Segment design challenge

Systematic processing and availability of the complete acquired data corresponding to a sustained generation rate (24h/7d) of a continuous stream

of

500Mb/s of user products (Sentinel-1,-2,-3 A series) Distributed interconnected network of centres (improved redundancy)

Local centre access capacity built on top of a powerful and scalable network

Including Big Data paradigm and use of innovative solutions

Progressive inclusion of Research Support & Hosted Processing services

Enhanced connectivity to int’l scientific community network (e.g. GEANT)

Federation of distributed data pick-up points to optimise proximity to end users

14

Copernicus Big Data Workshop 13-14 March 2014

Use Typologies

Copernicus Services

International

Agreements

ESA/EU Member States needs

(Collaborative GS)

ESA funded R&D projects

Public

Value Adding

use

Copernicus Core & Downstream Services

Other EU needs assimilated to

Copernicus services

e.g. EMSA, EEA, EUSC, JRC

Science use Commercial

Value Adding

use

Scientific

/Other use

15

MSs

CollGS

Int’l

Agreements

Copernicus Big Data Workshop 13-14 March 2014

CSC Ground Segment Data Access Tailored infrastructures adapted to different user typologies

MSs Collaborative

Access

Copernicus Services Access

CSC

GS

Dat

a A

cces

s

Scientific / Other Access

International Agreements

Access

16

ESA funded R&D projects

Scientific/ Other users

Copernicus Services

MSs CollGS Users e.g. public, scientific,

commercial International

users

Operated by MSs

National Mirrors (Inc local station) National Mirrors

(Inc local station) National Mirrors

International Mirrors

International Mirrors

(Inc local station)

Operated by int. partners

Int’l Mirrors

Copernicus Big Data Workshop 13-14 March 2014

Common User Service Charter

17 19/03/2013

The CSC Ground Segment provides a set of main services to all users,

independently from the access infrastructure

User REGISTRATION and MANAGEMENT

Management of user accounts

DISCOVERY Service Dataset and product search + visibility of planned acquisitions

VIEW Service Visualization of browse image

DOWNLOAD Services

Interactive Download via web browser or the Download Manager. Systematic background download based on defined filters

EMERGENCY Service Opening of an emergency “dossier” upon user call and management of data collection (tasking, selection from archive). Restricted to eligible users

DATASET GENERATION Service

Generation of geographical/temporal data collections according to pre-defined interest/application

HELP DESK Service Support and communications to users including dedicated Web Portal. Management of inquiries, feedback, and suggestions.

RSS and HOSTED PROCESSING Service

Research Support Service and Hosted Processing Service operations

Copernicus Big Data Workshop 13-14 March 2014

• The CSC GS data access infrastructure and user service charter is available to support the Sentinel-1A initial operations

• This first pre-operational configuration will be the basis for monitoring and consolidating the user scenario

• Yearly upgrades of the infrastructure and users Service Charter are foreseen to progressively integrate new Sentinels and quickly adapt to evolving user needs

• A set of mid/long term enhancements have already been identified to anticipate some of these needs

• Strong synergies with ESA R&D activities related to Big data and GS evolution

• Close coordination with European Commission is necessary to ensure needs of Copernicus Core Services and H2020 space and non-space related projects are feedback into the CSC GS evolution

Conclusions

18

Copernicus Big Data Workshop 13-14 March 2014

Further Information

• Copernicus Programme Website http://copernicus.eu • Copernicus Space Component Website http://esa.int/Our_Activities/Observing_the_Earth/Copernicus