UNCLASSIFIED/FOR OFFICIAL USE ONLY

UNCLASSIFIED / FOR OFFICIAL USE ONLYEuropean Union Satellite Centre © 2016

Big Data pilots for Secure Societies

Sergio AlbaniResponsible for RTDI

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

2

RTDI activities at SatCen

• Research, Technology Development and Innovation

- Fostering cooperation with EC, EU entities and key organisations

in Space such as ESA and GEO

- Implementing new solutions with regard to the whole data lifecycle

on issues related to Big Data and Cloud Computing

EVER-EST

NextGEOSS

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

3

• Integrating Big Data, software &

communities for addressing Europe’s

Societal Challenges

- Health, Food, Energy, Transport, Climate,

Social Sciences, Secure Societies

• BigDataEurope main activities:

- Gathering user requirements

- Developing a Big Data platform

- Implementing relevant pilots

• SatCen is:

- Building a Secure Societies community

- Eliciting Big Data requirements

- Implementing a Space and Security pilot

The BigDataEurope Project

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

4

Stakeholders interviews• Building of a Secure Societies Community with an interest in

the Big Data issue

• Four types of customized questionnaires submitted

- Real use cases, data stories and user needs collected

- Inputs analyzed looking for commonalities amongst users

• 1st Workshop held in Brussels on September 2015 at SOST

• Formalized set of user requirements for the design of the

system and the pilot deployment defined

Collection of User Requirements

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

5

• Data Chain

- To exploit data coming from space (using open data and tools)

- To integrate satellite, geospatial and other data

- To develop automatic tools for the whole data chain management

- Possible applications of Big Data should be mainly related to

access, archiving, analysis, visualization and dissemination

• Platform Characteristics

- Reliable, stable, efficient, time reducing, economically convenient,

open source-based, user-friendly, multi-lingual and interoperable

- Security compliant, geospatial oriented, Platform as a Service

(PaaS), single access, customizable and extensible

User Requirements in Secure Societies

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

6

Dissemination Activities

• Technical Webinars

- To present inputs from experts responsible for the architecture, the

implementation and the upcoming pilots roll-out

• Secure Societies Hangouts

- To give details on the use of Big Data in the Security domain

• Conferences

- 2nd Big Data from Space Conference (15-17 March 2016)

- Living Planet Symposium (9-13 May 2016)

- EO Open Science Conference (12-14 September 2016)

- SatCen Expert User Fora

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

7

The BigDataEurope SC7 Pilot

Remote Sensing Big Data Platform Social Sensing

Change Detection Workflow

Event Detection Workflow

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

8

• European Virtual Environment for

Research – Earth Science Themes

- A VRE is a distributed collaborative system

facilitating access, processing and sharing

of data, algorithms and results

• EVER-EST main activities:

- Establish a VRE for Earth Science

- Validate the VRE with 4 main VRCs

- Implement the use of ROs in ES

• SatCen is:

- Representing the Land Monitoring VRC

- Eliciting requirements for the VRE

- Implementing a Space and Security pilot

The EVER-EST Project

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

9

The EVER-EST LaMo Pilot

Binary Map (changes / no changes)

Classified Map (e.g. land cover)

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

10

• Next Generation GEOSS for

Innovation & Business

- The Group on Earth Observations is

building the Global Earth Observation

System of Systems

• NextGEOSS main activities:

- Engaging EO and related communities

- Advocating GEOSS

- Delivering a DH for EO data exploitation

• SatCen will be:

- Engaging with data providers

- Liaising with GEO communities/activities

- Implementing a Space and Security pilot

The NextGEOSS Project

NextGEOSS

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

11

Big Data General User Scenario

Data Access

Data Selection

Data Processing

Data Visualization

Data Analytics

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

12

Preliminary Results and Conclusions

• Technical solutions for Big Data exploitation

- System to search, download, pre-process and compare images

- Social media and news monitoring by a crawling system

- Web-GIS client to properly visualise information and results

- Solutions to guarantee a better access to open data

- Downloaded images storage in a distributed way

- Scalability improved with tile-based processing approaches

• Big Data and Cloud Computing based solutions can improve

the capabilities of the Space and Security community

- Foster use of open source technologies and of free/open datasets

- Cooperation with ESA, EC and EU entities to be furthered

- Results to be exploited in GEO (e.g. through NextGEOSS)

UNCLASSIFIED / FOR OFFICIAL USE ONLY

European Union Satellite Centre © 2016

UNCLASSIFIED/FOR OFFICIAL USE ONLY

Sergio Albani

Responsible for RTDI

sergio.albani@satcen.europa.eu

Thank You!