Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data...

Post on 22-Jan-2017

358 views 1 download

transcript

                    

BIG DATA EUROPE: PILOTS & APPLICATIONSApache Big Data Europe, Seville, Spain

Different uses of the BDE components

Adaptation of an existing non-parallel algorithm.

Management and preparation of data for an existing infrastructure.

Reimplementation of a parallel version of an algorithm in a Big Data processing system language.

1 mai 2023

SC4: Traffic conditions estimation

1 mai 2023www.big-data-europe.eu

Transport

• Estimation of real-time traffic conditions in Thessaloniki

• Combines:• Traffic modelling from

historical data• Current measurements

from a taxi fleet of 1200 vehicles

SC4 Pilot Architecture

1 mai 2023www.big-data-europe.eu

SC5: Climate modelling

1 mai 2023www.big-data-europe.eu

Climate

• Discovering and re-using previously computed derivatives• Lineage annotation: datasets

and model parameters used to compute derivative datasets

• Finding appropriate past runs avoids repeating weeks-long modelling runs

• Preparing modelling experiments• Slicing, transforming, combining datasets into

new datasets• Submission to and retrieval from modelling

infrastructure

SC5 Pilot Architecture

1 mai 2023www.big-data-europe.eu

SC7: Change detection & verification

1 mai 2023www.big-data-europe.eu

Secure Societie

s

• Automatically detect land cover evolution, caused by physical or human activities, and alert user accordingly. • Events are extracted from text

published by news agencies and on social media.

• Events are geo-located and relevant changes are detected by comparing current and previous satellite images

SC7 Pilot Architecture

1 mai 2023www.big-data-europe.eu