Horizon 2020-LEIT-ICT

Work Programme 2018-2020

Big Data topics

ICT-11

ICT-12

ICT-13

Kimmo Rossi

DG CNECT.G1

Data Policy and Innovation Unit, Luxembourg

Zagreb, 19/01/2018

Relevant policy context

• A Digital Single Market Strategy for Europe COM(2015)192, Third Pillar: launch of a Free Flow of Data Initiative

• Digitisation of European Industry COM(2016)180 – Big Data is an important contributor/element in the DEI

• Big Data Value Public-Private Partnership (BDV PPP)

• Communication: Building a European Data Economy -COM(2017) 9 final, adopted on 10/01/2017

• Data Protection reform (GDPR package)

• EuroHPC Joint undertaking

Disclaimer

The only authoritative source for Horizon 2020 call-related information is the Participant Portal.

In case of discrepancies between this presentation and the Participant Portal, the latter will prevail.

Overview of Big Data topics in H2020 ICT WP2018-20

• ICT-11-2018-2019: HPC and Big Data enabled Large-scale Test-beds and Applications (IA: 50M in 2018 + IA: 40M in 2019) – Technology integration topic!

• ICT-12-2018-2020 Big Data Technologies and Extreme-scale Analytics (RIA: 30M in 2018 + CSA: 1M in 2018 + continuation in 2020, tbc)

• ICT-13-2018-2019: Supporting the emergence of data markets and the data economy (IA: 48M in 2019, RIA: 10Min 2018, CSA: 3M in 2018)

• DT-ICT-11-2019: Big Data solutions for energy (IA: 30M)

In total: 202 MEUR in 2018-2019

ICT-11a (IA): What are we looking for?

• Large-scale HPC-enabled industrial pilot test-beds supporting BD applications and services

• Combining and/or adapting existing relevant technologies (HPC / BD / cloud) to optimize the specific features of processing very large data sets.

• Strong industrial commitment

• Fostering innovation potential and digitisation on in EU key industrial Sectors: e,g healthcare, manufacturing, energy, etc.

ICT-11a: Scope

• Large-scale HPC-enabled industrial pilot test-beds supporting BD applications and services

• Combining and/or adapting existing relevant technologies (HPC / BD / cloud) optimize the specific features of processing very large data sets.

• Massive amounts of diverse types of data

• Clearly demonstrating innovation and value creation.

• Description of the data assets/standards/ interoperability

• Simple secure access and secure service provisioning of highly demanding data use cases for industry, via the cloud

ICT-11b (IA): the challenge

A new generation of 'Lighthouse projects' (IA) taking advantage of integration of data processing technologies:

- Big Data

- Cloud/edge computing

Leveraging on IoT data sources and technologies

Contributing to the build-up of a European data Infrastructure

ICT-11b: what are we looking for?

Large Scale Pilot Actions in data intensive sectors involving key European industrial actors.

Their objective is to demonstrate how industrial sectors will be transformed by putting data technologies (Big Data/Cloud/IoT) at their core.

The industrial pilot test-beds shall also address the relevant networking connectivity and large-scale data collection, management and interoperability issues.

ICT-11b: Characteristics

Possible industrial sectors for Large Scale Pilot actions include (but are not limited to) healthcare, manufacturing, energy, finance & insurance, agri-food, space and security.

Despite the differences it is worth for proposers to take stock of the running 'Lighthouse' projects funded through ICT-15 of the H2020-ICT 2016-2017 Work Programme:

DataBio https://www.databio.eu (2016 Call)

TT https://transformingtransport.eu (2016 Call)

Boost 4.0 (2017 Call)

Bigmedilytics (2017 Call)

ICT-11b: Requirements (1)

The data assets available to the test-beds should be described in the proposal. The data assets shall be appropriately large, complex and realistic.

Pilot test-beds should also aim to provide, via the cloud, simple secure access and secure service provisioning of highly demanding data use cases for companies and especially SMEs.

ICT-11b: Requirements (2)

• A Consortium where industrial partners are represented byprofessionals who work in core business operations (as opposed toresearch laboratories)

• Develop a plan that is consistent with the business strategy of theindustrial partners concerned (e.g. avoid committing to technologiesthat the decision makers in the respective companies have nointention of deploying)

• Innovations developed in the pilot must work in actual operatingconditions and are consistent with important business parameters suchas reliability, accuracy, cost structure.

• To explicitly evaluate/measure changes in the cost structure and in thetechnological constraints and performance (at the end of the pilot)

• Demonstrated increase of innovation and productivity in the main target sector of the Large Scale Pilot Action

• Increase of market share of Big Data technology providers if implemented commercially within the main target sector of the Large Scale Pilot Action

• Effective integration of HPC/BD/Cloud/IoT technologies in the main target sector(s) of the Large Scale Action, resulting into integrated value chains and efficient business processes of the participating organizations

• Widening the use of and facilitating the access to advanced HPC, big data and cloud infrastructures stimulating the emergence of the data economy in Europe

ICT-11 a and b: Impact

• Stimulating additional private and public target investments in HPC and Big Data technologies from industry, Member States and Associated Countries, and other sources, as referred to in the contractual arrangements of the HPC and/or the Big Data Value Public Private Partnerships.

Now explicitly calling for synergies with other innovation programmes and national/regional initiatives for cooperation and co-funding

ICT-11 a and b: Impact

• ICT-11a: Big Data + High-Performance computing

• ICT-11b: Big Data + cloud, IoT, connectivity, edge computing, ...

• DO provide detailed information on the IT/Big Data/Cloud/HPC platform on which the project will run on

• DO explain how the project will credibly reach the impact goals set in the Work Programme (i.e. it is not sufficient to state 'we will reach the impact goals set in the Work Programme)

• DO explain how the private investment of the Consortium partners (additional to the EU funding) is connected to the participation of company X in the project (i.e. generally providing information on company X's investment in R&D does not really address the Work Programme requirement of leveraging the EC investment)

ICT-11: DOs and DON'Ts

The Call for proposals: subtopic ICT-11a

• The Call opened on 31/10/2017 – The call is open!

• The Call will close on 17/04/2018 at 17:00 CET

• Budget: 50 M€

• Proposals expected average size: 12-13 M€

• Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

The Call for proposals: subtopic ICT-11b

• The Call will open on 26/07/2018

• The Call will close on 14/11/2018 at 17:00 CET

• Budget: 40 M€

• Proposals expected average size: 15-18 M€

• Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

ICT-12 Big Data technologies and extreme-scale analytics

Two sub-topics:

a) Research and Innovation Actions

b) One Coordination and Support Action

ICT-12a (RIA): the challenge

Rapidly increasing volumes of diverse data from distributed sources create challenges for extracting valuable knowledge and commercial value from data.

This calls for novel methods, approaches and engineering paradigms in analytics and data management.

Not a new topic, it follows the footprints of ICT-16 of the H2020-ICT 2016-2017 Work Programme.

The state-of-the-art evolves constantly!

ICT-12a (RIA)

Have a look what is already being done in the ICT-16 Project Portfolio

• WP 2014-2015: 10 projects

• WP 2016-2017: 7 projects - to be published soon

https://ec.europa.eu/digital-single-market/en/eu-funded-projects-data

ICT-12a (RIA)

Research and Innovation Actions developing new big data analytics methodologies and engineering solutions addressing industrial and/or societal challenges.

Proposals may cover (but are not limited to): architectures for collecting and managing vast amounts of data; system engineering/tools to contribute to the co-design of secure federated/distributed systems (to involve all stakeholders/technology areas); new methods for extreme-scale analytics, deep analysis, precise predictions and decision making support; novel visualization techniques; standardized interconnection methods for efficient sharing of heterogeneous data pools, seamlessly using distributed tools and services.

R&D work addressing industrial and/or societal requirements.

Testing in real world scenarios (i.e. usability, robustness, performance, privacy aware) on real datasets, by professional/domain experts as opposed to researchers or software developers.

Quantifiable progress beyond the state-of-the-art whatever the technical domain chosen – performance measured against industry validated benchmarks.

Proposals must demonstrate that they have access to appropriately large, complex and realistic data sets. From day 1 of the project!

ICT-12a (RIA): Requirements

Not in a vacuum!

Success will require not only efficient data processing/management but also sufficient computing capacity and connectivity, a coordinated action with all related areas (e.g. analytics, software engineering, HPC, Cloud technologies, IoT) is necessary and will contribute to a European leadership in these areas.

ICT-12a (RIA)

• Increased productivity and quality of system design and software development thanks to better architectures and tools for complex federated/distributed systems handling extremely large volumes and streams of data;

• Demonstrated, significant increase of speed of data throughput and access, as measured against relevant, industry-validated benchmarks;

• Demonstrated adoption of results of the extreme-scale analysis and prediction in decision-making (in industry and/or society)

ICT-12a (RIA): Impact

ICT-12a and Artificial Intelligence

• Connection with ICT-26 'Building a European AI on-demand platform'

• It also builds on (big) data assets

• It builds on technologies also commonly associated to big data technologies: machine learning, deep learning

• It benefits from the scale enabled by big data assets

• It also supports European industry being more competitive

• An opportunity for traditional big data stakeholders.

ICT-12b (CSA)

One CSA to ensure coordination between the different existing activities in HPC/BD/Cloud technologies, including Public-Private Partnerships, digital innovation hubs, and relevant national and regional initiatives, in particular the European Network of National Big Data Centres of Excellence

ICT-12b (CSA): Impact

Effective cooperation of the participating initiatives and platforms as measured by the jointly participating members/users, countries/regions/cities and projects, and the organisation of common events and joint initiatives, resulting in an increased prevalence of data value chains and related technologies (HPC/BD/Cloud/IoT) in the national and regional strategies.

The Call for proposals

ICT-12-2018-2019

• The Call opened on 31/10/2017

• The Call will close on 17/04/2018 at 17:00 CET

• Budget: • ICT-12a (RIA) 30 M€

• ICT-12b (CSA) 1 M€

• Proposals expected average size: 3-6 M€ (RIA)

• Proposals expected average size: 1 M€ (RIA)

• Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

ICT-13

Three different sub-topics:

a) Innovation Actions (2019)

b) Research and Innovation Actions (2018)

c) One Coordination and Support Action

ICT-13 – problem statement

Sharing and re-using of Open Data is well underway

• PSI directive (since 2003)

• European Open Data portal https://www.europeandataportal.eu/

• ODINE Open Data Incubator

But "closed data" (e.g. data from connected vehicles, industrial sensors, client/patient data...) is not re-used because of many obstacles (legal, commercial, attitudes...). Data anonymization is difficult and can often be cracked. No culture of data sharing/trading!

ICT-13a (IA): the challenge

Fostering the European Data Economy by setting up platforms for sharing/trading industrial and/or personal data to create new business opportunities.

ICT-13a (IA): What are we looking for?

Innovation Actions for setting up and operating platforms for secure and controlled sharing of "closed data" (proprietary and/or personal data).

The actions should address the necessary technical, organisational, legal and commercial aspects of data sharing/brokerage/trading, and build on existing computing platforms. Proposals shall address one or both of the following sub-topics:

ICT-13a: two kinds of platforms

• Personal data platforms shall ensure respect of prevailing legislation and allow data subjects and data owners to remain in control of their data and its subsequent use. Solutions should preserve utility for data analysis and allow for the management of privacy / utility trade-offs, metadata privacy, including query privacy. Solutions should also develop privacy metrics that are easy to understand for data subjects and contribute to the economic value of data by allowing privacy-preserving integration of independently developed data sources.

• Industrial data platforms shall enable and facilitate trusted and secure sharing and trading of proprietary/commercial data assets with automated and robust controls on compliance (including automated contracting) of legal rights and fair remuneration of data owners.

ICT-13a (IA)

• Set-up and operations

• Adoption of privacy preserving technologies

• Trusted and secure sharing

• Automated contracting

• Sustainable business models

ICT-13a: additional information

• See a Commission paper on "Personal information management services – Current state of service offers and challenges" analysing feedback from public consultation

• See "Industrial Data Platforms – Key Enablers of Industry Digitization", IDC study report 28/7/2016

ICT-13b (RIA): the challenge

• Provide secure, privacy respecting operations for industrial and personal data platforms.

• Make data providers confident in participating in data sharing mechanism

• Provide citizens privacy safeguards

• Make industrial/personal data platform GDPR compliant

ICT-13b (RIA): the challenge

Not a new topic, it follows the footprints of ICT-18 of the H2020-ICT 2016-2017 Work Programme

ICT-18 Funded Projects:

SPECIAL: data sticky policies and queryable encryption

SODA: multi-party computation (MPC) techniques.

MyHealth-MyData: distributed, peer-to-peer architecture, based on Blockchain.

e-Sides: a CSA researching the ethical and societal implications of data and its use

ICT-13b: What are we looking for?

• Research and Innovation Actions to advance the state of the art in the scalability and computational efficiency of methods for securing desired levels of privacy of personal data and/or confidentiality of commercial data, particularly when they are combined from multiple owners.

• Proposals shall also analyse and address, as appropriate, privacy/confidentiality threat models and/or incentive models for the sharing of data assets.

• Personal data protection is improved, and compliance with the General Data Protection Regulation (and other relevant legislation) is made easier for economic operators

• Citizens' trust is improved as privacy-aware transparency and control features are increasingly streamlined across data platforms and Big Data applications.

• Better value-creation from personal and proprietary/industrial data.

• 20% annual increase in the number of data provider organisations in the personal and industrial data platforms

ICT-13b (RIA): Impact

• 30% annual increase in the number of data user/buyer organisations using industrial data platforms

• 50% annual increase in number of users (data subjects) in the personal data platforms

• 20% annual increase in volume of business (turnover) channelled through the platforms

ICT-13b (RIA): Impact (…continued)

ICT-13b (RIA): Requirements

• Focused to be an enabler of trusted, secure data markets. ICT-13a proposals will build on such technologies.

• Computationally efficient

• Capable of handling very large volumes of data

• Manages composition of independent data sets about the same subjects

• Trade-offs/customization are explained in a way that can be understood by a data subject or a data controller who are not scientists

• Addresses the operational constraints of likely application domains (telecom, geospatial, IoT, …)

ICT-13c (CSA)

• Support the emergence of a data economy by ensuring SME inclusion, entrepreneurial support and trust-building, address the data skills gap. The CSA action shall liaise with and complement related initiatives, and shall support and work in collaboration with the platforms under ICT-13 a).

• In line with the Communication on ICT Standardisation Priorities for the Digital Single Market, promote standardization, interoperability and policy support in the field of data and federated/networked computing systems.

ICT-13c (CSA): Impact

• Demonstrated success stories among clients as a result of the services offered by the CSA and at least 50 clients (e.g. start-ups, SMEs) served annually in partner finding, matchmaking, venture capital raising, training, coaching etc.

• Improved standardisation and interoperability especially in the context of cross-sector applications and technology convergence (data, Cloud, IoT, connectivity a.o.)

The Call for proposalsICT-13 a)

• The Call will open on 16/10/2018

• The Call will close on 28/03/2019 at 17:00 CET

• Budget: 48 M€

• Proposals expected average size: 4-6 M€

ICT-13 b) and c)

• The Call opened on 31/10/2017

• The Call will close on 17/04/2018 at 17:00 CET

• Budget:

• ICT-13b (RIA) 10 M€

• ICT-13c (CSA) 3 M€

Article 30.3 (Commission right to object to transfers or licensing) will be added to all Grant Agreements

Big Data Solutions for Energy DT-ICT-11-2019

The Challenge

• Tomorrow's energy grids consist of heterogeneous interconnected systems, of an increasing number of small-scale and of dispersed energy generation and consumption devices, generating huge amounts of data. The electricity sector, in particular, needs big data tools and architectures for optimized energy system management under these demanding conditions.

Big Data Solutions for Energy DT-ICT-11-2019

The Work Programme

• Innovation Actions targeting large-scale pilot test-beds for big data application in the electricity sector. The aim is to develop/pilot and deploya reference architecture for large-scale multi-party data exchange, management & governance and real-time processing (including distributed/edge processing) in the electricity sector and to translate this reference architecture into an open, modular data analytics toolbox for the safe and effective operation of grids and provision of innovative energy services.

Big Data Solutions for Energy DT-ICT-11-2019

The Work Programme (…continues)

• The reference architecture should ensure compatibility with legacy formats, interfaces and operating systems of the energy system, allow replication and scale-up, be compliant with applicable EU standards, and should enable the integration of relevant digital technologies like IoT, AI, cloud and big data services.

• The analytics toolbox shall be able to handle a wide variety of data and support the development of a wide range of energy services, at least to increase the efficiency and reliability of the operation of the electricity network (e.g. by predictive maintenance), to optimize the management of assets connected to the grid (in particular small-scale/renewable electricity generation and those used for demand response), to increase the efficiency and comfort of buildings, and to de-risk investments in energy efficiency (e.g. by reliably predicting and monitoring energy savings).

Big Data Solutions for Energy DT-ICT-11-2019

The Work Programme (…continues)

• Proposers should demonstrate that they have access to appropriate large-scale and realistic datasets, and should involve as many as necessary of the following types of participants: network operators, suppliers, independent aggregators, ESCO's, power exchanges, building management and renovation sectors, software integrators/developers. Proposals should address, as appropriate, analytics, simulation, prediction, cloud computing. Projects shall collaborate with EU-funded projects through the BRIDGE initiative.

Big Data Solutions for Energy DT-ICT-11-2019

Impact• Effective integration of relevant digital technologies in the energy sector,

resulting in integrated value chains and efficient business processes of the participating organizations;

• Enhancing energy asset management, increasing consumer participation and innovative network management, creating new data-driven business models and opportunities and innovative energy services;

• Contribution to increasing the use of renewable energy and increased energy efficiency based on optimised energy asset management, offering access to cheaper and sustainable energy for energy consumers and maximising social welfare;

• New data-driven paradigms for energy management systems able to deal with increased complexity of the energy systems;

• Improving availability of big data and big data management & analysis facilities for real-life scale research, simulation and test purposes.

Big Data Solutions for Energy DT-ICT-11-2019

Requirements• A Consortium where industrial partners are represented by

professionals who work in core business operations (as opposed toresearch laboratories)

• Develop a plan that is consistent with the business strategy of the industrialpartners concerned (e.g. avoid committing to technologies that thedecision makers in the respective companies have no intention ofdeploying)

• Innovations developed in the pilot must work in actual operatingconditions and are consistent with important business parameters such asreliability, accuracy, cost structure.

• To explicitly evaluate/measure changes in the cost structure and in thetechnological constraints and performance (at the end of the pilot)

Big Data Solutions for Energy DT-ICT-11-2019

Requirements (…continues)

• To account of the ownership, user right, cost structure of the data assets to be used and/or produced during the pilot, and at the end of the pilot.

• Privacy General Data Protection Regulation (GDPR)

Big Data Solutions for Energy DT-ICT-11-2019

DT-ICT-11-2019

• The Call opens on 16/10/2018

• The Call closes on 02/04/2019

• Budget available: 30 M€

• Expected project size: 10 M€

• Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

Additional information

Big Data Value Association (BDVA) updated Strategic Research and Innovation Agenda, version 4

http://www.bdva.eu

Questions: CNECT-G1@ec.europa.eu

Kimmo.Rossi@ec.europa.eu