Flanders Open Data Day II - KeyNote - Erik Mannens

transcript

ELIS – Mul*media Lab

What if

dr. Erik Mannens @erikmannens

Open Data, Linked Data, and Big Data

We need

together

Open Data

Way of … Thinking

Silos of Data

“Stop Hugging your Data”

e.g. … Open Learning

Open Data Linked

Way of … Publishing

Semantic Web

Connect your Silos

5-stars (Technical Perspective)

Open Linked Data (Tim Berners-Lee)

Make your Stuff available on the Web

Make it available as Structured Data

In a non-proprietary Format

Use URLs to identify Things, so one can point at your Stuff

Link your Data to other People’s Data to provide Context

5-stars (Organisational Perspective)

Open Data Engagement (Tim Davies)

Be Demand-driven

Provide Context

Support Conversation

Build Skills & Capacity

Collaborate with the Community

5-stars (Functional Perspective)

Open Data Portal Functionalities (iMinds)

Dataset Registry

Metadata Provider

Co-creation Platform

Data Publishing Platform

Common Data Hub

Data as Commodity

Sidenote

R&Wbase

15’ Open Data Publishing Framework

e.g. data.gent.be

opendata.antwerpen.be

Publishes 2 to 5 Star Data

tdt/core tdt/input triple store

REST-full API for Developers

triple store

core RESTful data adapter

XML SPARQL endpoint

e.g. datatank.gent.be/Grondgebied/Straten or data.irail.be/NMBS/Stations

R&Wbase

git for triples

Read/Write

LINKED DATA

TRIPLE STORES are they up for the challenge?

Distributed Triple Version Control

Commits

Deltas Virtual graphs

Versions

store describe

identify resolve

LIVE triples require fast version retrieval

LIGHTWEIGHT algorithm

through a

Store triples QUADS <subject> <predicate> <object> <context>

R&Wbase

GRAPH access

TRIPLE STORES

PROVENANCE

VERSION

with direct

provides control for

Data BIG

Way of … Analyzing

How Difficult Can It Be?

Collaborative Effort found Higgs Boson

Banking Industry

Healthcare Industry

Marketing Industry

Smart Cities

Deep understanding of some key Big Data markets

•  US Securities and Exchanges Commission has estimated that it would need to collect 20 terabytes of data per month to monitor all US capital market activity

•  Unstructured data comprises some 80% of the total data held by the average financial institution

•  The total number of non-cash payments in the EU amounted to 90.6 billion in 2011.

•  The total number of automatic teller machines (ATMs) in the EU in 2011 was 0.44 million

•  The number of points of sale (POS) terminals in the EU was 8.8 million in 2011

Big (Data) Bang in Banking

What if it were

OPEN & LINKED

e.g. … OpenSpending

e.g. … OpenBank

e.g. … OpenCorporates

e.g. … OpenCorporates - Belgium

•  Medical images are increasing by 20-40% annually

•  Electronic medical records: in 2009, 99% of primary care physicians in the Netherlands used EMRs, compared to 46% in the United States and 36% in Canada

•  Medical research, in which 100,000 participants are genotyped (ca. 1.5 GB/person), could result in a staggering 150 terabytes of data.

•  As of July 2012 PatientsLikeMe members have shared 4,029,661 symptom reports about 7,338 symptoms and 548,650 treatment histories about 12,838 treatments

Big (Data) Bang in Healthcare

What if it were

OPEN & LINKED

e.g. … PatientsLikeMe

e.g. … 23AndMe

e.g. … PlayStation III

e.g. … OpenPhacts

e.g. … DisQover (iMinds –Ontoforce)

•  Data use is expected to grow by as much as 44 times, amounting to some 35.2ZB (zettabytes -- a billion terabytes) globally

•  Walmart handles more than 1 million customer transactions every hour, which is imported into databases estimated to contain more than 2.5 petabytes of data.

•  Twitter has 200 million tweets per day or approximately 46MB/sec of data created (August 2011)

•  25% of search results for the World’s Top 20 largest brands are links to user-generated content

•  YouTube has 3 billion visitors per day, 48 hours of video is uploaded per minute (May 2011)

•  There are over 200,000,000 blogs: 34% of their posts are opinions about products & brands

Big (Data) Bang in Marketing

What if it were

OPEN & LINKED

e.g. … Consumers in 1990

e.g. … Consumers in 2000

e.g. … Consumers since 2010

The Tyranny of the Empowered ConsYOUmers

e.g. … GoodRelations

e.g. … Nike

•  Data use is expected to grow by as much as 44 times, amounting to some 35.2ZB (zettabytes -- a billion terabytes) globally

•  Sensors, social media feeds, photos, video and cellphone GPS signals account for 2.5 quintillion bytes of data per day

•  More than 50% global population lives in cities and this number is forecast to rise to 69% by 2050

•  The number of city residents is expected to grow from 3.5 billion to 5 billion in the next 20 years

•  ‘Internet of Things’ Age is approaching: 25 billion devices connected to the Internet by 2015 and 50 billion by 2020

•  Access to public data is estimated to be worth €27 billion in the EU •  ICT-enabled energy efficiency could translate into over €600 billion

worth of cost savings for the public and private sector

Big (Data) Bang in Smart Cities

What if it were

OPEN & LINKED

e.g. … OpenTransport

e.g. … OpenEnergyMonitor

e.g. … Big Data … in Iceland?

e.g. … a Trillion Sensors … in Iceland!

QUESTIONS?

dr. Erik Mannens erik.mannens@ugent.be

@erikmannens

Thoughts?

Credits

•  EMC - Greenplum •  Peter Hinssen •  Scott Brinker •  Jim Lecinski •  David Armano •  Did not have time to check all licenses of the Flickr

photos – in my defense, I did not kill anyone nor did I in any way insult and/or infringe the CIA, NSA, NDA, or any other JAA (Just Another Acronym)

Flanders Open Data Day II - KeyNote - Erik Mannens

Technology