Post on 14-Jun-2015
description
transcript
Building a Big Data Maturity ModelSamudra Kanankearachchi
NGTC Conference (c)
Next Generation Testing Conference (c)
Big Data Conference India
Next Generation Testing Conference (c)
Hype of Big Data is around Quantity
Next Generation Testing Conference (c)
Semantic Web (POC)
MSc Project Travel Planner
Next Generation Testing Conference (c)
Why Big Data is Not Popular yet in Sri Lanka?
Next Generation Testing Conference (c)
Does Sri Lanka have a real big data business case ?
How big are we in global?
Is Sri Lanka is too Small ?
Next Generation Testing Conference (c)
Is it Enough?
Only focus on Volume , Velocity Variety
Next Generation Testing Conference (c)
Let’s take real life example
Next Generation Testing Conference (c)
Impact of unplanned growth
Next Generation Testing Conference (c)
Infrastructure not mature for sustainable growth
Shared (Water , Food , Land , Energy …)
Popu
latio
n G
row
th
Qua
lity
of L
ife
Lack of Infrastructure for
growth
Next Generation Testing Conference (c)
Moral of the Story
Qualitative Quantity
Next Generation Testing Conference (c)
Why our tourism is a right match ?
Quantity Quality
Next Generation Testing Conference (c)
Many government initiative
Next Generation Testing Conference (c)
State of Software/IT Eco System
Lack of personalization.
Unable to convert information into Action
Lack of Timely information.
Mostly Surrounded with silos
Next Generation Testing Conference (c)
We need a maturity model
Next Generation Testing Conference (c)
Maturity Model
Optimizing
Intelligent/insight
Social Interaction
Semantic Connectivity
Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Level 1
Level 2
Level 3
Level 4
Level 5
Big Data in Silos
If they can’t express
If they can’t Socialize
If not intelligent
If cannot scale and optimize
Next Generation Testing Conference (c)
Maturity Level 1 (Current State)
5. Optimizing
4. Intelligent insight
3. Social Interaction
2. Semantic Connectivity
1. Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Next Generation Testing Conference (c)
Basic system
Next Generation Testing Conference (c)
Business Silos
Bus Providers
Flying /Shipping providers
TravelersHotels
Agencies Entertainment Providers
Next Generation Testing Conference (c)
Enterprise Silos
Cinnamon group
Amaya Group
Chaya Group
Next Generation Testing Conference (c)
Impact of Silos
As a traveler I wanted to find travel information to plan a trip to Sri Lanka
Next Generation Testing Conference (c)
Approach 1
Travel AgencyTraveler
Call
Web System
Impact : [Lot of manual work for integration]
Next Generation Testing Conference (c)
Approach 2
Next Generation Testing Conference (c)
It is a web of documents
Impact : [Lot more manual work to find details]
Next Generation Testing Conference (c)
Maturity Level 2
5. Optimizing
4. Intelligent insight
3. Social
2. Semantic Connectivity
1. Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Next Generation Testing Conference (c)
Web of Things
Hotels
SitesTaxi
Travelers
Night Clubs
Travel Agency
Next Generation Testing Conference (c)
Web of People , Places , Things
Next Generation Testing Conference (c)
Developing semantic graph
Next Generation Testing Conference (c)
Basic Ontology Sample
Next Generation Testing Conference (c)
Querying the Ontology
• Places near by “Hambanthota” ?• Places that are famous for wild life ?
Next Generation Testing Conference (c)
Facebook Graph Search
Next Generation Testing Conference (c)
Places in Kandy
Next Generation Testing Conference (c)
Openness- Standards
Next Generation Testing Conference (c)
Linking Ontologies Together
Linked Ontology/ Linked Data
XYZ Hotel Ontology
ABC Travel Agency
PQR Taxi Service Ontology
Next Generation Testing Conference (c)
Now I can query Complete travel plan
Linked Ontology/ Linked Data
• How to travel ?• Where to Stay ?• Food to eat ?• Options to Enjoy ?
Next Generation Testing Conference (c)
Maturity Level 3
5. Optimizing
4. Intelligent insight
3. Social
2. Semantic Connectivity
1. Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Next Generation Testing Conference (c)
Adding Social Layer
Linked Ontology/ Linked Data
XYZ Hotel Ontology
ABC Travel Agency
PQR Taxi Service
Ontology
Social Layer (Sharing / Ranking /Tagging…)
Identity Collaboration
Next Generation Testing Conference (c)
Example
Next Generation Testing Conference (c)
Maturity Level 4
Optimizing
4. Intelligent insight
3. Social
2. Semantic Connectivity
1. Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Next Generation Testing Conference (c)
Insights
5. Optimizing
4. Intelligent insight
3
2
1. Basic Enterprise (Volume/Variety/Velocity )
What can you offer with out level 2, Level 3 ?
Next Generation Testing Conference (c)
Insight
• Insight what you users wants• Your Ontologies has insight what the system
can offer • Integrating Internet of Things
• Analytics
Next Generation Testing Conference (c)
Maturity Level 5
Optimizing
4. Intelligent insight
3. Social
2. Semantic Connectivity
1. Basic Enterprise (Volume/Variety/Velocity )
Core Infrastructure ( Storage / Compute/ Internets)
Next Generation Testing Conference (c)
Apache Jena (Middleware)
Next Generation Testing Conference (c)
Scaling and Tooling
• https://jena.apache.org/• Microsoft.Net Port– http://www.linkeddatatools.com/downloads/jena-
net
Next Generation Testing Conference (c)
Facebook Open Graph (Alternative)
Next Generation Testing Conference (c)
Future (Apps , IOT, API)
Devices AppsUsers
Management. Access. Protection.
Data
Next Generation Testing Conference (c)
Developing a Market Place
Your Contact
NGTC Conference (c)