Date post: | 22-Apr-2015 |
Category: |
Technology |
Upload: | spagoworld |
View: | 845 times |
Download: | 0 times |
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
SpagoBI & Big Data:
a smart approach to turn data into knowledge
October 8th, 2013
Monica Franceschini – IT Solution Architect
This presentation has been used during a webinar delivered withinSpagoWorld Webinar Center - http://bit.ly/WebinarCenter
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Smart approach
By smart approach we mean:
● Information building through
● Different data sources connections
● Datasets
● Self service BI
● Agile development of information
● Visualization through
● Dashboards with interactions between documents
● Behavioural model leading documents behaviour
● Ad hoc reporting
● Smart approach = comprehensive approach
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
BYTES STREAM
SEMANTIC
BIG DATASETS
for Big Data
ANALYTICS
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeoAd hoc reporting...
NoSqlHadoopReal timeSelf Service...
DATASET
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
Data Source
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
Data Streaming
Semanticdatabase
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dataset component
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
BehaviouralBehavioural modelmodel
Analytical driver Analytical driver LOV (List of Values)LOV (List of Values)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Big Data storages
Data SourceData Set
Impala
JDBC / JNDI connectionstowards NoSql databases of the Hadoop ecosystem
Dataset follows the Behavioural Modelusing: SpagoBI analytical driversUser attributes
Query ● HBql● CQL● HiveQL● ...
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Real time
Data Streaming
InIn--MemoryMemory
Event Dispatcher
SpagoBIAdapter
● Web Service● Java API● Queue● ...
Event Handlers
Dataset
● SMS● Alerts● Mail● ...
PersistencyPersistency
Visualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Linked data semantic ontologies
Experienced NoSQL graph databases:
OrientDBNeo4J
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Semanticdatabase
ExplorativeExplorative AnalysisAnalysisNetwork Network AnalysisAnalysis asas DRIVERDRIVER
Network AnalysisEngine
MQL,MQL,CypherCypher, , SPARQLSPARQL, , GremlinGremlintraversetraverse
OrientOrient DB, DB, Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data throughsemantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeo
Ad hoc Ad hoc reportingreporting...
NoSqlHadoopReal time
SelfSelf ServiceService...
DATASET
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Agile development
Query
Create charts
Refine the query
Persist
New query
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Self service
Use Free Enquiry Engine to:
DefineDefine youryour ownown queriesqueriesoverover datasetsdatasets
Create Create newnew datasetsdatasets in in a a graphicalgraphical and and smartsmart
wayway
RefineRefine youryour analysisanalysis
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Ad hoc reporting
Use Worksheet
to:
InteractInteract withwith QbEQbE totorefreshrefresh youryour datadata
ProvideProvide anan instantinstantgraphicalgraphical meaningmeaning toto
youryour datasetsdatasetsCreate a Create a prototypeprototype forforyouryour projectproject
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dashboards
Use Cockpits to:
Aggregate Aggregate analysisanalysis totogetget information at a information at a
glanceglance
FilterFilter data data usingusingspecificspecific documentsdocuments
MakeMake differentdifferent kindskinds ofofdocumentsdocuments interactinteract
withwith eacheach otherother
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
What comes nextUnstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more advanced & predictive analysis
NEW VISUALIZATION
Data mining
NEW INFORMATION
BUILDING TECH
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
www.spagobi.org
Contact us