SpagoBI Webinar @ OW2

transcript

Open Source Business Intelligence

SpagoBI: a definition

SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy

What SpagoBI is ?

Platform:

It covers and satisfies all the BI requirements: KPIs, Reporting, OLAP, Dashboard and charts, Data Mining, Free Inquiring (QbE), Dossier, Geo-referenced analysis, Collaboration

Data Management, Profiling and security

Administrator support (versioning, scheduling, approval iter, import/export, etc)

SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy (Free and Open Source Software)

What SpagoBI is ?

Integration platform: Not a product platform, with a predefined set of tools Open to many products for the same/different analytical area, both open

source and proprietary It allows the composition of one’s own platform time for time in the best

way No binding dependences from products and tools Open standards adoption It allows to give the right answers to analytical questions by means of

different products

What SpagoBI is ?

Enterprise platform

Distributed architecture (scalability)

Adaptive behaviour of the documents based on the end users’ roles

Entirely Open Source

It is not the lite OS version of an enterprise commercial version

BI platform: Report OLAP Dashboard KPIs Charts Data Mining GEO-referenced analysis Free Inquiry (QbE) Collaboration ETL

Enterprise level Integration platform (not a closed product)

Multi engine (also mixing OS and proprietary)

Scalability

Security and visibility

What SpagoBI is ?

SpagoBI architecture

SpagoBI 2.1Architecture

Integration Platform

Analytical Model

Analytical Engines

agemen

t Tools

SpagoBI – Analytical Model

It is the layer that mediates all interactions between the core of the platform (i.e. behavioural model and service components) and external analytical engines

It works as a meta model describing all analytical areas in an abstract way (i.e. implementation independent)

It allows to de-couple users analytical questions from the actual tools used to answer to them

It is a cornerstone in the implementation of the integrability strategy adopted by the platform (integration platform vs. product) platform)

SpagoBI – Analytical Model in action

SpagoBI – Behavioural Model

It represents the allowed end-user’s behaviour according to his/her business responsabilities

It enhances the prominent analytical concepts and describes how they are showed and checked according to the end-user roles

It provides a unique representation of every analytical concept

SpagoBI – Behavioural Model

The behavioural model (BM) represents the allowed end-user’s behaviour in relation to his/her business responsibilities

It’s up to the BM to manage who, when, where and how constraints are related to an actionable functionality provided by the platform

actions

SpagoBI – Behavioural Model in action

SpagoBI – Management Tools

A set of back-end services that can be used to support all the other platform components and functionalities. Scheduler

Alarms & Notifications

Distribution lists

Subscriptions

Monitoring & Auditing

Collaboration module

SpagoBI – Analytical Engines

They are the components that actually execute analysis

At least one analytical engine exists for each analytical area (ex. report, olap, datamining, ecc…)

For each analytical area more than one engine type can exist (ex. Jasper, BIRT and BO for reporting)

One engine type can have multiple instances to guarantee scalability and reliability

SpagoBI logical architecture

The main components of SpagoBI

SpagoBI Metadata

SpagoBI Core

Authorization System

Authentication System

ecurity AP

SpagoBI Engine

Security connectors

Folders

From SpagoBI 1.9.x to SpagoBI 2.x

All the SpagoBI components are now into the SpagoBI Server

SpagoBI SERVERSpagoBI Studio

SpagoBI Meta

SpagoBI Applications

But in the new 2.x Release, some other main modules are coming …

SpagoBI 2.x – Main Modules

5 ModulesServerStudioMetaSDKApplications

6 NEW Engines GEO engine New QbE (multi-schema) Interactive dashboard (Composed Document) KPI modeller and navigator JPalo for OLAP Chart engine

Architectural review WebApplication and JSR 168 SSO with CAS SOA SSL Security assessment (OWASP Compliant)

General Features Subscriptions Personal folders Rich client Data sources configuration Alert and Notification Save Import/export settings ….

SpagoBI Server (the already known platform, with many

news) :

SpagoBI 2.x – Main Modules

5 ModulesServerStudioMetaApplicationsSDK

SpagoBI Studio : the integrated environment, to develop, test

and deploy documents into one or more SpagoBI Server

SpagoBI Meta : Business and technical metadata

SpagoBI SDK, to use SpagoBI from external application:

- Tag Lib- Integration API- Web Services

SpagoBI Applications: - BAM- Audit & Monitoring- ….

SpagoBI technological architecture

Technological architectureSpagoBI can be deployed in:

Tomcat 6.x

Jboss 4.x

WebSphere 6.x

SpagoBI can be installed as a simple WebApplicationSpagoBI can be installed in a Portal environment:

eXo Platform 2.x

Liferay 5.1

WebSphere Portal

Open StandardsJSR 168, JSR 170, JDBC, JDK, Hibernate

SpagoBI for the end-user

SpagoBI 2.1End-user functionalities

SpagoBI 2.1 - Reporting

Template File

Parameters

Report Engine

A typical reporting system

SpagoBI 2.1 - Reporting

SpagoBI 2.1 – Reporting and behavioural model

SpagoBI 2.1 - OLAP

A typical OLAP system

Olap C

ICom. Protocol

Olap S

Data Storage

MONDRIANJPIVOT

SpagoBI 2.1 – OLAP functionalities

SpagoBI 2.1 - GEO

SpagoBI 2.1 – GEO Analysis

GEO Analysis is ...

... a visual representation of some spatial data (typically a geographic map) whose elements, usually called geographical features, are enriched with some graphical information (typically colours) based on the value of some KPI related to the spatial element.

GEO spatial data: basic concepts

- features

- attributes

- layers

- maps

Geographic features are ...

... geometric entities like points, lines and polygons that can have a graphical representation. Geographical features are usually related to some existing entity in the real world like, for example, cities, streets and regions.

point line

polygon

Geographic attributes are ...

... properties related to some geographical features like for example id, name, population, length, ecc ...

POINT( Id: MI Name:Milan State: Italy Region:Lombardia Area: 182 km2 )

LINE( Id: H101 Name:101 Length: 500 km Type: Freeway )

POLYGON( Id: IT Name:Italy Population 51M Capital: Rome )

Layers are ...

... group of features, usually of the same geometric type and usually related to the same kind of real world entities.

Italy Regions' layer: groups together all the polygonal type features related to regions of Italy

Maps are ...

... a portrayal of geographic information as a digital image file suitable for display on a computer screen.

A map is not the data itself.

… usually built as a composition of different geographical layers

SpagoBI 2.1 – GEO Engine goal

GEO Analysis GOAL is ...

... build a bridge between geo-spatial data and datawarehouse informations

GEO spatial data: out of scope

- Web Map Server: a system capable of producing maps from geographic information

- Web Feature Service: a service whose interface allows to request for geographical features

- Geographical Information System: a system for capturing, storing, analyzing and managing data and associated attributes

GEO Dimension

- is part of the data warehouse

- is the link between the business data and the geo data

- is structured into one or more hierarchies

SpagoBI 2.1 – GEO in action

SpagoBI 2.1 – Charts

SpagoBI 2.1 – Bar charts

SpagoBI 2.1 – Dial charts

SpagoBI 2.1 – Pie charts

SpagoBI 2.1 – Box charts

SpagoBI 2.1 – Charts in action

SpagoBI 2.1 – Dashboards

SpagoBI 2.1 – Dashboards: Rotate

SpagoBI 2.1 – Dashboards: Live Line

SpagoBI 2.1 – Dashboards in action

SpagoBI 2.1 – Composite Document

SpagoBI 2.1 – Composite document

The composite document is a new SpagoBI engine which creates and displays on a single page more SpagoBI documents of any type (maps, reports, charts,…).

It can be considered as a new type of instrument panel with the difference that the documents are dynamic and so the users can navigate the displayed information.

SpagoBI 2.1 – Composite document in action

The user clicks on Washington state and then each other document is reloaded taking the new parameter as input:

The same, if the user click on the table, the charts in the lower part will be refreshed according to the new parameter :

Also the last single chart can update other documents, in this case updates the last chart on the right:

Note that all documents within the composite document share the same parameters and you can configure it so that everyone can start the update of the other, updating the value of a shared parameter

SpagoBI 2.1 – KPI

SpagoBI 2.1 – KPI for the final user

SpagoBI 2.1 – KPI instance details

Semaphore

Model instance CODE – Model Instance Name

Bullet Chart with Thresholds,value and Target

KPI value

KPI Measure Unit

KPI WeightKPI under Alarm control

KPI linked to another SpagoBI Document

SpagoBI 2.1 – The steps to create a KPI

KPI Definition Steps:Define a ModelDefine a Data Set for each KPIDefine ThresholdsDefine KPIsDefine a Model InstanceCreate a KPI Document

SpagoBI 2.1 – A KPI Model

SpagoBI 2.1 – A KPI Data Set

SpagoBI 2.1 – A KPI Treshold

SpagoBI 2.1 – Cross Navigation

The cross navigation is a mechanism that allows to execute a target document by clicking on an element of a source document, preserving the context of the starting document itself and passing as parameters the relevant data.

The target document can be in turn a source document, i.e. you can click on one of its elements and reach a third document, and so on.

A breadcrumb keeps track of the sequence of opened documents; the user can return to a previously opened document by clicking on an element of the breadcrumb itself.

SpagoBI 2.1 – Cross Navigation in Reporting

SpagoBI 2.1 – Cross Navigation in GEO

SpagoBI 2.1 – Query by Example

SpagoBI 2.1 – QbE in action

SpagoBI 2.1 – Analyitical Dossier

SpagoBI 2.1 – Analytical Dossier

SpagoBI 2.1 – Data Mining

Data mining is ...

... the nontrivial extraction process of implicit, previously unknown, and potentially useful knowledge from massive amount of data

SpagoBI has a data mining engine based on WEKA library called SpagoBIWekaEngine

With SpagoBIWekaEngine it is possible to execute mining processes defined visually using WEKA's KnowledgeFlow Designer

The output quality of a mining process can be than further investigate using others SpagoBI's analytical engines such as reporting engines

SpagoBI have one data mining engine based on WEKA library called SpagoBIWekaEngine

The output quality of a mining process can be than further investigate using others SpagoBI's analytical engines such as reporting engines

SpagoBI have one data mining engine based on WEKA library called SpagoBIWekaEngine

The output quality of a mining process can be than further investigated using other SpagoBI's analytical engines such as reporting engines

SpagoBI 2.1 – ETL

ETL is ...... is a process in data warehousing that involves

1. extracting data from outside sources;

2. transforming it to fit business needs;

3. loading it into the data warehouse.

ETL is important, as it is the way data actually gets loaded into the warehouse.

SpagoBI 2.1 – ETL

SpagoBI has an ETL engine based on Talend called SpagoBITalendEngine

With SpagoBITalendEngine it is possible to execute ETL processes defined visually using Talend Open Studio (TOS)

Each ETL process registered into the platform can be scheduled using the SpagoBI's Scheduler Portlet and then its execution can be minitoreted using SpagoBI's EventMonitor Portlet

SpagoBI 2.1 – ETL

SpagoBI have one ETL engine based on Talend called SpagoBITalendEngine

SpagoBI 2.1 – ETL

SpagoBI have one ETL engine based on Talend called SpagoBITalendEngine

SpagoBI for the end-user

SpagoBI 2.1Administrator functionalities

SpagoBI for the admin: managing resources

SpagoBI for the admin: managing engines

SpagoBI for the admin: managing data sources

SpagoBI for the admin: managing functionalities

SpagoBI for the admin: managing documents

SpagoBI for the admin: managing List of Values

SpagoBI for the admin: managing analytical drivers

SpagoBI for the admin: managing menus

References

SpagoBI Web Site

http://spagobi.eng.it

SpagoBI Online Demo

http://spagobi.eng.it/SpagoBI

SpagoBI Donwload Forge

http://forge.ow2.org/project/showfiles.php?group_id=204

SpagoBI Forum

http://forge.ow2.org/forum/?group_id=204

SpagoBI Webinar @ OW2

Technology