Open Source

Business Intelligence

Who am I

Stefano Scamuzzo

Senior Technical Manager

Architecture & Consulting

Research & Innovation Division

Engineering Ingegneria Informatica

The SpagoBI Core Team

Grazia Cazzin – Project Leader

Chiara Chiarelli

Davide Zerbetto

Antonella Giachino

Stefano Modroni

Angelo Bernabei Andrea Gioia

Giulio Gavardi

Who is Engineering

!! Leader Company

"! More than 40 premises

"! More than employees

"! More than 800 Customers

"! More than 400 Consultants

!! Activity Domain

"! System Integration

"! Technologies and Products

"! Consultance

"! Services and Software development

"! Training

!! Market segments

"! Banking and Insurances

"! Industry, Telecom et Services

"! Public administration (central and local)

"! Healthcare

"! Utilities

"! Research and Innovation

SpagoBI: a definition

SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy

What SpagoBI is ?

!! Platform:

"!It covers and satisfies all the BI requirements: KPIs, Reporting, OLAP, Dashboard and charts, Data Mining, Free Inquiring (QbE), Dossier, Geo-referenced analysis, Collaboration

"!Data Management, Profiling and security

"!

Administrator support (versioning, scheduling, approval iter, import/export, etc)!

SpagoBI is an integration platform for enterprise BI solutions,

entirely developed in FOSS philosophy (Free and Open Source Software) !

What SpagoBI is ?

!! Integration platform:

"!Not a product platform, with a predefined set of tools

"!Open to many products for the same/different analytical area, both open source and proprietary

"! It allows the composition of one’s own platform time for time in the best way

"!No binding dependences from products and tools

"!Open standards adoption

"! It allows to give the right answers to analytical questions by means of different products

SpagoBI is an integration platform for enterprise BI solutions,

entirely developed in FOSS philosophy (Free and Open Source Software) !

What SpagoBI is ?

!! Enterprise platform

"!Distributed architecture (scalability) !

"!

Adaptive behaviour of the documents based on the end users’ roles

!! Entirely Open Source

"!It is not the lite OS version of an enterprise commercial version

SpagoBI is an integration platform for enterprise BI solutions,

entirely developed in FOSS philosophy (Free and Open Source Software) !

!! BI platform:

"!Report

"!OLAP

"!Dashboard

"! KPIs

"!Charts

"!Data Mining

"!GEO-referenced analysis

"! Free Inquiry (QbE)

"!Collaboration

"! ETL

!! Enterprise level

"! Integration platform (not a closed product) !

"!Multi engine (also mixing OS and proprietary) !

"! Scalability

"! Security and visibility

What SpagoBI is ?

SpagoBI architecture

SpagoBI 2.1

Architecture

Integration Platform

Analytical Model

Analytical Engines

Man

agem

ent T

ools

SpagoBI – Analytical Model

!! It is the layer that mediates all interactions between the core of the platform (i.e. behavioural model and service components) and external analytical engines

!! It works as a meta model describing all analytical

areas in an abstract way (i.e. implementation independent) !

!! It allows to de-couple users analytical

questions from the actual tools used to answer to them

!!It is a cornerstone in the implementation of the integrability strategy adopted by the

platform (integration platform vs. product) platform) !

SpagoBI – Analytical Model in action

SpagoBI – Behavioural Model

!!It represents the allowed end-user’s behaviour according to his/her business responsabilities

!!It enhances the prominent analytical

concepts and describes how they are showed and checked according to the end-user roles

!!It provides a unique representation of

every analytical concept

SpagoBI – Behavioural Model

!!The behavioural model (BM) represents the allowed end-user’s behaviour in relation to his/her business responsibilities

!!It’s up to the BM to manage

who, when, where and how constraints are related to an actionable functionality provided by the platform

actions

users

BM

SpagoBI – Behavioural Model in action

SpagoBI – Behavioural Model in action

SpagoBI – Behavioural Model in action

SpagoBI – Management Tools

!!A set of back-end services that can be used to support all the other platform components and functionalities.

"!Scheduler

"!Alarms & Notifications

"!Distribution lists

"!Subscriptions

"!Monitoring & Auditing

"!Collaboration module

SpagoBI – Analytical Engines

!!They are the components that actually execute analysis

!!At least one analytical engine exists for each

analytical area (ex. report, olap, datamining, ecc…) !

!!For each analytical area more than one engine type

can exist (ex. Jasper, BIRT and BO for reporting)!

!!One engine type can have

multiple instances to guarantee scalability and reliability

SpagoBI logical architecture

!!The main components of SpagoBI

SpagoBI Metadata

SpagoBI Core

Authorization System

Authentication System

SS

O / S

ecurity

AP

I

SpagoBI Engine

SpagoBI Engine

SpagoBI Engine

SpagoBI Engine

Security connectors

Folders

From SpagoBI 1.9.x to SpagoBI 2.x

!!All the SpagoBI components are now into the SpagoBI Server

SpagoBI SERVER SpagoBI Studio

SpagoBI Meta

Spa

goB

I S

DK

SpagoBI Applications

!!But in the new 2.x Release, some other main modules are coming …

SpagoBI 2.x – Main Modules

!!5 Modules

"!Server

"!Studio

"!Meta

"!SDK

"!Applications

!! 6 NEW Engines "! GEO engine

"! New QbE (multi-schema)

"! Interactive dashboard (Composed Document) !

"! KPI modeller and navigator "! JPalo for OLAP

"! Chart engine

!! Architectural review "! WebApplication and JSR 168

"! SSO with CAS

"! SOA "! SSL

"! Security assessment (OWASP Compliant)!

!! General Features "! Subscriptions

"! Personal folders

"! Rich client "! Data sources configuration

"! Alert and Notification

"! Save Import/export settings

"! ….

SpagoBI Server (the already known platform, with many

news) :

SpagoBI 2.x – Main Modules

!!5 Modules

"!Server

"!Studio

"!Meta

"!Applications

"!SDK

SpagoBI Studio : the integrated environment, to develop, test

and deploy documents into one or more SpagoBI Server

SpagoBI Meta : Business and technical metadata

SpagoBI SDK, to use SpagoBI from external application:

- Tag Lib - Integration API - Web Services

SpagoBI Applications: - BAM - Audit & Monitoring - ….

SpagoBI technological architecture

!!Technological architecture

"!SpagoBI can be deployed in:

#! Tomcat 6.x

#! Jboss 4.x

#! WebSphere 6.x

"!SpagoBI can be installed as a simple WebApplication

"!SpagoBI can be installed in a Portal environment:

#! eXo Platform 2.x

#! Liferay 5.1

#! WebSphere Portal

!!Open Standards

"!JSR 168, JSR 170, JDBC, JDK, Hibernate

SpagoBI for the end-user

SpagoBI 2.1

End-user functionalities

SpagoBI 2.1 - Reporting

SpagoBI 2.1 - Reporting

Template File

Parameters

Report Engine

A typical reporting system

SpagoBI 2.1 - Reporting

SpagoBI 2.1 - Reporting

SpagoBI 2.1 - Reporting

SpagoBI 2.1 – Reporting and behavioural model

SpagoBI 2.1 – Reporting and behavioural model

SpagoBI 2.1 - OLAP

SpagoBI 2.1 - OLAP

A typical OLAP system

Ola

p C

lient

Co

m. A

PI

Co

m. A

PI Com. Protocol

Ola

p S

erv

er

Data Storage

MONDRIAN JPIVOT

SpagoBI 2.1 – OLAP functionalities

SpagoBI 2.1 – OLAP functionalities

SpagoBI 2.1 – OLAP functionalities

SpagoBI 2.1 – OLAP functionalities

SpagoBI 2.1 - GEO

SpagoBI 2.1 – GEO Analysis

GEO Analysis is ...

... a visual representation of some spatial data (typically a geographic map) whose elements, usually called geographical features, are enriched with some graphical information (typically colours) based on the value of some KPI related to the spatial element.

SpagoBI 2.1 – GEO Analysis

GEO spatial data: basic concepts

- features

- attributes

- layers

- maps

SpagoBI 2.1 – GEO Analysis

Geographic features are ...

... geometric entities like points, lines and polygons

that can have a graphical representation. Geographical

features are usually related to some existing entity in the

real world like, for example, cities, streets and regions.

point line

polygon

SpagoBI 2.1 – GEO Analysis

Geographic attributes are ...

... properties related to some geographical features

like for example id, name, population, length, ecc ...

POINT(

Id: MI Name:Milan State: Italy Region:Lombardia Area: 182 km2

)

LINE(

Id: H101 Name:101 Length: 500 km Type: Freeway

)

POLYGON(

Id: IT Name:Italy Population 51M Capital: Rome

)

SpagoBI 2.1 – GEO Analysis

Layers are ...

... group of features, usually of the same geometric

type and usually related to the same kind of real world

entities.

Italy Regions' layer: groups together all the polygonal type features related to regions of Italy

SpagoBI 2.1 – GEO Analysis

Maps are ...

... a portrayal of geographic

information as a digital image file

suitable for display on a computer screen.

A map is not the data itself.

… usually built as a composition of

different geographical layers

SpagoBI 2.1 – GEO Engine goal

GEO Analysis GOAL is ...

... build a bridge between geo-spatial data and datawarehouse informations

SpagoBI 2.1 – GEO Analysis

GEO spatial data: out of scope

- Web Map Server: a system capable of producing

maps from geographic information

- Web Feature Service: a service whose interface

allows to request for geographical features

- Geographical Information System: a system for

capturing, storing, analyzing and managing data and

associated attributes

SpagoBI 2.1 – GEO Analysis

GEO Dimension

- is part of the data warehouse

- is the link between the business data and the geo data

- is structured into one or more hierarchies

SpagoBI 2.1 – GEO in action

SpagoBI 2.1 – GEO in action

SpagoBI 2.1 – GEO in action

SpagoBI 2.1 – Charts

SpagoBI 2.1 – Bar charts

SpagoBI 2.1 – Dial charts

SpagoBI 2.1 – Pie charts

SpagoBI 2.1 – Box charts

SpagoBI 2.1 – Charts in action

SpagoBI 2.1 – Dashboards

SpagoBI 2.1 – Dashboards: Rotate

SpagoBI 2.1 – Dashboards: Live Line

SpagoBI 2.1 – Dashboards in action

SpagoBI 2.1 – Composite Document

SpagoBI 2.1 – Composite document

!!The composite document is a new SpagoBI engine which creates and displays on a single page more SpagoBI documents of any type (maps, reports, charts,…).

!! It can be considered as a new type of instrument panel with the difference that the documents are dynamic and so the users can navigate the displayed information.

SpagoBI 2.1 – Composite document in action

SpagoBI 2.1 – Composite document in action

!!The user clicks on Washington state and then each other document is reloaded taking the new parameter as input:

SpagoBI 2.1 – Composite document in action

!!The same, if the user click on the table, the charts in the lower part will be refreshed according to the new parameter :

SpagoBI 2.1 – Composite document in action

!! Also the last single chart can update other documents, in this case updates the last chart on the right:

!! Note that all documents within the composite document share the same parameters and you can configure it so that everyone can start the update of the other, updating the value of a shared parameter