Post on 25-Feb-2016
description
transcript
Architecting Business Intelligence System
Slava KokaevLead Business Intelligence Architect at
Industrial Defender Email: vkokaev@bostonbi.orgTwitter: @SlavaKokaev
Agenda• What is business intelligence?• Business Intelligence Architecture• Understanding Business Process and System Architecture• Modeling Business Processes• Modeling Dataflow• Modeling Dimensional Model• Modeling Analytical System• ETL Architecture
Tools And Technologies• Microsoft SQL Server 2012 Database Engen• Microsoft SQL Server 2012 Integration Services• Microsoft SQL Server 2012 Analysis Services• Microsoft SQL Server 2012 Reporting Services• SQL Server Data Tools in Visual Studio 2012• UML• IDEF0 Notation• SADT Methodology
What is Business Intelligence?
Business intelligence (BI) is a set of theories, methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information for business purposes."Business Intelligence - enables more effective strategic, tactical, and operational insights and decision-making."
What is Business Intelligence Technologies?
BI technologies provide historical, current and predictive views of business operations.
Expl
ore
Anal
yze
Visu
alize
Cont
rol
Types of BI SystemsBatch processing Architecture Scheduled Large dataset size
Close to real time architecture Scheduled or triggered Small dataset size
Real Time architecture Data stream Messages
Business Processes
Enterprise Business Analysis System
Customers Business partners
Vendors, Suppliers, Channel partners
IT providers Financial service providers
Monitoring Systems Analysis Systems
Business Processes and Operations
Controlling Systems Strategy and Planning Systems
Business Conceptual FrameworkDa
ta S
ourc
es
Data
Inte
grat
ion
Data
Sto
rage
Data
Ana
lytic
s (lo
gic)
Data
Visu
aliza
tion
Clie
nt A
pplic
atio
n
ETL Data Warehouse Data Presentation
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
ETL
Web Service
FTP Server
Database Server
ETL Extract, Transform, Load
ETL Data
Warehouse
ETL Extract, Transform, Load
Web Service
FTP Server
Database Server
ETL Data
Warehouse
Data Warehouse
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
Data Presentation
OLAP Cube
Data Mining
Structure
Data Presentation
SharePoint Server
Custom Application
Dashboards
Clients
Business Logic
Power User
Use Case
Reseller Sales
AmyJack
Mo Night Freight
Sales Quota $1000
Boss
Order Date Order # Reseller Sales Person Ship Date Product
06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200
Identifying System Boundary
Reseller
Sales Mager
Sales Person
Shipping Person
Browse Product Catalog
Get Product Quotes
Order Product
Receive Product
Analyze Sales Create Sales
Plan
Sale Product
Process Order
Ship the Product
Package Product
Get Processed
Order
Source System
Create KPI
Business Intelligence System
Business Process
Business ActivityMoney
Customers
Materials
Business Rules Plans Standards
IT ResourcesHuman Resources Equipment
Products
Orders
Contracts
Functional Structure
Plan
Act
Check
Do
Data Mining Reporting Services Analysis ServicesSQL Server
Input Data
Resources
Plans, Business Rule and KPI
Result Data
Process Output (Facts /Measures)
Feedback (Improvement)
Sales Business Process
Plan Sales
Analyze Sales
Monitor Sales
Resellers Sales
SQL Server DB
Sales ManagerSales Representative
Market Data
Reseller (Dimension)
Sales Quota and KPI
Sales Result
Sale Orders (Facts /Measures)
Sales corrections and Improvement
Sales Summary
Balance Scorecards
Sales Transaction
Designing Dimensional Model
DimensionDimensionDimensionDimensionDimensionFact
8/12/2013DateSK812201
3
Full NameAmy Valdes
EmployeeSK5
Full NameJohn Doe
ResellerSK20
ProductNameBike-200, Mnt, B
ProductSK555
Date
Designing Dimensional Model
Order Date ResellerSales Person Product Price Order Qty8/12/2013 John DoeAmy Valdes Bike-200, Mnt, B $150.00 20
Shipping Date9/3/2013
Order Date ResellerSales
Person Product8/12/2013 John DoeAmy
ValdesBike-200,
Mnt, B
DimDate
DimEmployee
DateSK8122013
DateSK932013
EmployeeSK5
DimReseller
ResellerSK20
DimProduct
ProductSK555
FactResellerSales Measures
9/3/2013 932013
Analytical System of the Data WarehouseBI Semantic Model
Data model
Business logic and queries
Data access ROLAP MOLAP VertiPaq DirectQuery
MDX DAX
Multi-dimensional Tabular
Third-partyReporting Services Excel PowerPivot
Databases
LOB Applications
Files OData Feeds
Cloud Services
SharePoint
ETL Logical ArchitectureExtract Data
Load Staging
Extract from Staging
Transform Data
Load Dimensions
Load Facts
Process Cube
Log ETL Process
Send Notification
Batch Processing Architecture
Data Source Staging Table DWH Table
ETL
Truncate Table
Batch Processing Architecture (Table Switch)
Data SourceStaging Table 1
DWH Table
ETL
Staging Table 2
Truncate Table
Presentation System
This is the End of the presentation
But not the end of the way