Business Process Modeling and Analysis for Data Warehouse Design

Slava KokaevLead Business Intelligence Architect at Lockheed Martin

Email: vkokaev@bostonbi.orgTwitter: @SlavaKokaev

Agenda

Dimensional Model Physical Implementation

Design Dimensional Model

Model and Analyze Business Processes

Tools And Technologies

Microsoft SQL Server 2014

UML

IDEF0 Notation

SADT Methodology

What is Business Intelligence?

Business intelligence is a set of theories, methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information for business purposes.

Business Intelligence GoalTo optimize organizational Key Business Processes and Operations by providing critical to business Information at Right Time and Right Format to all levels of employees.

Expl

ore

Ana

lyz e

Vis

uali

zeCon

tro l

System DefinitionSystem is a group or set of functional elements that interact together to produce desired result or achieve a goal

Element 1

Element 2

Element 3

We scope a system by defining its boundary; this means choosing which entities are inside the system and which are outside – part of the environment.

Element 5

Element 6

Element 7

System ProcessA system can also be viewed as a bounded transformation process, that is, a process or collection of processes that transforms inputs into outputs. Inputs are consumed; outputs are produced.

ProcessInput

Control

Processor

Output

System Formation

System is a set of detailed methods, procedures and routines created to carry out a specific activity, perform a duty, or solve a problem.

Identify Problem

Set Goal and

Result

Define Mechani

sm

Perform Task

Analyze Result

Improve Process

Business ProcessBatch processing Architecture Scheduled Large dataset size

A business process is a collection of related, structured activities or tasks that produce a specific service or product (result) (serve a particular goal) for a particular customer or customers.

There is two types of business processes: key processes and supportive processes.Key Business process is a process that adds value to the productSupportive process adds value to the process itself, but not to the product

Business Process Structure

Enterprise Business Analytics System

Customers

Business Partners

Vendors, Suppliers

Service Providers

Monitoring Systems

Analysis Systems

Business Processes and Operations

Controlling Systems

Strategy and Planning Systems

Business Conceptual Framework

Reseller Sales

AmyJack

Mo Shipping Dept.

Sales Quota $1000

Manager

Order Date

Order # Reseller Sales Person

Ship Date Product Price

06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200

Data Sources

Customer Web App Order Cloud

Web Service

FTP Server

Database Server

Data Sources

Customer Web App Order Cloud

Web Service

FTP Server

Database Server

ETL

Web Service

FTP Server

Database Server

ETL Extract, Transform, Load

ETL

Data Warehouse

ETL Extract, Transform, Load

Web Service

FTP Server

Database Server

ETL

Data Warehouse

Data Warehouse

Data Warehouse

Data Warehouse

OLAP Cube

Data Mining

Structure

Data Warehouse

Data Warehouse

OLAP Cube

Data Mining

Structure

Data Presentation

OLAP Cube

Data Mining

Structure

Data Presentation

SharePoint Server

Custom Application

Dashboards

Clients

Business Logic

Power User

Use Case

Reseller Sales

AmyJack

Mo Night Freight Sales Quota $1000

Manager

Order Date Order # Reseller Sales Person Ship Date Product

06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200

Identifying System Boundary

Reseller

Sales Mager

Sales Person

Shipping Person

Browse Product Catalog

Get Product Quotes

Order Product

Receive Product

Analyze Sales Create Sales

Plan

Sale Product

Process Order

Ship the Product

Package Product

Get Processed

Order

Source System

Create KPI

Business Intelligence System

Business Process

Business ActivityMoney

Customers

Materials

Business Rules Plans Standards

IT ResourcesHuman Resources Equipment

Products

Orders

Contracts

Functional Structure (PDCA Model)

Plan

Act

Check

Do

Data Mining Reporting Services Analysis ServicesSQL Server

Input Data

Resources

Plans, Business Rules

Result Data

Process Output (Facts /Measures)

Feedback (Improvement)

Sales Business Process

Plan Sales

Analyze Sales

Monitor Sales

Sale Product

Sales ManagerSales Representative

Analysis Data

Reseller Info (Dimension)

Sales Quota

Sales Result

Order Info (Facts /Measures)

Sales corrections and Improvement

Sales Summary

Balance Scorecards

Sales Transaction

Product Info (Dimension)

KPI

Designing Dimensional Model

Dimension

Dimension

Dimension

Dimension

DimensionFact

Designing Dimensions

Reseller

Name

Address

Phone

Business Type

Product Line

Jack Yo

…, NJ, USA

(555)333-7777

Bikes

Retailer

Designing Dimensions Hierarchy

Product

Name

Category

Sub Category

Color

Price

Mountain Bike 200

Bike

Mountain Bike

Black

$150.00Name

Category

Sub Category

Designing Dimensions

HierarchiesA dimension hierarchy is a collection of logically structured levels based on attributes.

Surrogate KeysPrimary key purposeIdentifies uniquenessRelates to foreign keys in a fact tableConsolidates multiple data sourcesConsolidates multi-value business keysAllows tracking of dimension history

Product

Name

Category

Sub Category

Color

Price

Product ID

DimProduct

Name

Category

Sub Category

Color

Price

Product ID

Product Key

Mountain Bike

Bike

Mountain Bike - 200

Black

$150.00

MB124677

1

Source OLTP Table Target DW Table

8/12/2013DateSK812201

3

Full NameAmy

Valdes

EmployeeSK5

Full NameJohn Doe

ResellerSK20

ProductNameBike-200,

Mnt, B

ProductSK

555

Date

Designing Dimensional Model

Order Date

ResellerSales Person

Product Price Order Qty8/12/2013 John Doe

Amy Valdes

Bike-200, Mnt, B

$150.00

20

Shipping Date

9/3/2013

Order Date

ResellerSales Person

Product8/12/2013 John Doe

Amy Valdes

Bike-200, Mnt, B

DimDate

DimEmployee

DateSK8122013

DateSK932013

EmployeeSK5

DimReseller

ResellerSK20

DimProduct

ProductSK555

FactResellerSales Measures

9/3/2013 932013

This is the End of the Slides

But not the end of the presentation