Business Intelligence in SQL Server 2005 Business Intelligence in SQL Server 2005

Technical Overview Technical Overview

Peter Blackburn Peter Blackburn Speaker, Trainer, Developer, Mentor, AuthorSpeaker, Trainer, Developer, Mentor, AuthorWindows Server Systems – SQL Server MVPWindows Server Systems – SQL Server MVP

PeterDB@Boost.netPeterDB@Boost.net

Business IntelligenceBusiness IntelligencePeter BlackburnPeter Blackburn

Published Books:Published Books:

Hitchhiker’s Guide to SQL Server 2000 Hitchhiker’s Guide to SQL Server 2000 Reporting ServicesReporting Services

ADO.NET Examples and Best Practices ADO.NET Examples and Best Practices for C# Programmersfor C# Programmers

Next Books:Next Books:

Hitchhiker’s Guide to SQL Server 2005 Hitchhiker’s Guide to SQL Server 2005 Reporting ServicesReporting Services

Hitchhiker’s Guide to Visual Studio 2005 Hitchhiker’s Guide to Visual Studio 2005 and SQL Server 2005and SQL Server 2005

ContactContact

PeterDB@Boost.NETPeterDB@Boost.NET

Business IntelligenceBusiness IntelligencePresentation GoalPresentation Goal

To provide an introduction to as many of the To provide an introduction to as many of the new Business Intelligence features as time new Business Intelligence features as time permitspermits

Business IntelligenceBusiness IntelligenceThe OriginalThe Original

““BI” coined in 1992 by Howard Dresner – now a VP of BI” coined in 1992 by Howard Dresner – now a VP of Gartner GroupGartner Group

““Business Intelligence (BI) is a conceptual umbrella. Business Intelligence (BI) is a conceptual umbrella. Underneath it are a variety of technologies that support Underneath it are a variety of technologies that support end-user access to, and analysis of quantitative end-user access to, and analysis of quantitative information sources. At the very basic level that means information sources. At the very basic level that means end-user reporting. It also includes OLAP (on line end-user reporting. It also includes OLAP (on line analytical processing), executive interfaces, end-user ad analytical processing), executive interfaces, end-user ad hoc query, enterprise business intelligence suites, and hoc query, enterprise business intelligence suites, and Business Intelligence platforms – which are essentially Business Intelligence platforms – which are essentially development environments for building custom decision development environments for building custom decision support applications.support applications.””

Business IntelligenceBusiness IntelligenceSQL Server 2005 BI PlatformSQL Server 2005 BI Platform

Microsoft OfficeMicrosoft OfficeAd hoc query and analysis

RDBMSRDBMSRelational Data Warehouse

Analysis ServicesAnalysis ServicesMultidimensional Database

Analysis ServicesAnalysis ServicesData Mining

Reporting ServicesReporting ServicesReporting

Bulk Copy Program (BCP)Bulk Copy Program (BCP)2000: Data Transformation Services (DTS)2000: Data Transformation Services (DTS)2005: 2005: SQL Server Integration Services (SSIS)SQL Server Integration Services (SSIS)

Extract Transform and Load (ETL)

Microsoft SQL Server TechnologyMicrosoft SQL Server TechnologyBI ComponentBI Component

Business IntelligenceBusiness IntelligenceSQL Server 2005 BI ToolsSQL Server 2005 BI Tools

BI ComponentBI Component SQL Server 2000SQL Server 2000 SQL Server 2005SQL Server 2005

Management Tools Enterprise ManagerEnterprise Manager

Analysis ManagerAnalysis Manager

SQL Server SQL Server Management StudioManagement Studio

Management Utilities SQL Server Service SQL Server Service Manager Manager (systray)(systray)

SQL Computer SQL Computer Manager Manager (mmc)(mmc)

Server Development Tools

Enterprise ManagerEnterprise Manager

Query AnalyzerQuery Analyzer

Analysis ManagerAnalysis Manager

SQL Server SQL Server Management StudioManagement Studio

Business Intelligence Business Intelligence Development Studio Development Studio

Client Development

Tools

Visual StudioVisual StudioVisual Studio.NET Visual Studio.NET

ETL – Simple new T-SQL FeaturesETL – Simple new T-SQL Features

Using SQL Server 2005 Management StudioUsing SQL Server 2005 Management Studio

DemoDemo

Business IntelligenceBusiness IntelligenceETL: Database SnapshotsETL: Database Snapshots

Create with TSQL scriptCreate with TSQL script

Enable data consistency of extractsEnable data consistency of extracts

Performance considerationsPerformance considerations

Business IntelligenceBusiness IntelligenceETL: Bulk Copy ProgramETL: Bulk Copy Program

Consume File as ROWSET in TSQLConsume File as ROWSET in TSQL

Extract an XML Format File – new for 2005:Extract an XML Format File – new for 2005:bcp AdventureWorks.Production.Product bcp AdventureWorks.Production.Product format nul -c -x -f Product_XML.fmt -Tformat nul -c -x -f Product_XML.fmt -T

Extract the Data:Extract the Data:bcp AdventureWorks_1300.Production.Product out bcp AdventureWorks_1300.Production.Product out Product.tab -f Product_XML.fmt –TProduct.tab -f Product_XML.fmt –T

Business IntelligenceBusiness IntelligenceETL: Database MirrorsETL: Database Mirrors

Simple ‘hot’ standby serversSimple ‘hot’ standby servers

Easier-to-manage than failover clusteringEasier-to-manage than failover clustering

Snapshots enable ‘Mirrors’ to be used as Snapshots enable ‘Mirrors’ to be used as reporting servers with minimal data latencyreporting servers with minimal data latency

Principal and Mirror can switch ‘roles’Principal and Mirror can switch ‘roles’

Automatically – requires Witness ServerAutomatically – requires Witness Server

Manually - without a Witness ServerManually - without a Witness Server

Forced Forced service - NB possible data loss service - NB possible data loss

Business IntelligenceBusiness IntelligenceETL: SQL Server Integration Services (SSIS)ETL: SQL Server Integration Services (SSIS)

DTS ReplacementDTS Replacement

(DTS 2000 Runtime is included for backward (DTS 2000 Runtime is included for backward compatibility)compatibility)

Completely re-engineeredCompletely re-engineered

Enhanced performance & debuggingEnhanced performance & debugging

Separation of control flow and data flowSeparation of control flow and data flow

Matthew Stephen Matthew Stephen Drills into SSIS in session 5 today Drills into SSIS in session 5 today

Analysis Services 2005 Analysis Services 2005

Business Intelligence Development StudioBusiness Intelligence Development Studio

DemoDemo

Business IntelligenceBusiness IntelligenceAnalysis Services - UDMAnalysis Services - UDM

UDM Unified Dimensional ModelUDM Unified Dimensional Model

Bridge between the user and the data sourcesBridge between the user and the data sources

• Performance

• Analytic

functionality

• Complex schemas

• Low latency

Business IntelligenceBusiness IntelligenceAnalysis Services - UDMAnalysis Services - UDM

Supports OLAP and Data MiningSupports OLAP and Data Mining

Cubes & DimensionsCubes & Dimensions

No Access (MDB file) meta data repositoryNo Access (MDB file) meta data repository

XML/AXML/A

Server side Server side

KPI calculationsKPI calculations

PerspectivesPerspectives

TranslationsTranslations

Stored Procedures (CLR – MDX functions, Cube Processing )Stored Procedures (CLR – MDX functions, Cube Processing )

Business IntelligenceBusiness IntelligenceAnalysis Services - KPIAnalysis Services - KPI

Defined in Analysis Server 2005 asDefined in Analysis Server 2005 as

Value to be measuredValue to be measured

Goal for the valueGoal for the value

Status - range for value betweenStatus - range for value betweenvery badvery bad -1 -1 very goodvery good +1 +1

Trend – better or worse relative to its goal.Trend – better or worse relative to its goal.

Business IntelligenceBusiness IntelligenceUDM = The best of Relational and OLAPUDM = The best of Relational and OLAP

FeatureFeature RelationalRelational OLAPOLAPFlexible schemaFlexible schema Real time data accessReal time data access Single data storeSingle data store Simple managementSimple management Detail reportingDetail reporting High performanceHigh performance End-user orientedEnd-user oriented Ease of navigation and explorationEase of navigation and exploration Rich analyticsRich analytics Rich semanticsRich semantics

Business IntelligenceBusiness IntelligenceData MiningData Mining

Previously domain of big hitters with big budgetsPreviously domain of big hitters with big budgets

Data Mining enables pattern exploration, discovery and Data Mining enables pattern exploration, discovery and ultimately prediction.ultimately prediction.

Predictive AnalyticsPredictive Analytics

Ability to apply the data mining results against new dataAbility to apply the data mining results against new data

SQL Server Data Mining extracts information from data, SQL Server Data Mining extracts information from data, and allows the user to integrate predictive analytics.and allows the user to integrate predictive analytics.

Business IntelligenceBusiness IntelligenceData MiningData Mining

Data Mining answers a variety of questions:Data Mining answers a variety of questions:Which customers will respond to my mailing?Which customers will respond to my mailing?

Is this transaction fraudulent?Is this transaction fraudulent?

Will I lose this customer?Will I lose this customer?

How long will this asset be in service?How long will this asset be in service?

How can I differentiate my customers?How can I differentiate my customers?

How are people using my Web site?How are people using my Web site?

What items are bought together?What items are bought together?

What products should I recommend to my customers?What products should I recommend to my customers?

What are projected revenues for all products?What are projected revenues for all products?

How do I handle call center data?How do I handle call center data?

Business IntelligenceBusiness IntelligenceData MiningData Mining

What's New?What's New?

Two enhanced and five new algorithms …Two enhanced and five new algorithms …

Enhanced tools including custom visualization for Enhanced tools including custom visualization for each algorithmeach algorithm

OLAP, DTS, and Reporting IntegrationOLAP, DTS, and Reporting Integration

.NET programming model.NET programming model

Text MiningText Mining

Completely expandable frameworkCompletely expandable framework

Business IntelligenceBusiness Intelligence

Decision Trees Clustering Time Series

Sequence Clustering

Association Naïve Bayes

Neural Net

Business IntelligenceBusiness IntelligenceData Mining – Which Algorithm ?Data Mining – Which Algorithm ?

Analytical problemAnalytical problem ExamplesExamples Microsoft algorithmsMicrosoft algorithms

Classification: Assign cases to predefined classes such as "Good" vs "Bad"

Credit risk analysis

Churn analysis

Customer retention

Decision Trees

Naïve Bayes

Neural Nets

Segmentation: Develop a taxonomy for grouping similar cases

Customer profile analysis

Mailing campaign

Clustering

Sequence Clustering

Association: Advanced counting for correlations

Market basket analysis

Advanced data exploration

Decision Trees

Association Rules

Time Series Forecasting: Predict the future

Forecast sales

Predict stock prices

Time Series

Prediction: Predict a value for a new case (such as a new customer) based on values for similar cases (such as existing customers)

Quote insurance rates

Predict customer income

Predict temperature

All

Deviation analysis: Discover how a case or segment differs from others

Credit card fraud detection

Network infusion analysis

All

Business IntelligenceBusiness IntelligenceData Mining ExampleData Mining Example

Get top five movie recommendations based on Get top five movie recommendations based on shopping cart contentsshopping cart contents

SELECT Predict(Movies, 5)SELECT Predict(Movies, 5)FROM MovieModelFROM MovieModelNATURAL PREDICTION JOIN NATURAL PREDICTION JOIN (SELECT (SELECT

(SELECT ‘Matrix’ as Movie (SELECT ‘Matrix’ as Movie UNION SELECT ‘Aliens’ as UNION SELECT ‘Aliens’ as

Movie) Movie) as Movies) as tas Movies) as t

Reporting Services 2005 Reporting Services 2005

DemoDemo

Internet Information Server (IIS)

Business IntelligenceBusiness IntelligenceReporting Services ArchitectureReporting Services Architecture

URL & SOAP Interfaces

Report ServerReport Server

Report Processor

Data Processing

Data Sources(SQL, OLE DB, XML/A, ODBC, Oracle, Custom)

Analysis Server

Report Rendering

Output Formats HTML, Excel, PDF, CSV, XML…

SQL Server Catalog

SQL Server 2005

BI Dev Studio BI Dev Studio Report DesignerReport Designer

Report ManagerReport ManagerReportServer WebReportServer Web

ServiceService

Security

Delivery Targets(E-mail, FileShare, Sharepoint

Custom)

Scheduling & Delivery

Web Report Web Report BuilderBuilder

Business IntelligenceBusiness IntelligenceReporting ServicesReporting Services

New for SQL 2005New for SQL 2005

ReportBuilder; based on Active ViewsReportBuilder; based on Active Views

ADO.NET Datasets as data sourcesADO.NET Datasets as data sources

MDX DesignerMDX Designer

Custom Report ControlsCustom Report Controls

Better integration with Analysis ServerBetter integration with Analysis Server

Reporting Services Configuration ManagerReporting Services Configuration Manager

SSIS – report directly from SSISSSIS – report directly from SSIS

New for Visual Studio 2005New for Visual Studio 2005

Client side rendering controlClient side rendering control

SQL Server 2005SQL Server 2005

www.microsoft.com/sql/2005www.microsoft.com/sql/2005

Visual Studio 2005Visual Studio 2005

lab.msdn.microsoft.com/vs2005lab.msdn.microsoft.com/vs2005

My Site: My Site:

www.sqlreportingservices.netwww.sqlreportingservices.net

Resources

Event InformationEvent InformationWhat’s Next?What’s Next?

Technical Roadshow Post Event WebsiteTechnical Roadshow Post Event Website

www.microsoft.com/www.microsoft.com/uk/techroadshow/posteventsuk/techroadshow/postevents

Available from Monday 18Available from Monday 18thth April April

Please complete your Evaluation Form!Please complete your Evaluation Form!

© 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.© 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.

© 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.© 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.