Date post: | 20-May-2015 |
Category: |
Technology |
Upload: | willie-favero |
View: | 1,197 times |
Download: | 4 times |
© 2010 IBM Corporation
Session IM03:
Data Warehousing:What's Available on System z Today
Willie Favero – Data Warehouse on System z Swat Team (DB2 SME)
09 September 2010
Total Solution Event for System z: Brussels 2010
Copyright © 2010 IBM CorporationAll rights reserved Slide 2 of 63IM03 - Data Warehousing: What's available on System z today
NoticesThis information was developed for products and services offered in the U.S.A.
Note to U.S. Government Users Restricted Rights — Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrates programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy, modify, and distribute these sample programs in any form without payment to IBM for the purposes of developing, using, marketing, or distributing application programs conforming to IBM's application programming interfaces.
Copyright © 2010 IBM CorporationAll rights reserved Slide 3 of 63IM03 - Data Warehousing: What's available on System z today
Trademarks
This presentation contains trade-marked IBM products and technologies. Refer to the following Web site:
http://www.ibm.com/legal/copytrade.shtml
Copyright © 2010 IBM CorporationAll rights reserved Slide 4 of 63IM03 - Data Warehousing: What's available on System z today
Agenda
Why Data Warehouse and Business Intelligence on System z? – Industry Trends– Changing Business Requirements– System z Features
An Introduction to Data Warehousing on System zIBM Smart Analytics System 9600IBM Smart Analytics Optimizer
Copyright © 2010 IBM CorporationAll rights reserved Slide 5 of 63IM03 - Data Warehousing: What's available on System z today
Why System z and
zEnterprise 196for
Data Warehousing and BI?
zEnterprise 196 processor chip
Copyright © 2010 IBM CorporationAll rights reserved Slide 6 of 63IM03 - Data Warehousing: What's available on System z today
Regulatory Compliance
Marketing/Sales Interactions
Online Sales
Supply Chain Optimization
Financial Trading
Financial Planning
Fraud Avoidance
Customer Service/
Care
Customer Self Service
The focus is on having the right information at the right time
To enable the right business decision
Applications are Moving to Optimized Business ProcessesCreating a New Set of Requirements
Copyright © 2010 IBM CorporationAll rights reserved Slide 7 of 63IM03 - Data Warehousing: What's available on System z today
Operational Business Intelligence TraditionalWarehousing
Caring for high value customers
Identifying seats for rerouted passengers due to flight delays before the flight arrives
--------------- Travel and Transportation
Crime statisticsand reporting
Identifying related incidents and potential suspects prior to arriving at the crime scene
--------------- Transforms law enforcement
CustomerAnalysis
Understanding relevant customer info to identify cross sell and up sell opportunities and improve value of sale at the point of sale
--------------- Transforms sales effectiveness
Insurance fraudanalysis & reporting
Identifying potentially fraudulent claims prior to approval and payment rather than after the fact
--------------- Transforms insurance fraud
Providing the Right Information .....To the right person, at the right time –
... Changes the Way We Do Business Delivering Information When it Has the Most Impact
Copyright © 2010 IBM CorporationAll rights reserved Slide 8 of 63IM03 - Data Warehousing: What's available on System z today
Industry Trends that Favor the System z Platform
Cost efficiencies of a consolidated, virtual environment– Reduced: labor costs, energy consumption, data center footprint– Improved: ability to manage operations, upgrades, performance
Mixed workload environments and operational business intelligence– When warehouse and analytics become more operational, System z platform
qualities of service become more critical:• Availability, Reliability, Security
Compliance pressures– Centralized data can dramatically improve ease of data governance by
reducing the number of servers and copies of data to be managed– Single version of the truth
Copyright © 2010 IBM CorporationAll rights reserved Slide 9 of 63IM03 - Data Warehousing: What's available on System z today
The Changing Data Warehouse Market
The data warehouse is a mission-critical system, with data warehouses serving in an increasingly mixed workload capacity, including as a data source for online applications. "Deep mining“ analysts and business analysts are running less-structured but equally complex queries and fast running tactical queries, each with differing service-level expectations. These differing workloads are all competing for CPU, memory and disk access. At the same time, data latency continues to progress from batch to continuous loading demands.
Publication Date: 23 December 2008/ID Number: G00163473; © 2008 Gartner, Inc. and/or its Affiliates. All Rights Reserved.
Copyright © 2010 IBM CorporationAll rights reserved Slide 10 of 63IM03 - Data Warehousing: What's available on System z today
WarehouseWarehouse
Present
Acquire
ETLETLData QualityData Quality ELTELT
ReplicationReplicationEAIEAI**
EIIEII****
Store CubingCubing
Operational Source SystemsStructured/ Unstructured Data
Operational Applications
Transform/Optimize
Excel
Where does your System z fit?
Data Warehouse/BI Basics- 4 stages between Data and Information
* Enterprise Application Integration** Enterprise Information Integration
Copyright © 2010 IBM CorporationAll rights reserved Slide 11 of 63IM03 - Data Warehousing: What's available on System z today
Cost effective alternative to masses of commodity servers
– Management/Administration costs are already exceeding new server spending– Power and energy costs growing dramatically
2000 –Raw processing “horsepower” is the primary goal, while the infrastructure to support it is assumed ready
2010 –Raw processing “horsepower” is a given, but the infrastructure to support deployment can be a limiting factor
Source: IDC, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006
$0
$50
$100
$150
$200
$250
$300
199719981999
2000
200120022003200
420052006200720082009201
0
Installed Base(M Units)
Spending(US$B)
0
5
10
15
20
25
30
35
40
45
50
1996
Power and cooling costs
Server mgmt and admin costs
New server spending
Worldwide IT Spending TrendW orldwide IT Spending Trend
$0
$50
$100
$150
$200
$250
$300
199719981999
2000
200120022003200
420052006200720082009201
0
Installed Base(M Units)
Spending(US$B)
0
5
10
15
20
25
30
35
40
45
50
1996
$0
$50
$100
$150
$200
$250
$300
199719981999
2000
200120022003200
420052006200720082009201
0
Installed Base(M Units)
Spending(US$B)
0
5
10
15
20
25
30
35
40
45
50
1996
$0
$50
$100
$150
$200
$250
$300
199719981999
2000
200120022003200
420052006200720082009201
0
Installed Base(M Units)
Spending(US$B)
0
5
10
15
20
25
30
35
40
45
50
1996
Power and cooling costs
Server mgmt and admin costs
New server spending
Power and cooling costs
Server mgmt and admin costs
New server spending
Worldwide IT Spending TrendW orldwide IT Spending Trend
Copyright © 2010 IBM CorporationAll rights reserved Slide 12 of 63IM03 - Data Warehousing: What's available on System z today
Processor Performance and Scalability
z990
z9
z10
Capacity
Cus
tom
er E
ngin
es
Additional Capacity using hybrid Technologies
z900
IFLCrypto
+zAAP
+zIIP
+Accelerators
zEnterprise
+Compute Intensive
Decimal FP
System z is no longer your father’s mainframe system!!!
Copyright © 2010 IBM CorporationAll rights reserved Slide 13 of 63IM03 - Data Warehousing: What's available on System z today
IBM zEnterprise System – Best in Class Systems & Software Technologies
Part of the IBM System Director family, provides platform, hardware and workload managementUnifies management of resources, extending IBM System z® qualities of service across the infrastructure
Ideal for large scale data and transaction serving and mission critical applicationsMost efficient platform for Large-scale Linux®
consolidation Leveraging a large portfolio of z/OS® and Linux on System z applicationsCapable of massive scale up, over 50 Billion Instructions per Second (BIPS)
Selected IBM POWER7™
blades and IBM x86 Blades1 for tens of thousands of AIX® and Linux applications
High performance optimizers and appliances to accelerate time to insight and reduce cost
Dedicated high performance private network
1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.
Unified management for a smarter system:zEnterprise Unified Resource Manager
Unified management for a smarter system:zEnterprise Unified Resource Manager
The world’s fastest and most scalable system:IBM zEnterprise™ 196
(z196)
The world’s fastest and most scalable system:IBM zEnterprise™ 196
(z196)
Scale out to a trillion instructions per second:
IBM zEnterprise BladeCenter® Extension
(zBX)
Scale out to a trillion instructions per second:
IBM zEnterprise BladeCenter® Extension
(zBX)
HMCHMC
A system of systems that unifies IT for predictable service delivery
Copyright © 2010 IBM CorporationAll rights reserved Slide 14 of 63IM03 - Data Warehousing: What's available on System z today
The z/OS Workload Manager (WLM) is the most mature and sophisticated workload manager available today
Granular WLM policies provide improved performance for mixed workloads
0
100
200
300
400
500
600
700
800
900Throughput Effects Response Time Effects
Que
ries
Com
plet
ed /
min
ute
Policy:Equal Priority
WLM Policy in effect
Policy:Equal Priority
WLM Policy in effect
Triv.Mod/ Med LargeTriv. Mod Med Large 0
20
40
60
80
100
120
140
160
180
Avg
Res
pons
e Ti
mes
Moderate/ Med /Large Triv small mod l Large
88% +faster
3 x
Proven Ability to Handle Mixed Workloads
Copyright © 2010 IBM CorporationAll rights reserved Slide 15 of 63IM03 - Data Warehousing: What's available on System z today
50TB System z Data Warehouse Benchmark
Poughkeepsie Lab / Silicon Valley Lab joint effort
Deliver proof points of System z scalability in Business Intelligence environment
Establish capability of System z to scale to larger volumes
Develop best practices of managing large data warehouses
Drive unique value of System z– Workload Manager: capabilities to manage mixed workloads– Operational BI: large volumes of users, smaller queries– zIIP: lower cost BI solution– Data compression: minimal overhead with hardware compression
SG24-7674
Copyright © 2010 IBM CorporationAll rights reserved Slide 16 of 63IM03 - Data Warehousing: What's available on System z today
Cost Benefits of System z
Reduce Operational CostsSave on storage using DB2 for z/OS System z hardware based data compression without compromising performance
– Typical savings in the 50-60% range
Index compression, DB2 9, software based Save on labor, energy, and floor space through consolidation to System z
– Save up to 85% on floor space**
– Save up to 80% on energy costs**
– Save up to 50% on labor resource**
Reduce overall Risk ExposureHighly sensitive personal or financial data is secure and auditableDB2 for z/OS data sharing and GDPS provide unparalleled availabilityMixed workloads benefit from the capability of the world class System z workload managerReduced latency and duplication provide a sound basis for timely and consistent business analysis
Position for GrowthApplication growth on System z scales well, while cost savings increaseParallel Sysplex and DB2 for z/OS data sharing enable incremental growthSystem z provides a non-disruptive upgrade path; System z tech dividends make that upgrade path more cost effective
** Based on calculations of savings realized in internal IBM System z consolidation projects
Copyright © 2010 IBM CorporationAll rights reserved Slide 17 of 63IM03 - Data Warehousing: What's available on System z today
An Introduction to Data Warehouse and BI on System z & zEnterprise
InfoSphereWarehouse
InformationServer
IndustryModels
MDM Server
DB2 for z/OSCognos 8 BI
Copyright © 2010 IBM CorporationAll rights reserved Slide 18 of 63IM03 - Data Warehousing: What's available on System z today
The Data Warehouse and BI Solution on System z
Combining the Reliability and Availability of DB2 for z/OS with Cost Effective Applications running on Linux for System z
InfoSphere Information Server for System z
DB2 for z/OS
OLTPdata
Data Warehouse
Cognos 8 BIfor Linux on
System z
Serving Up Consolidated Enterprise BI
Complete ETLSolution
The Enterprise Data Warehouse
InfoSphere Warehouse Cubing
Services
InfoSphere Warehouse
SQW
Source Systems :DB2IMS
VSAM
New ‘09 New ‘09
InfoSphere Replication Server
Copyright © 2010 IBM CorporationAll rights reserved Slide 19 of 63IM03 - Data Warehousing: What's available on System z today
Warehouse/BI Highlights of DB2 for z/OS V8
Materialized Query Tables –Improved performance for query
Multi-row insert and fetch–Improved speed of warehouse ETL and query
Online Schema evolution–Improves availability and efficiency
Longer Table and Column names–Increased compatibility with ETL and BI tools
Increased SQL vocabulary–Increased compatibility with ETL and BI tools
64 bit support –Expanded size capability
Copyright © 2010 IBM CorporationAll rights reserved Slide 20 of 63IM03 - Data Warehousing: What's available on System z today
Warehouse/BI Highlights of DB2 9 for z/OS
Index over Expression –Improved performance on ETL and BI tools
Index Compression–Improved use of space (up to 50%)
Not Logged Tablespace–More efficient for temporary tables such as Staging tables
Universal Table Space – partition by growth–Easier to manage growth–Best of segmented tables and partitioning
Utility Improvements–More online utility operations, reduced CPU
Overall DB2 9 for z/OS– reduced CPU
Copyright © 2010 IBM CorporationAll rights reserved Slide 21 of 63IM03 - Data Warehousing: What's available on System z today
1. CPU reductions for transactions, queries, & batch
2. Ten times more users by avoiding memory constraints
3. More concurrency for catalog, utilities, and SQL
4. More online changes for data definition, utilities and subsystems
5. Improved security with more granularity
6. Temporal or versioned data
7. SQL enhancements improve portability
8. pureXML performance and usability enhancements
9. Hash, index include columns, access path stability, skip migration, …Pick your favorite!
10.Productivity improved for database & systems administrators, andapplication programmers
2121
Top 10 in DB2 10 for z/OS
Copyright © 2010 IBM CorporationAll rights reserved Slide 22 of 63IM03 - Data Warehousing: What's available on System z today
InfoSphere Information Server on System z
Business Glossary DataStage
Parallel Processing
Rich Connectivity to Applications, Data, and Content
Enterprise Data Dictionary
Extract, Transform, and Load in Batch or Real-
time
Information Services Director
Metadata Workbench / FastTrack
Publish SOA services for informationintegration and access
Information AnalyzerData Source Profiling &
Problem Diagnosis
Manage and track consistent metadata across information integration tasks and automate generation of data flow logic
Federation ServerVirtualize access to
disparate information
CDC & ReplicationDeliver and replicate
changed data
QualityStage
Global Name RecognitionRecognize & ClassifyMulti-cultural names
Data Quality: Standardize,Correct & Match Data
Copyright © 2010 IBM CorporationAll rights reserved Slide 23 of 63IM03 - Data Warehousing: What's available on System z today
Maintaining a Low Latency Warehouse or ODS
Replication, InfoSphere CDC, Event Publisher, Classic Event Publisher
Provides incremental near real time feed to InfoSphere DataStage from IMS, VSAM, IDMS, Adabas, DB2 all platforms, Oracle, MS SQL Server, Sybase
Copyright © 2010 IBM CorporationAll rights reserved Slide 24 of 63IM03 - Data Warehousing: What's available on System z today
The core Cognos 8 BI components for Linux on System z
Reporting• Provides full breadth of report types • Ensures consistent information to all users • Engages business users with simplified role-based
interface• Delivers personalized content via email, portal, MS-
Office, search and mobile devices etc• Enables collaboration across users, communities and
with ITAnalysis
• Provides guided exploration across multiple dimensionsof information
• Performs complex analysis and scenario modelingeasily and quickly
• Exposes the “why” behind trends to reveal symptomsand causes
• Moves from summary level to detail levels ofinformation effortlessly
Copyright © 2010 IBM CorporationAll rights reserved Slide 25 of 63IM03 - Data Warehousing: What's available on System z today
Dashboards
• Provides at-a-glance, high impact viewsof complex information
• Helps quick focus on issues that needattention and action
• Are highly visual and intuitive
• Combines information across disparate sources
Right time Information
Copyright © 2010 IBM CorporationAll rights reserved Slide 26 of 63IM03 - Data Warehousing: What's available on System z today
Cognos 8 BI for Linux on System z
SERVICES
DATA TIER
PRESENTATION TIER
APPLICATION TIER
Broad Range of Capabilities
Open Data Access(Transactional, Warehouses or Modern data sources)
Common Set of Services
Right time Information
Copyright © 2010 IBM CorporationAll rights reserved Slide 27 of 63IM03 - Data Warehousing: What's available on System z today
SELECT DEPT,(SUM) SALARY AS SUMSALFROM BIG_PERSONNEL_TABLEGROUP BY DEPT
BI analyses most often involve aggregates andcalculations such as …
“I want to see all departments where the totalsalary is greater than $xx and if they exceed theprevious year by 15% then …”
Let’s start with a simpleexample … just the sum of the salaries …
DB2
DB2 will do a vast scan of the table… form the aggregate values … and present the result set to the end user
or application…and frequently many business users are
looking at the same data over and over
OLAP – Online Analytical Processing
Copyright © 2010 IBM CorporationAll rights reserved Slide 28 of 63IM03 - Data Warehousing: What's available on System z today
Multidimensional Analytics
Multidimensional Analytics (aka OLAP)– Multidimensional view of the business: customers, products, time and
measures– Analysis of business metrics/measures over time, previous to “current”– Maps well to Star Schema concepts (Dimensions, Facts, Aggregates)
Key Aspects– Dimensions, Hierarchies, Measures, Summarizations– Cross dimensional calculations– Time Series, Parallel Period analysis– Dimensional navigation – slice, dice, drill, pivot
Copyright © 2010 IBM CorporationAll rights reserved Slide 29 of 63IM03 - Data Warehousing: What's available on System z today
Different methods for different uses
OLA
P
Read/write user communities64 bit in-memory fast performanceLarger highly dynamic data sets
--------------------------------------------Dynamic changing dimensions and hierarchy, what-if scenarios, data contribution Common dimensions shared across multi-cube modelsBudgeting and planningPersonal and corporate data sources
Large read only user communitiesModerate ‘focused area’ data setsPre-aggregated static fast results
--------------------------------------------Off-line portable/ partitioned storageRapid startup for advanced business user self service modelingAutomatic time series analysis & trendingPoint in time dataPersonal and corporate data sources
Large user communitiesLarge data setsPlanned performance/optimization facilities
--------------------------------------------Optimized ROLAPZero LatencyHigh volume concurrencyLargest Data VolumesCentralized IT management of information
IBM Cognos PowerCube
Optimized for broad, general purpose BI usage
IBM Cognos TM1
Optimized for write back and high volatility applications
IBM IW CubingServices
Optimized for very large datasets with very large dimensions
Specialized OLAP Modeling ToolsSpecialized OLAP Modeling Tools
Turbo IntegratorTurbo IntegratorMO
DEL
ING
TransformerTransformer Data ArchitectData Architect
OLAP Portfolio from IBM
Copyright © 2010 IBM CorporationAll rights reserved Slide 30 of 63IM03 - Data Warehousing: What's available on System z today
InfoSphere Warehouse on System z
Adds core data warehouse and analytics capability to DB2 for z/OS:– Advanced physical database modeling and design– In-database data movement and manipulation capabilities of SQL Warehouse
Tool (SQW)– Optimize multidimensional reporting and analysis of data with Cubing Services
30
Cognos
MS Excelz/OS Linux on System z
OLTP DB2 DWH DB2
SQW
MDX QueriesCubing Services
IW Design Studio
Copyright © 2010 IBM CorporationAll rights reserved Slide 31 of 63IM03 - Data Warehousing: What's available on System z today
InfoSphere Warehouse on System z - Architecture
DB2 for z/OSDB2 for z/OS
Source SystemsDB2 for z/OSDB2 for z/OS IMSIMS VSAMVSAM RDBMSRDBMS
Data Warehouse Server
Linux on System z Partition / IFL
WebSphere Application Server
WebSphere Application Server
Windows / Linux
Design StudioDesign Studio
Admin ConsoleAdmin Console
Application Server
Cognos 8 BI for System zExcel
Client Layer• Design and admin client• BI / Reporting tools and
apps
MQT AdvisorMQT
Advisor
JDBC/DB2 Connect/Hipersockets
IE/Firefox
Eclipse
SQL
Cubing Services EngineCubing Services Engine
SQW RuntimeSQW Runtime
MDX
MQT Cube Metadata Control DB
Copyright © 2010 IBM CorporationAll rights reserved Slide 32 of 63IM03 - Data Warehousing: What's available on System z today
Cubing Services Supports Microsoft Excel 2007
IBM OLE DB Provider for OLAP
Uses Excel Pivot Table Services
Copyright © 2010 IBM CorporationAll rights reserved Slide 33 of 63IM03 - Data Warehousing: What's available on System z today
Cubing Services Supports Cognos
All Cognos Studios can access Cubing Services
Query Studio Report StudioAnalysis Studio
Integrate cube data into Cognos Dashboards and Reports
Cognos 8 BI uses metadata directly from Cubing Services – no duplicate metadata development
Copyright © 2010 IBM CorporationAll rights reserved Slide 34 of 63IM03 - Data Warehousing: What's available on System z today
Modernize an Existing Reporting ServerTransform it into a DB2 for z/OS Warehouse
34
1. Model your data for OLAP access using the InfoSphere Warehouse Design Studio
2. Populate your star schema using InfoSphere Warehouse SQW Scripts
3. Build one or more Cube structures using the InfoSphere WarehouseDesign Studio
4. Access data through Excel or Cognos MDX queries
InfoSphere WarehouseDesign Studio Cognos
Excel
System z Environment Improved with InfoSphere Warehouse
z/OS Linux on System z
OLTP DB2 DWH DB2
SQW
MDX QueriesCubing Services
1
2
3
4
Copyright © 2010 IBM CorporationAll rights reserved Slide 35 of 63IM03 - Data Warehousing: What's available on System z today
Modernize an Existing Reporting ServerAdd Cubing Services to enhance business user experience
workload contains 30 MDX queries
Cube Server Performance
02000400060008000
1000012000
1.run no cache 1.run cache 2.run cache
cube server cache re
spon
ds ti
me
in s
ec
Series1
Data can remain in one single repository – DB2 for z/OS
Increasing ease of data compliance, security and governance
Analysis can be performed with high speed through in-memory caching
CPU on System z can be reduced when more queries can be answered through the in-memory caching
Copyright © 2010 IBM CorporationAll rights reserved Slide 36 of 63IM03 - Data Warehousing: What's available on System z today
ProblemWasted I/O or resource contention because of multiple programs reading the same transaction data
Scalable Architecture for Financial Reporting (SAFR)
SalesTrans
ProgramB
ProgramA
ProgramC
SAFR SolutionGenerate multiple extracts or reports simultaneously with a single pass of the transaction data
SalesTrans
SAFR ViewsA/B/C
“Scan sharing”
Copyright © 2010 IBM CorporationAll rights reserved Slide 37 of 63IM03 - Data Warehousing: What's available on System z today
IBM Smart Analytics System 9600
Copyright © 2010 IBM CorporationAll rights reserved Slide 38 of 63IM03 - Data Warehousing: What's available on System z today
Solution Editions
Solution Edition for Data Warehousing –Legendary System z quality, priced aggressively to fit within a shrinking budget
Complete Offering:– Solution – based offering– Customized hardware to meet your business requirements– Pre-determined software stack tuned for Data Warehousing
workloads– Maintenance for the hardware
For a highly available, energy efficientData Warehousing infrastructure designed for growth
Created to simplify your IT decision!
Copyright © 2010 IBM CorporationAll rights reserved Slide 39 of 63IM03 - Data Warehousing: What's available on System z today
New! IBM® Smart Analytics System 9600
What’s new:– Delivers a complete end-to-end software, hardware, and services solution for a rapid deployment of business analytics on System z at a
compelling price point.
Features / Business Value:– Provides unprecedented value for an end-to-end analytics solution on System z– Inherits the unique System z quality of service, for new business analytic workloads– Delivers continuous availability to a centralized single view of the business to support enterprise wide business analytics– Leverages customers existing disaster recovery and backup processes to simplify deployment without requiring additional backup and
recovery processes.
Delivers - unprecedented value in deploying new business analytics
Powerful Data Warehouse SoftwareInfoSphere Warehouse on System zCognos 8 BI for Linux on System zDB2 for z/OS Value Unit Edition (MLC Option)DB2 Utilities Suite
z/OS Operating System Stack
Client Benefits:–To deliver enterprise-wide business analytics to operational users –Deliver business insights to the right person, at the right time, in the right context
Copyright © 2010 IBM CorporationAll rights reserved Slide 40 of 63IM03 - Data Warehousing: What's available on System z today
Meeting clients where their information is…
7600Based Power System
9600Based on System z
5600Based System x
40
Consistent value, Right fitted to your needs
IBM Smart Analytics System Offerings Deliver Analytics Value Across Platforms
Faster Time to Value, Faster Business Results
Copyright © 2010 IBM CorporationAll rights reserved Slide 41 of 63IM03 - Data Warehousing: What's available on System z today
IBM Smart Analytics System 9600
How is it different?Secure, Available Business Analytics
– Rapidly delivers analytic information to decision makers at the time of decision.
– New environment for the availability, reliability and scalability necessary to stay aligned with the operational systems
Simplified administration– Appliance-like delivery– Faster deployment at lower cost.– Leverages customers existing disaster recovery, and
backup processes
Proven Operational Characteristics– Extends the qualities of service of System z.– Reduces risk through extending System z manageability
and security across the entire system.
High Value Operational BI– Cost effective way to drive daily operational decisions
What is it? The IBM Smart Analytics System 9600 is an integrated solution of hardware, software and services that enables customers to rapidly deploy cost effective game changing analytics across their business.
Delivering business results in days, not months
Copyright © 2010 IBM CorporationAll rights reserved Slide 42 of 63IM03 - Data Warehousing: What's available on System z today
IBM Smart Analytics System 9600High Value Dynamic Warehousing
InfoSphere Warehouse
Cubing Cubing ServicesServices
Cognos 8 BI
ELTELT
Operational Source SystemsStructured/ Unstructured Data
Data Data WarehouseWarehouse
System z
Implementation Services
DB2 for z/OS VUE(option for MLC)
DB2 Utilities SuiteImage Copy, LOAD, UNLOAD, REORG, etc
PowercubePowercubeServicesServices
Copyright © 2010 IBM CorporationAll rights reserved Slide 43 of 63IM03 - Data Warehousing: What's available on System z today
Optional Value Priced Add-onsTivoli OMEGAMON for DB2 Performance ExpertTivoli Directory ServerInfoSphere Master Data Management Server InfoSphere Information ServerInfoSphere Replication ServerQ-Rep, CDC and Event Publisher eligibleInfoSphere Federation Server plus Classic Federation on System zSPSSTivoli ITCAM, ITUAMCognos Now! For Linux on System zCognos Blueprints for Healthcare, Banking and others…BI User on-boarding application (as proposed for Smart Analytics Cloud)
Powerful Data Warehouse and BI SoftwareDB2 for z/OS Value Unit Edition (primary) V9 - Option for MLCDB2 Utilities Suite V9DB2 ConnectInfoSphere Warehouse on System z V9.5.2IBM Cognos 8.4 BI for Linux on System zIBM Cognos® 8 BI reporting, IBM Cognos® 8 BI analysis, IBM Cognos® 8 BI dashboard, Cognos 8 Go! Mobile, Cognos 8 Go! Search, Cognos 8 Go! Officez/OS Operating System Stack V1.11z/VM 6.1
43
Deeply Optimized by IBM Experts… Flexible Growth…
IBM Smart Analytics System 9600 Software
Copyright © 2010 IBM CorporationAll rights reserved Slide 44 of 63IM03 - Data Warehousing: What's available on System z today
Database Size
Amt Usable Disk*Amt
User Data*
244TB 100TB
122TB 50TB
61TB 25TB
27TB 12TB
10TB 4TB
Data Capacity Sizing
*Usable = Disk for compressed table data, indexes, work files, MQTs etc.
*User Data = Raw, uncompressed, user data
IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements
Copyright © 2010 IBM CorporationAll rights reserved Slide 45 of 63IM03 - Data Warehousing: What's available on System z today
Cognos Workload
Named Users Max Concurrent Users
5000 - 10,000 100
50
5-2500 25
BI Capacity Sizing
IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements
Copyright © 2010 IBM CorporationAll rights reserved Slide 46 of 63IM03 - Data Warehousing: What's available on System z today
Choosing A Deployment Style
Virtual Upgrade Delivery
Standalone Delivery
Server delivered in “appliance-like” fashion
Capacity delivered as a “bolt-on” to existing server(s) or as new server(s) depending on customer needs in a “virtual appliance-like”fashion
Copyright © 2010 IBM CorporationAll rights reserved Slide 47 of 63IM03 - Data Warehousing: What's available on System z today
Scales for Your Unique Needs
Rapidly & easily add new capacity as
information & new analytic capabilities grow
Rapidly & easily add new users as business
needs expand
Building blocks for each growth increment
Deployed in scalable increments to match each type of need
Copyright © 2010 IBM CorporationAll rights reserved Slide 48 of 63IM03 - Data Warehousing: What's available on System z today
Faster ResultsLess Risk
June Jan.
5
4
3
2
Jan.
Build from Scratch
Months Days
Pre-Built
Pre-implementation System Sizing
Acquire Components
Installation & Configuration
Testing & Validation
Faster Time to ValueResults in Days Versus Months
Copyright © 2010 IBM CorporationAll rights reserved Slide 49 of 63IM03 - Data Warehousing: What's available on System z today
IBM Smart Analytics Optimizer
Copyright © 2010 IBM CorporationAll rights reserved Slide 50 of 63IM03 - Data Warehousing: What's available on System z today
IBM Smart Analytics Optimizer
How is it differentPerformance: Unprecedented response times to enable 'train of thought' analyses frequently blocked by poor query performance.Integration: Connects to DB2 through deep integration providing transparency to all applications. Self-managed workloads: queries are executed in the most efficient way Transparency: applications connected to DB2, are entirely unaware of the acceleratorSimplified administration: appliance-like hands-free operations, eliminating many database tuning tasks
What is it? The IBM Smart Analytics Optimizer is a workload optimized, appliance-like, add-on, that enables the integration of business insights into operational processes to drive winning strategies. It accelerates select queries, with unprecedented response times.
Breakthrough Technology Enabling New Opportunities
Capitalizing on the best of relational and the best of columnar databases
Copyright © 2010 IBM CorporationAll rights reserved Slide 51 of 63IM03 - Data Warehousing: What's available on System z today
Smart Analytics Optimizer– Deep DB2 Integration
DB2
DataManager
BufferManager IRLM Log
Manager
SmartAnalyticsOptimizer
Application Interfaces(standard SQL dialects)
Operation Interfaces(e.g. DB2 Commands)
Applications DBA Tools, z/OS Console, ...
. . .
Copyright © 2010 IBM CorporationAll rights reserved Slide 52 of 63IM03 - Data Warehousing: What's available on System z today
Smart Analytics Optimizer- Platform View
DB2
DataManager
BufferManager IRLM Log
Manager
SmartAnalyticsOptimizer
Application Interfaces(standard SQL dialects)
Operation Interfaces(e.g. DB2 Commands)
Applications DBA Tools, z/OS Console, ...
. . .z/OSz/OS
Pric
e/P
erfo
rman
ce
Pric
e/P
erfo
rman
ce
optim
ized
op
timiz
ed
Har
dwar
eH
ardw
are
Copyright © 2010 IBM CorporationAll rights reserved Slide 53 of 63IM03 - Data Warehousing: What's available on System z today
Extreme performance for complex queries
Game Changing PerformanceRapidly delivers information to decision makers through breakthrough technologies providing dramatic performance improvement.
The best of row and columnar store technologies Highly compressed dataCompressed data operationsIn-memory processingMassively parallel architecture
Enables decision makers to submit queries they never dared in the past, that analyze trends, predict outcomes, and produce better business results.
Copyright © 2010 IBM CorporationAll rights reserved Slide 54 of 63IM03 - Data Warehousing: What's available on System z today
Target Market: Business Intelligence (BI)
Characterized by:– “Star” or “snowflake” schema:
– Complex, ad hoc queries that typically• Look for trends, exceptions to make actionable business decisions• Touch large subset of the database (unlike OLTP)• Involve aggregation functions (e.g., COUNT, SUM, AVG,…)• The “Sweet Spot” for IBM Smart Analytics Optimizer!
CityRegion
Store
SALES
Product
Time
Brand
Month
Quarter
Category
Dimensions
Fact Table
Copyright © 2010 IBM CorporationAll rights reserved Slide 55 of 63IM03 - Data Warehousing: What's available on System z today
Database Performance Appliance
Appliance-like, add-on device
Application transparent, install and begin reaping the benefits of higher performance
Rapidly add new applications and user requirements driving immediate value to the bottom line
No need for indices, materialized query tables (MQTs), query plans or query hints
Significantly reduces costs and enables quick time to value
Copyright © 2010 IBM CorporationAll rights reserved Slide 56 of 63IM03 - Data Warehousing: What's available on System z today 56
Orders of Magnitude Faster for Queries
... and its acceleration factor : :
163 s2311 s25 s1593 s35 s 8s5435 s
48
Runtime of queries w/o ISAOpt with ISAOpt
511
12
206
4
1424
Factor
8s
4s
2s5s3s
For customers who have struggled with gaining the required performance out their complex queries of full table scans, multiple compares, and complex logic – the results are astounding!
Beta Customer Results
Copyright © 2010 IBM CorporationAll rights reserved Slide 57 of 63IM03 - Data Warehousing: What's available on System z today
Combining the Smart Analytics offerings in System z:IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer
Complete, end-to-end environment for BI workload Processes ALL queries submitted by end-users Software:
Includes z/OS, DB2 for z/OS, Linux, InfoSphere Warehouse, Cognos, DB2 Connect
Supports: Data movement / ETLEnd user tools (Cognos) / BI queries/reportsData Storage (Data warehouse)
Runs in z/OS-DB2 LPAR, Linux for System z LPAR for ToolingIs an all purpose environment to deploy any BI workload
Workload optimized, appliance-like, add-on to a Data Warehouse on System z MUST connect TO a DB2 for z/OS environment that is running a BI workloadWill enhance a Smart Analytics System 9600Software:
Includes ISAO software running on blades and connects to DB2 for z/OS to enable query routing to ISAO
Supports: (Subset of) complex and long-running BI queries with access to data in a star or snowflake schemaOrder of magnitude acceleration of a SUBSET of queries that are selected/routed to ISAO by DB2 for z/OS
GA June 2010 GA 4Q 2010
For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option
Must Connect to D W
Copyright © 2010 IBM CorporationAll rights reserved Slide 58 of 63IM03 - Data Warehousing: What's available on System z today
Co-locating Transactional and Data Warehouse Workloads
Poughkeepsie Lab / Silicon Valley Lab joint effort
Managing analytic and traditional workload best practices
Using workload manager (WLM) to manage mixed workloads
OLAP vs data warehouse workloads
Data sharing vs non data sharing considerations
Single vs multiple LPAR configurations
Implementation considerations
Benchmark results
SG24-7726
Copyright © 2010 IBM CorporationAll rights reserved Slide 59 of 63IM03 - Data Warehousing: What's available on System z today
Other Significant System z Data Warehouse Redbooks
SG24-7637Enterprise Data Warehousing with DB2 9 for z/OS
REDP-4606Using IBM System z As the Foundation for Your Information Management Architecture
SG24-7813InfoSphere Warehouse: A Robust Infrastructure for Business Intelligence
Copyright © 2010 IBM CorporationAll rights reserved Slide 60 of 63IM03 - Data Warehousing: What's available on System z today
More Significant System z Data Warehouse Redbooks
REDP-3927Workload Management for DB2 Data
REDP-4668IBM zEnterpriseBladeCenter Extension
SG24-6489Best Practices for SAP BI using DB2 9 for z/OS
Copyright © 2010 IBM CorporationAll rights reserved Slide 61 of 63IM03 - Data Warehousing: What's available on System z today
Reference Materials
Relevant System z DW/BI Redbooks:– 3 more currently in progress: Cognos on System z, Data Collocation,
InfoSphere Warehouse
Cognos 8 BI Performance Whitepaper:– http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101437
WLM Magazine Article:– http://www.ibmsystemsmag.com/mainframe/novemberdecember09/tipstechniq
ues/26908p1.aspx
More info:– http://www-01.ibm.com/software/data/businessintelligence/systemz/
Copyright © 2010 IBM CorporationAll rights reserved Slide 62 of 63IM03 - Data Warehousing: What's available on System z today
More information on zEnterprise
IBM zEnterprise Announcement Landing Page: ibm.com/systems/zenterprise196IBM zEnterprise HW Landing Page: ibm.com/systems/zenterprise196IBM zEnterprise Events Landing Page: ibm.com/systems/breakthroughIBM Software: ibm.com/software/os/systemz/announcementsIBM System Storage: ibm.com/systems/storage/product/z.htmlIBM Global Financing: ibm.com/financing/us/lifecycle/acquire/zenterprise/Global Technology Services:
– vanity: ibm.com/services/zenterprise
Copyright © 2010 IBM CorporationAll rights reserved Slide 63 of 63IM03 - Data Warehousing: What's available on System z today
Thank YouMerci
Bedankt
Gracias
Obrigado
Danke
Japanese
English
French
Russian Spanish
GermanNederlands
Brazilian PortugueseArabic
Traditional Chinese
Simplified Chinese
Thai