Post on 24-Dec-2014
description
transcript
DATA WAREHOUSING
AGENDA
IntroductionNext Generation Performance and AvailabilityInsights for EveryoneFastest Time to Solution at Lowest Cost
IntroductionData Warehousing with a Vision
IMAGINE …
You’re at a station in an unfamiliar city on business and your train is delayed
Your smart phone, aware of the delay, alerts you to the fact that you will be late for your scheduled meetingIt offers to direct you to a bus stop, calculating that you can still arrive on time by taking the next bus
Instead you decide use an app on your phone that contacts local cab firms and automatically orders a car from the company that can get to you fastest
The cab locates you by GPS, gets you to your meeting on time, and the fare is paid automatically via your phone
GETTING THEREIt’s all about the data warehouse
Availability
Performance
Scale
Delivery
Scale to house massive volumes
of data from multiple sources
Answer complex queries almost
instantly
Ensure that the service remains available at all
times
Deliver accurate information to any device, any time, and any
place
GETTING THEREWhere are we now?
Transport for London has already implemented a Microsoft solution that offers real-time journey options through mobile devices, making it faster and simpler for travellers to find their way around in this very large city“Portable and mobile devices in people’s hands are a great way to help customers benefit from our data. Our challenge is to get information to people in a way that helps them make their journeys better, faster, and less stressful.”
- Michael Gilbert, Chief Technology Officer, Transport for London
WHY SQL SERVER FOR DATA WAREHOUSING?
… the power and scalability to handle the largest, most demanding workloads
…the reliability to ensure virtually 100% availability
Plus …
Increased productivity
with integrated
tools
Credible and consistent data with built-in EIM
Easy to use, familiar BI
tools
Reference architectures and appliance
options
Fastest time to solution
Low cost of acquisition,
operation, and maintenance
Fast insights with built-in analysis and
reporting
End-to-End Data Warehousing PlatformDriving Analytics on any Data
NON RELATIONAL
100111
DATA MANAGEMENT
SHAREAND GOVERN
DISCOVERAND RECOMMEND
TRANSFORMAND CLEAN
ANALYTICS
DATA ENRICHMENT
OPERATIONAL
SELF-SERVICE MOBILE
PREDICTIVE
REAL-TIME
COLLABORATIVE
MA
RK
ETPLA
CE
Exte
rnal
Data
and
Serv
ices
RELATIONAL MULTIDIMENSIONAL STREAMING
LEADERS IN BOTH DATA WAREHOUSING AND BI
Challengers
Leaders
Niche players Visionaries
Completeness of Vision
Abili
ty t
o
Exe
cute
Gartner magic quadrants
“Microsoft exhibits one of the best value propositions on the market with a low
cost and a highly favorable price / performance ratio”- Gartner, February 2012
[Gartner, Inc., Magic Quadrant for Data Warehouse Database Management Systems Magic Quadrant, Mark A. Beyer, Donald Feinberg, Merv Adrian, Roxane Edjlali, February 6, 2012. The Magic Quadrant is copyrighted 2012 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
Challengers
Leaders
Niche players Visionaries
Completeness of Vision
Abili
ty t
o
Exe
cute
Data Warehousing Business Intelligence
As of February 2012 As of February 2012
MEETING THE CHALLENGES OF TODAY AND TOMORROWBenefit from a roadmap that enables you to tackle today’s issues and be prepared for the challenges of the future
Data explosion – Harness ever increasing volumes of data to gain insights and drive solutions
Multiple sources of data – Include all of the data, from unstructured ‘big data’ to cloud-based data, and obtain new and different types of insightsDevelopment and Implementation – Experience a fast time to solution and low TCO by using tested reference architectures and pre-built appliances
Pervasive business intelligence – Liberate your data and empower workers by opening up BI to everyone
Vendor lock-in – Choose the hardware that suits you best and avoid the risks of being locked into a specific hardware vendor
Manageability – Reduce management effort and increase productivity with integrated tools
DATA WAREHOUSING WITH MICROSOFT
11
Extend BI to all users
Insights For Everyone
Enterprise Ready
Breakthrough Performance with Mission Critical
Availability and Scale
Lowest Total Cost of Ownership
Fastest Time To Solution At Lowest
Cost
Breakthrough Performance with
Mission Critical Availability and Scale
Enterprise Ready
BREAKTHROUGH PERFORMANCE AT MASSIVE SCALE
Next-Generation Performance
Key Features at a Glance
Enterprise Scale
“
”
“
” – Wolfgang Kutschera, bwin.party
Enterprise Ready
ENTERPRISE CLASS AVAILABILITY
“
” - Paul Gleason, VP SQL Administration
Team
Key Features at a Glance
•
•
•
•
COMPLEX QUERIES AT HIGH CONCURRENCY
“Parallel Data Warehouse runs complex queries about 160 times faster, providing a data load over 1 Tb/Hour
and fully integrates into a complete BI Solution”
Benefits
• Incredible performance for highly complex queries
• High-concurrency environments
responsiveness and agility
maximum availability
Insights for EveryoneExtend BI to All Users
ANALYSIS AND REPORTING AT NO EXTRA COSTProven reporting and analysis tools
Multidimensional data models for ‘traditional’ data analysis
“
”- Tim Lum, Head of BI, Kelkoo
Intuitive report authoring
SQL Server Analysis Services
SQL Server Reporting Services
Tabular data models make it fast and easy to analytics get up and running
Comprehensive report management and delivery
Interactive, visual reporting with Power View
Benefits
Benefits
SELF-SERVICE BUSINESS INTELLIGENCEUse the tools that you already own
Excel-based, in-memory data aggregationSlice and dice data modelsShare data models in SharePoint
SharePoint-based interactive visual reportingCreate visualizations from tabular data models
Power View
PowerPivot
“
”- Dong-Soo Woo, Head of IT Planning,
- Heungkuk
CREDIBLE, CONSISTENT DATA A complete enterprise information management suite
Integration Services
Data Quality Services
Master Data Services
Data cleansing and de-duplication
Accuracy, trustworthy data
Extract, transform, and load data from any industry source
“
”- Dalila Kerkouba, IT Manager,
- Areva
BIG DATA AND COULD INTEGRATIONImprove insights by including all of the data
Harness unstructured data such as Word documents, PDF files, pictures, videos, RFID data, and sensor data
Hadoop solutions for Windows Server and Windows Azure
Connectors move data between SQL Server data warehouse and Hadoop
Big Data
Integrate on-premises data with data stored in the could to deliver the whole picture
Combine internal and external data and services with SQL Azure
Use familiar tools such as Excel and PowerPivot to gain insights
Cloud Data
Fastest Time to Solution at Lowest Cost
Lowest TCO
LOWEST TOTAL COST OF OWNERSHIPSave hundreds of thousands on new licence and maintenance costs by migrating to SQL Server
Fastest time to solution with Appliances or RAs
Save hundreds of thousands of dollars on new license and maintenance costs
Monitor HW and SW with single tool
Key components of Business Intelligence and Enterprise Information Management at no extra cost
Open industry hardware your staff already knows
“
” -Dale Danilewitz, CIO, AmerisourceBergen
Save Hundreds of Thousands of Dollars
FASTER DEPLOYMENT TIME
A major component of TCO for a data warehouse is the cost of planning and deployment …
DBMS Installation
Configuration
Security
Integration
Total
SQL Server
22 34 18 14 88 minutes
Oracle 48 165 38 106 357 minutes
SQL Server and Oracle Database deployment times in minutes *
* Installation – Initial installation of the database software on the server Configuration – Creation of database schema and specification of database instance settings Security – Definition of security settings for the database Integration – Integration of the database with the infrastructure, including backup processes
“
” -Staffan Zackrisson, President and CEO, Volvo Aero
… SQL Server has a faster deployment time than major vendors
REFERENCE ARCHITECTURES AND APPLIANCESChoice of Form Factors: Eliminate planning and deployment times
Pre-tested and tuned reference architectures based on commodity hardware from major partners
Certified with 7 open industry standard HW partners
“
.”- Jordan Zommick, Executive Director of Enterprise Architecture and Development, Las
Vegas Sands
Fast Track Data Warehouse
High-performance, high-concurrency data warehouse appliances
Co-engineered with open industry standard hardware
Parallel Data Warehouse
Monitor Data Warehouse hardware and software through single tool: System Center
TAKE CONTROLBetter manageability, greater productivity, lower TCO
Integrated tools enable management of all aspects of your data warehouse with minimal trainingIncrease backup speeds and reduce backup storage with backup compressionUp to 15,000 partitions, enabling you to better manage the data lifecycle
“By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.”
- Mark Underwood, Second Vice President, Protective Life Corporation
Summary
Breakthrough Performance with Mission Critical Availability and Scale Insights for everyone The fastest time to solution at the lowest cost
APPENDIX (DETAILED SLIDES)
DATA WAREHOUSING AT ANY SCALE
A choice of form factors and hardwareStart small and grow
Self Build
Business Data
Warehouse
Fast Track Reference Architectur
es
Parallel Data
Warehouse Half Rack
Parallel Data
Warehouse Full Rack
Effort to Build
Variable Very low Moderate Very low Very low
Capacity Variable 5TB 14TB – 95TB 80TB 500TB +
Concurrency
Variable Light Light – high Very high Very high
Query Complexity
Variable Medium Medium – high
Very high Very high
Architecture
SMP SMP SMP MPP MPP
Form factor
Software only
Appliance Reference Architecture
Appliance Appliance
SQL SERVER DATA WAREHOUSE OPTIONSFlexibility and Choice
29
Customers acquire and tune the software to their own hardware without guidance.
Offerings• SQL Server 2012• SQL Server 2008 R2
Effort to build
Tuning
Flexibility in configuration
Initial Price Investment
Variable to High
Mid
High
Low
Deliver hardware and software separately containing pre-tested, pre-tuned configuration best practices
Offerings• Fast Track for SQL
Server 2012• Fast Track for SQL
Server 2008 R2
Effort to build
Tuning
Flexibility in configuration
Initial Price Investment
Low
SW
Low - Mid
Mid
HW
Appliances deliver a solution with hardware and software already integrated, tested, tuned, configured
Offerings• Parallel Data
Warehouse• BDW, SDW• HP Factory Express
Effort to build
Tuning
Flexibility in configuration
Initial Price Investment
Mid - High
Low
Low
Low
SOFTWARE
REFERENCE ARCHITECTURES
APPLIANCES
Tuning & Optimization
Procure or Use Existing HW& Support
Installation
Procure Software & Support
ConfigurationTuning & Optimization
Installation
Configuration
Tim
e t
o
Solu
tion
Installation
SQL SERVER DATA WAREHOUSE OPTIONSFlexibility and Choice
Offerings• SQL Server 2012• SQL Server 2008
R2
Offerings• Fast Track for Server
2012• Fast Track for SQL 2008
R2
Offerings• Parallel Data Warehouse
• BDW, SDW• HP Factory Express
Tuning & Optimization
Procure or Use Existing HW& Support
Procure Software & Support Procure Appliance & Support
High
Pri
ce
High
Optional if have HW already
SOFTWARE
REFERENCE ARCHITECTURES
APPLIANCES
Benefits
SOFTWARESelf-build Data Warehouse with SQL Server 2012
“
” - Bruce Kenny, Executive Vice President
Key Features
Benefits
REFERENCE ARCHITECTURESGuided-Build Data Warehouse with Fast Track
“
” Hasan Rahmi Atılganer, Data Process
ManagerKey Features
•
•
“
” Tom Grina, CFO
Benefits
•
•
APPLIANCESPre-Built Data Warehouse with Parallel Data Warehouse
Key Features
•
•
•
•
•
“
” Peter van Manen, Managing Director
Benefits
APPLIANCESPre-Built Small Data Warehouse with BDW, SDW
Key Features
Required 9’s of availability
Optimized on the latest industry standard hardware
SSD optimized
WHAT’S NEW IN FAST TRACK FOR SQL SERVER 2012
10-100x faster
“We anticipate huge data growth across all of our properties, and SQL Server Fast Track Data Warehouse gives us confidence that we can meet any scalability needs that arise.”
- Jordan Zommick, Las Vegas Sands
Half-rack appliances now available
Best in class manageability
Scale your applications from SQL Server to Parallel Data Warehouse
WHAT’S NEW IN SQL SERVER PARALLEL DATA WAREHOUSE AU3
10x performance improvement
Data Warehousing Customer Momentum
Don Wood, Manager of Database Administration
Jordan Zommick, Executive Director of Enterprise Architecture
Fariba Anderson Vice President of Lottery IT
- David Smith, Director, Software Architecture
- Rajesh Babu, Sr Director Global BI
-Matt Cunningham, ICT
-Dale Danilewitz, Chief Information Officer
-Mark Underwood, Second Vice President
-Staffan Zackrisson, President and CEO
CASE STUDY- McLaren Electronic Systems
McLaren Electronics Systems is part of the McLaren Group, a private group of companies that includes McLaren Racing.
A platform to capture, store, and access large volumes of data for Formula One racing circuit
A Parallel Data Warehouse solution that can scale out on commodity servers to hundreds of terabytes
Store and analyze hundreds of billions of rows of dataAnalyze real-time racing conditions
Requirement:
Solution:
Results:
“
” Peter van Manen, Managing Director
CASE STUDY- DirectEdge
DirectEdge is the fourth largest US based exchange after NYSE, NADAQ, and BATs. It handles 10% of US trading.
A platform that could grow with the data, with up to 2 TB of new data per month
A Parallel Data Warehouse solution that can scale out on commodity servers to hundreds of terabytes
Test results met or exceeded projected needs for scalePower users can explore PDW directlyFinance analysts can compare customer trading activities themselves
Requirement:
Solution:
Results:
CASE STUDY- Volvo Aero
Volvo Aero, a subsidiary of AB Volvo, develops and manufactures high-technology components for aircraft, rocket, and gas turbine engines.
Need to store, access, and share data must on a secure, scalable, and reliable infrastructure.
SQL Server Data WarehousingSharePoint ServerBiztalk Server
Rely on identical data across all stages of product design, development, and production.Easily and quickly disseminate order and product changes and updates.Increase user satisfaction.
Requirement:
Solution:
Results:
“
” -Staffan Zackrisson, President and CEO, Volvo
Aero
CASE STUDY- Protective
The Protective Life Corporation offers insurance and investment products throughout the United States and Canada.
Reducing IT costs of existing DW platform
SQL Server Data WarehousingSharePointOffice
Migrate from Teradata system End users perform own analysis without ITIncreased processing speed by 15%Reduced IT administrative and maintenance costs of $600,000 over two years
Requirement:
Solution:
Results:
“By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.”
- Mark Underwood, Second Vice President, Protective Life
Corporation
CASE STUDY- Universal Music Group
Universal Music Group is the world’s leading recording company. A subsidiary of Vivendi, UMG earned €4.4 billion (U.S.$6.1 billion) in revenue in 2010.
Existing DW too expensive to maintainNeeded flexible, affordable DW with mission critical performance and reliability
Fast Track Data Warehouse
Cuts cost by more than 97% and increase flexibilityRenders reports 92% fasterDelivers 100% uptime
Requirement:
Solution:
Results:
“Our IBM DB2 solution was very expensive in terms of hardware and software licensing costs. We just added 13 terabytes of capacity to our SQL Server Fast Track Data Warehouse at a minimal cost and we can also add memory for much less money than we could with our previous solution.”
- Rajesh Babu, Sr Director Global BI
“In the last 18 months, our SQL Server Fast Track Data Warehouse has delivered 100 percent uptime. We have not even had one serious memory alert.”
- Rajesh Babu, Sr Director Global BI
CASE STUDY- Stein Mart
Stein Mart is a growing department store chain that offers discounted fashion merchandise for men and women
A platform for up-to date data analysisExisting DW had performance and cost issues
Fast Track Data WarehouseSharePointOffice
Save $600,000 a year in technology costsImprove Analysis and ForecastingSpeed Reporting Process
Requirement:
Solution:
Results:
“With SQL Server Fast Track Data Warehouse, we can look at our entire transaction history and do market analysis and business forecasting, which we could not do previously. Now, for example, we will be able to study the correlation between promotions and sales.”
Ilan Wajsman, Data Systems Manager
“We will be able to eliminate 95 percent of the monthly costs related to the previous system,” says Wajsman.”
Ilan Wajsman, Data Systems Manager
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.