+ All Categories
Home > Technology > SQL Track: SQL Server unleashed meet SQL Server's extreme sides

SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Date post: 25-May-2015
Category:
Upload: itproceed
View: 239 times
Download: 1 times
Share this document with a friend
Description:
This session is a special one, and yes because of the subject matter but also because of the set-up of the session. It is split in two mini-sessions, one about New Technologies and an introduction to Parallel Datawarehouse: New Technolgies: This part of the session is all about the discovering the extremes of SQL Server. First we will talk about the new SQL Servers In-memory technologies the updatable ColumnStore and Heckaton technology, both pushing the boundaries of SMB machines far beyond what we taught possible 3 years ago. SQL Server PDW: With the new SQL Servers In-memory technologies SQL Server pushes the SMB machines far, for some of us these boundaries are still to close for comfort. So meet the scalable version of SQL Server, obliterating the limits of SMB machines. This is an introduction to SQL Server PDW, the next step in the (r)evolution of SQL Server, capable of running high performance data warehouse queries on big data even offering seamless integration with Hadoop using PolyBase.
Popular Tags:
40
SQL Server unleashed: Meet SQL Server's Extreme sides Karel Coenye
Transcript
Page 1: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

SQL Server unleashed: Meet SQL Server's Extreme sidesKarel Coenye

Page 2: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

The world of data is changing

Page 4: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

New Questions, More data

Page 5: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Do more with less

Page 6: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Previous Limitations

Page 7: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Urban Myths

Page 8: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

But… Do you know the challenges

Page 9: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Data is the Key

Page 10: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

PDW vs. SMB

Page 11: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

SMB on Steroids

Page 12: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

OLTP

Page 13: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Hekaton

Page 14: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

SMB

Page 15: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

DWH’s

Page 16: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Next Gen DWH Performance

Page 17: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Updateble ColumnStore

Page 18: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Enter Big Data

Page 19: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Hadoop

Page 20: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

ScaleStandard Enterprise Fasttrack PDWReliable SMB Reliable Business

Critical SMBReference Architecture

High End MPP DWH

Needs Maintenance hours

Online Maintenance24/7/365

Based upon Enterprise edition

High end Data marts and EDWs

Software Only Sofware Only Architecture (hard and software)

Appliance

Scale Up Scale Up Scale Up DWH Scale outOLTP OLTP / /Small DWH DWH up to 10’s of

TBData Marts and small to midsize DWH

Up to PB’s

Page 21: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

MPP - PDW

Page 22: SQL Track: SQL Server unleashed meet SQL Server's extreme sides
Page 23: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

MPP - APS

Page 24: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Hardware

Page 25: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Virtualization

Page 26: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Yes… But does it work with Excel…

Page 27: SQL Track: SQL Server unleashed meet SQL Server's extreme sides
Page 28: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Polybase

Control Node Compute Node

Name Node Data Node

PDW Appliance

Compute Node

Data Node

Data Node

Data Node

Data Node

Data Node

Data Node

Data Node

Hadoop Cluster

Page 29: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Ok sounds cool, but what does it do

Control Node

Compute Node

Compute Node

Compute Node

Compute Node

Name Node

Data Node

Data Node

Data Node

Data Node

PDW

Page 30: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Ok so you said it’s fast… but now show me

Page 31: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Load performance

PDW

DEV SQL -> SQL

PROD TeraData -> SQL

0 10 20 30 40 50 60 70

Loading 100 milion rows in minutes (shorter is better)

Page 32: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Data Pumps• Reading 132 MB/s from disk = 8 GB

per minute• Reading 2 DVDs per minute

Page 33: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Scaling• Scales Lineair– Demo PDW has only 2 units

• There is a pdw development edition– but it is a developer appliance! For an

msdn ultimate subscription, there is 1 pdw developer license.

Page 34: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Future Proof• DWLoader is the fastest load mechanism• Transformations can be done using CTAS

statements• Loading from remote server:

– Any remote server connected with infiniband switch– Multiple servers allowed

• Pollybase– Ready for big data

• Can use existing SSIS

Page 35: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

DEMO

Page 36: SQL Track: SQL Server unleashed meet SQL Server's extreme sides
Page 37: SQL Track: SQL Server unleashed meet SQL Server's extreme sides
Page 38: SQL Track: SQL Server unleashed meet SQL Server's extreme sides
Page 39: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Follow Technet Belgium@technetbelux

Subscribe to the TechNet newsletteraka.ms/benews

Be the first to know

Page 40: SQL Track: SQL Server unleashed meet SQL Server's extreme sides

Belgium’s biggest IT PRO Conference


Recommended