Cloud Computing: SQL Data Services

Christoph PletzSenior ConsultantTrivadis AG

Meinrad WeissPrincipal ConsultantTrivadis AG

Technologiekompetenz: Microsoft , Oracle, IBM, Open Source

BusinessIntelligence

Business

Communication

Applic

atio

n

Devel

opm

ent

ManagedServices

Bestehende IT KundenInfrastruktur

Training

Trivadis Facts & FiguresCurrently 13 locations with over 500 employees

Baden, Basel, Bern, Brugg, Lausanne, Zurich Düsseldorf, Frankfurt, Freiburg, Hamburg, Munich, Stuttgart Vienna

Since January 2008, the Trivadis Group has a qualified majority of shares in MIK AG, based in Brugg

Financially independent and sustainably profitable

Key figures in 2007Consolidated incomeCHF 98 million / EUR 60 millionServices for more than 600 clients in over 1‘500 projectsOver 125 Service Level AgreementsMore than 5'000 training participants per year Research budget: CHF 6.0 million / EUR 3.6 million

Agenda

Azure Overview

SQL Data Services (SDS)

SQL Server ↔ SDS Compatibility

SDS Client Applications

Wrap Up

Visual Studio & .NET

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

• Designed to be: “File System in the cloud” • lowest cost efficient solution for simple

data storage and retrieval in the cloud • can store

• Queues• Blobs• ISAM style, simple Tables

(non-relational)

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

• Designed to be: “File System in the cloud” • lowest cost efficient solution for simple

data storage and retrieval in the cloud • can store

• Queues• Blobs• ISAM style, simple Tables

(non-relational)

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

Database Data Sync Reference Data

ETL Data Mining Reporting

Database Choices

Low-cost and zero friction addresses web/dept workloads

Target is 3 to 10 GB Databases

High compatibility with existing SQL Server offering

Reso

urc

es

Dedicated

Shared

Low High“Friction”/Control

SDS (RDBMS)

Value Props:

Auto HA, Fault-ToleranceFriction-free scaleSelf-provisioningHigh compatibility

Virtual DB server Logical user database

(LDB) Resource governance @

LDB Security @ LDB

Value Props:

XSPs, Server OpsSQL CLR100% compatibility

Roll-your-own HA/DR/scale

Hosted Hosted SQL Server or

other Resource governance @

VM Security @ DB Server/OS

On-premise SQL Server or other s/w on-

premise Resource governance @ machine Security @ DB Server/OS

Value Props:Full h/w control –

size/scale100% compatibilityRoll-your-own

HA/DR/scale

From CTP 1 to now

Storage

SQL, Tablesand Rows

T/SQL via TDS

Authority, Container,

Entity

SOAP/REST

Simple Tables, Blobs,

Queues

SOAP/RESTMassive

ArchitecuralChange Key-Value DB

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

Authority, Container,

Entity

SOAP/REST

From CTP 1 to now

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

SOAP/REST

Data Services

T/SQL via TDS T/SQL via TDS

Database

Server

Service Provisioning ModelEach account has

a billing relationship with Microsoftowns one or more virtual servers

Each server has one or more databases including virtual mastereach database limited in size one or more logins

Each database has one or more SQL users

Account

Server

DatabaseServer=server1.data.database.windows

.netDatabase=testDBLogin=HansM[@server1] (maps to

testuser)

SQL Server vs. SQL Data Services • Master

• AdventureWorks• Northwind• Pubs

• Master

• Pubs• Northwind

• Adventureworks

SQL Server

• Master• AdventureWorks• Northwind• Pubs

SQL Data Services

Instances and Databases

One SQL Server instance per physical machineMultiple logical databases per instance

Randomly distributed by infrastructureRessource sharing

Scalable HA technologyAutomatic replication and failover

Provisioning, metering and billing infrastructure

Machine 5

SQL Instance

SQL DBs

DB5 DB1 DB3 DB2

Provisioning (databases, accounts, roles…), Metering, and Billing

Machine 6

SQL Instance

SQL DBs

DB1 DB6 DB2 DB3

Machine 4

SQL Instance

SQL DBs

DB3 DB4

Machine 7

SQL Instance

SQL DB

DB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load Balancing

HA – Reading DataSelect * from Customer

Primary

New Primary

Secondary

Secondary

HA – Writing DataUpdate CustomerSet Priority = 1

Secondary

Secondary

Primary

TDS GatewayFront-end Node

Protocol Parser

Gateway Logic

TDSSession

1

Front-end NodeProtocol Parser

Gateway LogicTDS

Session 2

Architecture

Master Cluster

Master Node

Data Node Components

Partition Manager

Master Node

Data Node Components

Partition Manager

1

2

4

5

6

7

8

Utility Layer

Account Database

Billing/Usage

Database

Service Platform

Monitoring

Load Balancing

NodeProvisionin

g

Roles

3

Machine 5

SQL Instance

SQL DB

DB5 DB1 DB3 DB2

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Machine 6

SQL Instance

SQL DB

DB1 DB6 DB2 DB3

Machine 4

SQL Instance

SQL DB

DB3 DB4

Machine 7

SQL Instance

SQL DB

DB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

ConnectDB2

Authority, Container,

Entity

SOAP/REST

From CTP 1 to now

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

T/SQL via TDS T/SQL via TDSDitto

?

Example of SQL CompatibilityIn Scope for v1 (likely)

Tables, indexes and viewsStored ProceduresTriggersConstraintsTable variables, session temp tables (#t)…

Out of Scope for v1 (likely)

Distributed TransactionsDistributed QueryCLRService BrokerSpatialPhysical server or catalog DDL and viewsTraditional “Backup/Restore”##t ?

Management Tools

API for provisioningWeb

SQL Server Management Studio (SSMS)

Basically available, but will have obviously some restrictions

e.g. no sp_configure

Standard Query Tools

Security Model

Uses regular SQL security modelAuthenticate logins, map to users and rolesAuthorize users and roles to SQL objects

Limited to standard SQL Auth loginsUsername + password Future

AD Federation (Geneva)Windows Live ID

EncryptionTDS supports SSLNo database encryption at all in V1

Transparent Database Encrytion Encryption Functions

How Scalable is SDS?

Scalability and/or consistency?ACID (Atomicity, Consistency, Isolation, Durability)

Write n nodes on CommitRead from the max n nodes

BASEBasically available, soft state, eventually consistentWrite n nodes on Commit synchronize more nodes laterRead on more than the n nodes

SDS = (a very) ACID modelWrites on 3 nodes on CommitReads form 1 node

Scalability

Scale PerformanceSDS fabric can switch the primary node for a database to a less busy nodeSDS may throttle your session if it takes too much resourcesBYOP (bring your own partitioning)PYON (Pay for your own physical node(s))

Scale Size of DatabaseCurrent offering is targeted at departmental databasesBYOP (bring your own partitioning)

SDS Client Applications

Clients connect directly to a databaseCannot hop across DBs

Any database client library for SQL Server can be also used for SDS

ODBC, OLE DB, ADO.NET Provider for SQL Server

ADO.NET Entity FrameworkADO.NET Data Services (Astoria)

LINQ to SQL

PHP native SQL Client…

Cloud

SDS Client Apps

SDS Database

TDS + TSQL Model

Windows Azure ComputeREST

(Astoria)ADO.Net* +

EF

Browser

HT

TP

Application

SQL Client*TD

S

* Client access enabled using TDS for ODBC, ADO.Net, OLEDB, PHP-SQL, Ruby, …

Data

Cen

ter Web Srv

SQL Client*

HT

TP

+R

ES

T

Application

REST Client*

Web App

SQL Client*

HT

TP

+S

OA

P

Application

SOAP Client*

Tabular Data Stream (TDS)

“Code far” scenarioTDS is not designed for high latency networks

Recommendation Batch SQL statements Use Functions/Stored Procedures

Table valuein parametersare very handy

Extending SQL Data Platform to Cloud

SQL Data Services (SDS)Database-as-a-Service

Data SyncReference Data

Reporting

Business Intelligenc

e

Symmetric Programming Model Data Hub Aggregation

Data Hub / Sync Services

On Premises Assets and Data

Mobile Users

SQL Services (Opportunities and Futures)

ScalabilityPartitioned databasesGeo-location and geo-redundancy

FlexibilityDistributed querySupport for multiple levels of hardware and software isolation

SecurityFuture AD FederationWLID, etc as alternate authentication protocolsEncryption

Release Plan

Invitation CTP – On-board invitation-only customers + some current

Public CTP – On-board all early adopters

Commercial Availability with Windows Azure in 2009

MIX ‘09

TechEd

InvitationCTP

Public CTP

Commercial Availability

Migration

Mar 09

May 09 Jul 09 Nov 09

Sep 09

Apr 09

Jun 09 Aug 09

Oct 09

PDC

InternalAdoption

Quick Wins with SDSHigh Availability

Including Data Hub ScenarioFast and easy Deployment

Ideally “Code near” scenario with Web apps

Well known programming modelLow learning curve (you can learn it today)

ReliabilityConfidence that data will not be lostReplication, back-up

Defined SLA, at which Cost (?)

Want to Know More?

Team Bloghttp://blogs.msdn.com/ssds

MSDN Development Centerhttp://msdn.microsoft.com/en-us/sqlserver/dataservices

Register @ the Azure start portalhttp://www.azure.com

Your Benefits today

•30%•30%• 3days

Limited Offer Only

on SQL Server Trainings

on Application Builder

TAB Pilot Project for free

Your MSDN resourcescheck out these websites, blogs & more!

PresentationsTechDays: www.techdays.chMSDN Events: http://www.microsoft.com/switzerland/msdn/de/presentationfinder.mspxMSDN Webcasts: http://www.microsoft.com/switzerland/msdn/de/finder/default.mspx

MSDN EventsMSDN Events: http://www.microsoft.com/switzerland/msdn/de/events/default.mspxSave the date: Tech•Ed 2009 Europe, 9-13 November 2009, Berlin

MSDN Flash (our by weekly newsletter)Subscribe: http://www.microsoft.com/switzerland/msdn/de/flash.mspx

MSDN Team BlogRSS: http://blogs.msdn.com/swiss_dpe_team/Default.aspx

Developer User Groups & CommunitiesMobile Devices: http://www.pocketpc.ch/Microsoft Solutions User Group Switzerland: www.msugs.ch.NET Managed User Group of Switzerland: www.dotmugs.chFoxPro User Group Switzerland: www.fugs.ch

Your TechNet resourcescheck out these websites, blogs & more!

PresentationsTechDays: www.techdays.ch

TechNet EventsTechNet Events: http://technet.microsoft.com/de-ch/bb291010.aspx Save the date: Tech•Ed 2009 Europe, 9-13 November 2009, Berlin

TechNet Flash (our by weekly newsletter)Subscribe: http://technet.microsoft.com/de-ch/bb898852.aspx

Schweizer IT Professional und TechNet BlogRSS: http://blogs.technet.com/chitpro-de/

IT Professional User Groups & CommunitiesSwissITPro User Group: www.swissitpro.ch NT Anwendergruppe Schweiz: www.nt-ag.ch PASS (Professional Association for SQL Server): www.sqlpass.ch

Save the date for tech·days next year!

7. – 8. April 2010Congress Center Basel

Classic Sponsoring Partners

Media Partner

Premium Sponsoring Partners