The Data Aware Enterprise

Andrew Fryer

Microsoft UK

agenda

• mainframe

• Client server

• N-tier

• S&S

• Cloud db

History of Data Architecture

What does the enterprise need from a database?

Secure

Reliable

Fast & Scalable

Interoperable

Store any type of Data

Manageable

Business Intelligence

Requirements

IntegrityIntegrityConfidentialConfidentialityity

ReliabilityReliability

Security

Surface Area Surface Area ReductionReduction

Security Security updatesupdates

Kerberos/ Kerberos/ NTLMNTLM

Password Password Policy Policy EnforcementEnforcement

End Point End Point AuthenticatioAuthenticationn

Credentials Credentials always always encryptedencrypted

Single sign-Single sign-onon

Native Native cryptographic cryptographic capabilitiescapabilities

Transparent Transparent Data Data EncryptionEncryption

Extensible Key Extensible Key ManagementManagement

Principals andPrincipals andSecurablesSecurables

RolesRoles

Catalog Catalog securitysecurity

Execution Execution ContextContext

User SchemaUser SchemaSeparationSeparation

All Action All Action AuditAudit

Audit actions Audit actions toto

File, File,

Windows Windows

Application Application LogLog

Security logSecurity log

Capture and Capture and audit DDL audit DDL activitiesactivities

SecureSecureConfigurationConfiguration

GranularGranularAuthorizationAuthorization

Rich Rich AuthenticationAuthentication

AuditingAuditingData Data EncryptionEncryption

Reliability

Database Mirroring

Logical RecoveryStandby

Log Shipping

Log Shipping with Restore Delay

ProductionDatabase

Replication

Clustering

WarmStandby

HotStandby

DatabaseScale OutFor Queries

Backup

Multiple features work together to provide a coherent reliability scenario

Scalability

• Hot add extra resources

• Performance Tuning Management

• Benchmarks

Performance

• Assign users process to groups and pools

• Dynamic

• Limits only apply when the server is under pressure

Resource Management

Database Server

Min memory 10%Max memory 20%Max CPU 20%

Min memory 10%Max memory 20%Max CPU 20%

Admin groupAdmin group

Batch Jobs

Admin tasks

OLTP groupOLTP group

OLTP activity

Report groupReport group

Specificreports

Executivereports

Max CPU 90%Max CPU 90%

Application poolAdmin pool

Performance TPC-E

Rank System tpsE Database Operating SystemProcessors /

Cores / Threads

1  NEC Express 5800 / 1320Xf (32SMP)

1,126.49  Microsoft SQL Server 2008 Enterprise Edition  

Microsoft Windows Server 2008 Intanium based Systems  

32 / 64 / 64 

2  Unisys ES7000/one Enterprise Server (16s)

660.85  Microsoft SQL Server 2005 Enterprise Edition (x64)  

Microsoft Windows Server 2003 Datacenter Edition  

16 / 32 / 64 

3  IBM System x3850 M2 479.51  Microsoft SQL Server 2008 Enterprise x64 Edition  

Microsoft Windows Server 2008 Enterprise x64 Edition  

4 / 16 / 16 

4  IBM System x3850 M2 419.80  Microsoft SQL Server 2005 x64 Enterprise Edition SP2  

Microsoft Windows Server 2003 Enterprise x64 Ent. R2  

4 / 16 / 16 

5  Dell PE2900 268.00  Microsoft SQL Server 2005 x64 Enterprise Edition SP2  

Microsoft Windows Server 2003 Enterprise x64 Ent. R2  

2 / 8 / 8 

• Time & date data types

• Full text search

• Filestream

• Spatial

Store Any Type of Data

Advantages

Challenges

• Integrated management

• Data-level consistency

• Poor streaming API support

• Performance deterioration as file size increases

Store BLOBs in Store BLOBs in DatabaseDatabase

Store BLOBs in Store BLOBs in DatabaseDatabase

DBDB

ApplicationApplication

BLOBsBLOBsBLOBsBLOBs

• Cheap• Streaming

Performance

• Complex application development & deployment

• Integration with structured data

Use File Use File ServersServersUse File Use File ServersServers

DBDB

ApplicationApplication

BLOBsBLOBsBLOBsBLOBs

• CheapCheap• Streaming Streaming PerformancePerformance

• Integrated Integrated managementmanagement

• Data-level Data-level consistencyconsistency

Need to support any Need to support any File SystemFile System

Store BLOBs in Store BLOBs in DB + File DB + File SystemSystem

Store BLOBs in Store BLOBs in DB + File DB + File SystemSystemApplicationApplication

BLOBBLOBBLOBBLOB

DBDB

FileStream

Spatial Data

• Standards – official and de facto,

• Third Party Support

• Hardware e.g. NUMA,

Interoperability

• Compression

• Configuration Servers

• Policy Management

• Audit

• Performance Data Collection

• Resource Management

Manageable

• Integration

• OLAP

• Reporting

• Office Integration

Business Intelligence

Processes, policies and technologies to produce and

maintain accurate master data for transactional and

analytic applications across the enterprise

What is Master Data Management?

…One version of the truth

What Does MDM Do?

• MDM Hub

• Open interfaces

• Incremental implementation

• Distributed, and Federated

• Hierarchy Management is a critical capability

• Data Stewardship is a key success factor

• Analytical and Operational MDM are just two uses for the

same data

Microsoft MDM Philosophy

• SQL server 2008 is fit for purpose

• ... But the enterprise also needs master data

management

Conclusion

• SQL Server 2008 Site

http://www.microsoft.com/sqlserver/2008/en/us/default.aspx

• Microsoft BI Site

http://www.microsoft.com/bi

• Microsoft’s vision for Master Data Management:

http://www.microsoft.com/mdm

• SQL Server Data Services

http://www.microsoft.com/sql/2008/default.mspx

• Me

afryer@microsoft.com and http://blogs.technet.com/andrew

Further Information

Thank you