Rock Solid SQL Server Management

Red Rock ConsultingRed Rock Consulting

Red Rock Consulting

RockSolid


Red Rock Consulting Overview

• Australian-owned company; established in 1998

• Focused on providing the best solutions using Microsoft SQL Server & Oracle technologies

• SQL Server Group

– Support

– Consulting

– RockSolid Product

• Over 350 staff with offices in Sydney, Melbourne, Brisbane, Adelaide, Canberra, Wellington and

Auckland

• Microsoft Gold Certified Partner

• Government endorsed supplier

• Member of UXC - ASX Top 300 listed business solutions company


Overview

Tony Bain, RockSolid Product Manager

• 12 years SQL Server DBA Management experience

• Former SQL Server MVP

• Author (SQL Server 2000 Stored Procedure Handbook, SQL Server 2000 From Novice to Pro, Data Warehousing with SQL Server 2000 Analysis Services, Building an Effective Data Layer with SQL Server 2000 and VB.NET)

• Frequent speaker at Microsoft Tech Ed


Overview The RockSolid Product

• RockSolid software currently provides automated DBA support for more than 10000 commercial instances

• One of the worlds largest IT Services Company uses RockSolid to provide outsourced DBA support to large Australian customers

• Several of the largest banks in Australia—(w/2006 revenues of AUD$19B)—manage their large SQL database infrastructures with RockSolid

• RockSolid is developed in Microsoft .NET & is a group of Windows Services, ASP.NET Web Site, ASP.NET Web Service, TSQL and Reporting Services Reports

• RockSolid is over 500,000 lines of code

• Product team of 10– Development, testing, documentation, support


Overview The RockSolid Product

SQL Server Monitoring

Issue Analysis

Automated Management

Issue Management

ReportingDBA Team

Management

Comms

SQL Server Monitoring

Issue Analysis

Automated Management

Issue Management

ReportingDBA Team

Management

Comms


Overview

RockSolid Architecture

DataStore

Client Agent

ServerAgent

Web Service

Web Service

AnalysisAgent

NotificationAgentWeb

Portal

Web Portal

ReportLibrary

ReportLibrary

Site SQL ServersSite SQL Servers

Client Agent

Site SQL ServersSite SQL Servers


Site

Deployment Model: Enterprise

• RockSolid is fully installed onsite

• Licensed on perpetual license model

RockSolid


Site

Deployment Model: Enterprise - Cloud Enabler

• Seamless management between local & cloud based instances

• Allows organizations to start a transition to cloud based SQL infrastructure

RockSolid


Site

Deployment Model: Service Provider

• Allows a Service Provider to manage multiple customers

• Service Provider has a “global” view of all customers

• Customer has a “local” view of just their site

RockSolid

Site

Service Provider


Site

Deployment Model: SaaS

• Multi-tenanted RockSolid installation

• Sites are independent and managed locally by site resources

• SaaS provider can make available “best practice” defaults to SaaS clients

RockSolid

Site


Goal: “Allow DBAs to manage any number of SQL Server Instances to the same service quality possible if they were just managing one.”


Core Concepts – A Constant High Robust Service Level

• Virtualized Management

• Automated Management

• Real Time SQL Server Analysis

• Issue Escalation, Notification & Change Control

• Information Availability


A Constant High Robust Service Level Virtualized Database Management



Virtualized Database

• All the configuration, management, security and recovery options that effect the database

• Not just “SQL Server” settings, but the monitoring and management of the database

Virtualized Instance• All the configuration, management, security

options that effect the Instance• Again not just “SQL Server” settings, but the

instance management, patching and availability settings.



Hierarchy

Instance Hierarchy

• All the configuration, management, security and recovery options that effect the database

• Settings are inherited from the parent, and can overridden at the children

Database Hierarchy• All the configuration,

management, security and recovery options that effect the database

• Not just “SQL Server” settings, but the monitoring and management of the database

ServiceProvider

Group

Site

Domain

Instance

Bucket

Site

Domain

Instance

Database



Routing

Routing allows databases to be automatically managed to standard on discovery

• Routing ensures databases are not “forgotten” about

Prod Test Dev

XYZDB_Test

DEFABC


Management Set


Prod Test Dev


A Constant High Robust Service Level Real Time SQL Server Analysis

• Monitoring

– Our monitoring of SQL Server is highly detailed and specific to SQL Server

– Monitoring is carried out for Analysis and Reporting

– Our monitoring of SQL Server is comprehensive

• Analysis

– RockSolid does all the expected reactive checks

– Proactive Checks are key point of difference

– Uses relevant historical information to isolate potential issues

– Examples:

• Backup space in advance

• tps decrease

• Growth rate increase

• Security login activity

Blocking data (blocker, blockee, blocking query)SQL Server Version, License, Clustering,Edition InformationDatabase UserDatabase User RolesServer Role MembersData Database File (space, type, used etc)Database File GroupsStored Procedure checksumsTable (rows, space etc)Indexes (space etc)DatabasesInternal Memory Status (DBCC MemoryStatus)Connection countsDatabase Virtual File StatsSQL Agent jobsSQL Agent job stepsSQL Agent job schedulesSQL Agent job historiesInstance Wait Stats (select * from sys.dm_os_wait_stats)SQL Configuration (sysconfigures)SQL Registry keys (backup location, log location etc)Backup histories (sysbackups, backupsets etc)LoginsSQL Server Error Log rowsSQL Server Error Log sizesProfiler Login Failed EventProfiler Login Completed EventProfiler Object Create EventProfiler Object Modified EventProfiler Object Dropped EventProfiler RPC:CompletedProfiler SQL Batch CompletedProfiler RecompileProfiler Database Auto Srhink EventSQL Agent Error LogWindows Service StatusDisk InformationDisk UsageIndex usage (2005)Index recommendations (2005)Selective Query Plan (showplans)

Blocking data (blocker, blockee, blocking query)SQL Server Version, License, Clustering,Edition InformationDatabase UserDatabase User RolesServer Role MembersData Database File (space, type, used etc)Database File GroupsStored Procedure checksumsTable (rows, space etc)Indexes (space etc)DatabasesInternal Memory Status (DBCC MemoryStatus)Connection countsDatabase Virtual File StatsSQL Agent jobsSQL Agent job stepsSQL Agent job schedulesSQL Agent job historiesInstance Wait Stats (select * from sys.dm_os_wait_stats)SQL Configuration (sysconfigures)SQL Registry keys (backup location, log location etc)Backup histories (sysbackups, backupsets etc)LoginsSQL Server Error Log rowsSQL Server Error Log sizesProfiler Login Failed EventProfiler Login Completed EventProfiler Object Create EventProfiler Object Modified EventProfiler Object Dropped EventProfiler RPC:CompletedProfiler SQL Batch CompletedProfiler RecompileProfiler Database Auto Srhink EventSQL Agent Error LogWindows Service StatusDisk InformationDisk UsageIndex usage (2005)Index recommendations (2005)Selective Query Plan (showplans)

SQL Server BuildServer Role MembershipAuthentication ModeDatabase OwnershipSQL Login Password Policy ComplianceDisk Allocations and UsageInstance ConfigurationDisk Growth and Projected CapacityBackups FailingBackups not running or not scheduledService AvailabilityLog Shipping IssuesLog Backups not runDBCC Checks not runDatabase options in violation of standardInstance options in violation of standardTransactions per second rateCPU PressureI/O PressureCommon Query PerformanceBlocking issuesDatabase Growth rate issuesError Log IssuesLogin FailuresSecurity IssuesMemory PressureJob Executions times abnormalUsers performing administrator functionsChanges occurring without change controlNew Index recommendationsUnused Index removal recommendationsPerformance Issue Analysis

SQL Server BuildServer Role MembershipAuthentication ModeDatabase OwnershipSQL Login Password Policy ComplianceDisk Allocations and UsageInstance ConfigurationDisk Growth and Projected CapacityBackups FailingBackups not running or not scheduledService AvailabilityLog Shipping IssuesLog Backups not runDBCC Checks not runDatabase options in violation of standardInstance options in violation of standardTransactions per second rateCPU PressureI/O PressureCommon Query PerformanceBlocking issuesDatabase Growth rate issuesError Log IssuesLogin FailuresSecurity IssuesMemory PressureJob Executions times abnormalUsers performing administrator functionsChanges occurring without change controlNew Index recommendationsUnused Index removal recommendationsPerformance Issue Analysis


PerformanceDecrease

Backup Failure

Cost of SQL Server Management Automated Issue Resolution

• DBA actions are defined as activities

• RockSolid contains a comprehensive business rules engine which organizes activities into resolution processes. Resolutions use best practices.

Disk Space Issue Shrink Data File

Remove OldBackups

Shrink Log File

BackupDatabase

CheckBlocking

CheckOpen Trans

Kill Non Critical Spid

Shrink Data File

Remove OldBackups

Shrink Log File

Remove OldBackups

BackupDatabase

CheckOpen Trans

CheckBlocking

Kill Non Critical Spid

Create Job

Start Job

Run Script

Change DBOption

Apply ServicePack

CreateDatabase Create

Login

CreateObject

RemoveDatabase

RestoreDatabase


Cost of SQL Server Management Automated Issue Resolution

Fault Resolution

• Availability Failure

• Service Failure

• Job Failure

• Backup Failure

• I/O Corruption

• Disk Space Issues

• Performance Degradation

• Repeated Login Failure

• Error Log Errors

• Replication Failures

• Log Shipping Failures

Task Resolution

• Creating

– Databases, Logins, Users, Roles

• Assigning Permissions

• Altering Database Configuration

• Altering Instance Configuration

• Apply Service Packs

• Backing up a Database

• Move Database / Data File

• Restoring Databases from Backup

• Database Ownership

• Create / Alert / Drop jobs

• Run Script

• Update Statistics


A Constant High Robust Service Level Automated Database Management

• A Good Operational DBA process is flowchartable• Numerous automated management tasks exist e.g.

– Index Maintenance– Data File Management

• Automatically resizing data files during maintenance windows– Statistics Management– Backup Management– Database Consistency Checks– Patch Management– Error Log Management– History Table Management– CPU Affinity & Parallelism Management


Detailed Functionality

Example: Index Management

• Index management approach is different to “typical” approach.• Using calendars DBA assigns times when Index Maintenance is allowable• RockSolid decides how to use that time to full potential• RockSolid evaluates what indexes to maintain in that window based on

– Index size– Index fragmentation– Index usage– Index relevance to “common queries” (query plan analysis)– Index rebuild history

• Large chunks of time and not necessary to maintain indexes. Small pockets of time between batch processes etc can be used to their full potential to maintain the database


Cost of SQL Server Management Zero Screen Time

Normal DBA operations can be fully completed without requiring log in to the SQL Server itself to carry out the tasks

• Task Completion Time Frame– Tasks are completed faster as login access is not required– Tasks are completed more accurately as task is implemented as per request

approved by change approvers– Tasks are carried out using a consistent approach and methodology

• Security– Does not require DBAs to have login access to SQL Server– Enforces all changes to have a history and have change records– Certain tasks can be prevented from certain users.


Cost of SQL Server Management Reduced Investigation & Resolution Timeframes

• Data Gathering & Presentation– When an issue is passed to a DBA for manual resolution, an error message is

not simply passed– Instead all the detailed relevant information required to resolve the issue is

passed to the DBA for immediate analysis.


• Eventing is the capture and recording of every task, change, process or situation of interest that occurs within a SQL Server instance

• Events are not issues, events are simply things that have happened• Events are categorized based on their impact on areas such as performance,

security, recoverability and availability.• Examples:

– Backup completed, index create, table altered, query run for first time, application detected for first time, login failed, login succesful, data file grown, statistics update, stored procedure plan recompiled……

• Events can then be used for analysis in the context of issues.• For Example:

– A stored procedure is failing, what changes have been recently made and by who…

– Or, I can see that performance of this query has slowed down significantly, but why?

Cost of SQL Server Management Reduced Investigation & Resolution Timeframes

Eventing

INSTANCE ABC - Performance History

0

10

20

30

40

50

60

10/10

/200

7

11/10

/200

7

12/10

/200

7

13/10

/200

7

14/10

/200

7

15/10

/200

7

16/10

/200

7

17/10

/200

7

18/10

/200

7

19/10

/200

7

20/10

/200

7

21/10

/200

7

22/10

/200

7

23/10

/200

7

24/10

/200

7

25/10

/200

7

26/10

/200

7

Perf Events Query Response Time

16/10/2007 10:00 Index "ix_TableABC_Index1" was dropped by Login "DOMAIN\toms"

16/10/2007 10:13 Common Query "SELECT * FROM ABC WHERE A={numericvalue}" query plan recompiled

16/10/2007 10:20Common Query "SELECT * FROM ABC WHERE A={numericvalue}" performance changed by

more than 70%

16/10/2007 10:40 Table ABC statistics update automatically by SQL Server

16/10/2007 11:45 Table ABC long term exclusive locks causing 5 concurrent process to blocked for 120 seconds

16/10/2007 17:00 Table ABC Index "ix_TableABC_Index2" offline rebuild completed successfully


Detailed Functionality Performance Management

• Executed queries are parsed to isolate root query• Root query is then aggregated to show try impact of query execution

ServerAgent

SELECT a,b,c FROM xyz WHERE Y=10



SELECT a,b,c FROM xyz WHERE Y={numeric}

EXEC proc_DEF ‘ON’,1,’10/2/2007

EXEC proc_DEF ‘OFF’,5,’12/2/2007EXEC proc_DEF {string},{numeric},{date}

Sp_executesql ‘SELECT a,b,c FROM hijWHERE Y=@P1’,’int’,’1’

SELECT a,b,c FROM hij WHERE Y={numeric}


A Constant High Robust Service Level Reduced Investigation & Resolution Timeframes

Capacity Planning• Real time projections of I/O, CPU and Memory resources

– Configured hardware “lead time” to provide heads up when resources are reaching capacity

• Capacity Planning Analysis– Show me this database with double the users– Show me the infrastructure requirements for this instance in 24 months based on

historical growth– Show me the infrastructure requirements for this instance in 24 months based on

irregular growth

• Consolidation Analysis– Find databases with compatible characteristics

• Workload patterns• System requirements (collations etc)

– Consolidated picture capacity specification


THANK YOU

Date post:	27-May-2015
Category:	Technology
Upload:	tony-bain
View:	483 times
Download:	0 times

Rock Solid SQL Server Management

Technology