Accelerating Oracle OLTP Database with Dell Flash based storage: Case Studies Guy Harrison, Kai Yu,...

Accelerating Oracle OLTP Database with Dell Flash based storage: Case StudiesGuy Harrison, Kai Yu, Naveen Iyengar

2 Global MarketingRoom for text

Agenda


Agenda

• Why should you care about Flash based storage disks?

• Types of Flash based storage disks

• Dell Flash based storage solutions

• Case studies – performance analysis

• Q&A


Why should you care about Flash based storage disks?


FASTER SLOWER

Flash SSD Technologies

Why should you care about flash based storage drives?• HDDs are performance limited by the spinning speed of the

disk (15K rpm) and its mechanical head movement

• Compared to HDDs flash based storage or Solid State Drives (SSDs) – Have no moving parts– Extremely fast, low-latency, and high IOPS

• Single SSD can replace many HDDs– Consolidate rack space– Save on power and cooling


Types of Flash based storage disks


Types of flash based storage disks or SSDs

• SAS/SATA based SSDs– Use the same SAS/SATA based interface as HDDs – Accessed by the system through OS driver stack– Performance better than HDDs but still limited by OS driver stack

• PCIe based SSDs– Directly connected to PCIe bus– Directly connected to CPU and system memory through PCIe bus– Faster than HDDs and SAS/SATA based SSDs– Two types

– Single-level cell (MLC) NAND – Best suited for performance intensive applications– Smaller capacity

– Multi-level cell (SLC) NAND– Suited for applications having high capacity requirements– Lower cost alternative to SLCs

FASTER SLOWER

Flash SSD Technologies


Dell Flash based storage solutions


• Server-side PCIe SSD based solutions– Database directly on Dell PowerEdge Express Flash PCIe SSDs– Database cached on Dell PowerEdge Express Flash PCIe SSDs

using Fluid Cache for DAS

• Storage-side PCIe SSD based solutions– Dell Compellent All-Flash array

Dell Flash based storage solutions

PCIe-SSDSAS/SATA


Case studies –Dell Flash based Storage Solutions Performance analysis


Case Study #1Oracle OLTP Database directly on Dell PowerEdge Express Flash PCIe SSDs


Introduction to Express Flash PCIe SSD

12

Media Bay & Control Panel S

AS

0

SA

S 1

SA

S 2

SA

S 3

SA

S 4

SA

S 5

SA

S 6

SA

S 7

PC

Ie S

SS

0

PC

Ie S

SS

1

PC

Ie S

SS

2

PC

Ie S

SS

3

Directly connected to PCIe bus Up to four PCIe SSDs per server 2.5 inch plugged into a device bay Capacity: 175GB/350GB Hot Swappable: add or remove a device

without halting or rebooting the system


Use Cases of PCIe SSDs for Oracle Database• Use PCIe SSDs stores the entire database schema.

• PCIe SSDs stores portions of a database schema four PCIe SSDs combining

with MD3220 external storage with

24 HDDs

• PCIe SSD used as Oracle Smart flash cache in a 11g R2 RAC Database

two PCIe SSDs combining with

MD3220 external storage with 24

HDDs

13

PCIE SSDSAS/SATADell Power Edge R720Dell Power Edge R720

PCI-e SSD

Dell PowerVault MD3220 SAS

PCIE SSDSAS/SATA

PCI-e SSD


Performance Testing Results• Use PCIe SSDs stores the entire database

schema: comparison of two configurations:

Baseline: the entire database schema stored in Hard Disk Drives (HDDs)

Compared group: the entire database schema stored in PCIe SSDs

TPS Comparison: 569% increaseResponse time (MS) Comparison: 250% increase of # of users for 1 second time99 times reduce of query response timefor 600 users

14


• User case 2: PCIe stores partial database: – Config1 : all the database objects stored in HDDs. (Base Line)– Config2: all indexes stored in PCI-e SSD Drives , – Config3: all indexes plus one most active table stored in PCI-e SSDs – Config4: all indexes plus four active tables stored in PCI-e SSD Response time Comparisons:TPS Comparisons: 12%-200% increase of # of users in 1 sec mark14%-310% TPS Increases 2-16 times decrease of response time for 800 users

15

Performance Testing Results


• Use PCIe as the smart flash cache for RAC --- an extension of database buffer cache

• Configure PCEI SSD as Oracle Smart cache: Set udev rule in /etc/udev/rules.d KERNEL=="rssda1",OWNER="oracle", GROUP="dba", MODE="0775"

16

PCIE SSDSAS/SATADell Power Edge R720Dell Power Edge R720

PCI-e SSD

Dell PowerVault MD3220 SAS

PCIE SSDSAS/SATA

PCI-e SSD

Database Buffer Cache

Database Buffer Cache

Smart Flash Cache

Smart Flash Cache

3. :Read Block from Smart Flash Cache to

Buffer Cache

1: Read a data block from disk

to Database buffer

2: The block is written to flash

cache



Performance Testing ResultsSELECT name, value FROM v$sysstat WHERE name IN ('physical read flash cache hits', 'physical reads', 'consistent gets', 'db block gets', 'flash cache inserts');

NAME VALUE---------------------------------------------------------------- ----------db block gets 10912661consistent gets 194736483physical reads 4514407physical read flash cache hits 2047180flash cache inserts 246469• 44.8% increase of TPS (Transactions Per Second)

17



• 5.8 times decrease of Query Average Response Time

18


Performance Testing Results• Observed different database wait patterns

19


Performance Testing Results• Free buffer wait event

– Process A: Fast data read from smart flash cache– Process B: Slow process to free a slot in memory due to the slow writing a dirty block to disk – Fast process A has to wait for slow process B Free buffer wait

20


Oracle Deployments: Challenges

Business Challenges:• Structured Data

Growth at CAGR > 50%

• Flat or declining IT budgets

• Do more with less• Support aggressive

Goto market requirements

Technical Challenges:• Increase performance

and availability• Increase Automation• Reduce Management

Complexity• Increase online data

accessibility


Case Study #2Oracle OLTP Database on Dell Compellent All-Flash Storage Array


Solving Database challenges

Common Approaches:• Add more processing/

memory• Add more storage• Add Server Flash• High touch database

tuning and management

Limitations:• Limited effectiveness• Storage overprovisioning

not sustainable• Point fix/Capacity

Constrained• Limited effectiveness


Better Solution: Automated Tiered Storage

Benefits of Automated Tiered Solution:• Increase performance without increasing cost• Scale performance/capacity independently• Right data in the right place at the right time – at the right

cost• Automation reduces management overhead• Increase amount of data that is online• Leverage existing investments


New Compellent All Flash Array Solution

75% Lower CostThan most All-Flash solutions

>300K IOPS>100,000 IOPS and sub-

millisecond latency running OLTP workload

Flash Tiering Economics:• Improve cost per GB and cost per

I/O• Reduce HW requirements• Reduce SW Licensing• Reduce maintenance/support

costs• Reduce environmental cost

factors

Reduce SSD costs

80%

Increase SSD Capacity

5X


SSD Tiering

$$$

RAID 10$$

RAID 5

RAID 5

$

RAID 6

RAID 6Read Intensive Enterprise SAS SSD

(1.6TB MLC)

HDD(15K, 10K,

7.2K)

Write-Intensive Enterprise SAS SSD

(400GB SLC)

Tier 1

Tier 2

Tier 3

How it works:• Flash Optimized Tiering• Write Intensive Tier for

Reads/Writes• Read Intensive Tier for Read

Only Data• On Demand data progression• Flash Optimized Storage

Profile• Enhanced Flash Wear

monitoring• Capacity addition through NL-

SAS


Performance Test Environment

100%

86%

Test Hardware:• 2 X M820 Blade Servers • Blade IO modules: A: M8024 10GbE Switch B: Force 10 10GbE Switch C: M6505 16GB FC Switch• Storage : 2 X SC8000

Compellent Controllers 4 X SC220 enclosures: 72 X 15k SAS disks 6 Write Intensive (SLC)SSDs 6 Read Intensive (MLC) SSDs

Test Software:• Oracle Linux 6.4 UEK

kernel• Oracle Database

Enterprise Edition 11. 2.0.4• Orion • Dell Quest Benchmark

Factory


Performance Test Environment

100%

86%


Orion Test Results

ORION: OLTP

All Flash Vs Spinning Media

(15k)

Flash Performance

100%

Flash Latency

86%

72X146G 15k

Vs

6XWI (400G) + 6XRI (1.6T)

Same Cost


TPCC Test Results

0 500 1000 1500 2000 2500 3000 35000

100

200

300

400

500

600

700

800

900

1000

0

1

2

3

4

5

6

7

8

9

10

TPC-C Results for 72x 15k SAS drives on Storage Center 6.3

Transactions per Second

Response Time

User Load

Tra

nsacti

on

s p

er

Se

co

nd

(T

PS

)

Re

sp

on

se

Tim

e (

se

c)

926 TPS

1 sec


0 500 1000 1500 2000 2500 3000 35000

100

200

300

400

500

600

700

800

900

1000

0

1

2

3

4

5

6

7

8

9

10

TPC-C Results for 72x 15k SAS drives on Storage Center 6.4

Transactions per Second

Response Time

User Load

Tra

nsacti

on

s p

er

Se

co

nd

(T

PS

)

Re

sp

on

se

Tim

e (

se

c)

947 TPS

1 sec


72x 15k SAS 6x SLC + 6x MLC0

200

400

600

800

1000

1200

1400

1600

1800

2000

947

1,835

72x 15k SAS vs 6x SLC + 6 MLC Flash Optimized

94% In-crease in Max TPS


Case Study #3Oracle OLTP Database Cached on Dell PowerEdge Express Flash PCIeSSDs using Fluid Cache for DAS


What is Fluid Cache for DAS?• Server-based caching technology

• Leverages Dell’s hot pluggable PowerEdge Express Flash PCIe SSDs

• Transparent to the Application

• Reduces latency & accelerates response times for any Linux-based application needing improved random IO reads and writes (i.e. Oracle OLTP) or sequential reads

• Consists of software, PowerEdge w/ Express Flash and optional PowerVault

OSOracle Linux 6.2 (RedHat

Compatible Kernel)

Platforms R620, R720, R820, T620RAID

Controller Dell PERC H710P, H710, H810


Fluid Cache for DAS Differentiators

• Write-back cache accelerates data writes as well as reads

• Pools up to 4 Express Flash PCIe SSDs in a server

• Protects write cache data with efficient block replication technologies

• Combines performance enhancements with data integrity

• Cache stays warm on reboot PCIe-SSDSAS/SATA


How Fluid Cache works:Enables High Speed Flash Performance for Direct Attached Storage

Dell (Server + Storage+ Flash) + Fluid Cache Application Acceleration

Oracle Database

ServerPCIe SSDs

1X IOPS

>50x IOPS

Fluid Cache for DAS

1x IOPS

RAID cont

.

ExternalPowerVault JBOD

Storage

ExternalPowerVault JBOD

Storage

RAID cont

.

RAID cont

.

Shared Read/Write Cache Pool

Shares PCIe Flash Cache Pool for VDs across up to 3 RAID Controllers (only 2 used here)

InternalStorage


• Fluid Cache for DAS 1.0

• PowerEdge R720

• Database & OS– Oracle Single Node 11gR2

Enterprise or Std. Edition DB SW– Oracle Linux 6.2

(RedHat Compatible Kernel)

• PowerVault MD1220– H810 connected to MD1220s in balanced mode– MD1220s connected in a daisy chain– 8 x R10 Data Volumes, 4 x R5 FRA* Volumes, 12 Global Hot Spares

* FRA – Flash Recovery Area (contains Archive Logs, Backups, etc.)

Fluid Cache for DAS: Oracle OLTP Database reference architecture


TPC-C Performance: Transactions per second (TPS)


TPC-C Performance : Average Response Time (ART)


TPC-C Performance : Max User load Scalability


• Dell Express Flash PCIe SSDs – www.dell.com/poweredge/expressflash

• Fluid Cache for DAS user’s guide - ftp://ftp.dell.com/Manuals/all-products/esuprt_electronics/esuprt_software/esuprt_cache_solutions/dell-fluidcache-das_User's%20Guide_en-us.pdf

• Oracle OLTP Fluid Cache for DAS reference architecture white paper – ftp://ftp.dell.com/Manuals/all-products/esuprt_electronics/esuprt_software/esuprt_cache_solutions/dell-fluidcache-das_White%20Papers90_en-us.pdf

Fluid Cache for DAS Resources

http://www.dell.com/poweredge/expressflash

Global Marketing

Q & A

Date post:	29-Mar-2015
Category:	Documents
Upload:	dorian-galey
View:	221 times
Download:	5 times

Accelerating Oracle OLTP Database with Dell Flash based storage: Case Studies Guy Harrison, Kai Yu,...

Documents