© 2010 IBM Corporation
Storage Virtualization with SVC: Simplify Procedures, Reduce Risk, Enhance Usage
Klemen BačakField Technical Sales Specialist, IBM Slovenija d.o.o. [email protected], GSM:040/456-607
29.09.2010
5 © 2010 IBM [email protected]
Virtualization Everywhere
MiddlewareMiddleware
•Virtual machines
Application
SOA
Grid,Clustered applications
VM (mainframe)VMware, HyperVPowerVM (AIX)
Storage
Virtual file systems
7 © 2010 IBM [email protected]
Today's SANs
SAN SAN-attached disks look like local disks to the OS & application
8 © 2010 IBM [email protected]
Virtualizationlayer
SANs – with Virtualization
Virtual disks start as images of migrated non-virtual disks.
The 1:1 relation is not mandatory afterwards
SAN
9 © 2010 IBM [email protected]
Virtualizationlayer
Become truly flexible !
Virtual disks remain constant during physical infrastructure changes
SAN
10 © 2010 IBM [email protected]
Virtualizationlayer
Enable tiered Storage !
Moving virtual disks between storage tiers requires no downtime
SAN
11 © 2010 IBM [email protected]
Avoid planned Downtime !
Upgrade
Replacement or upgrade of the virtualization
hardware require no downtime
SAN
12 © 2010 IBM [email protected]
In-band Storage Virtualization : Compiled Benefits
Isolation
1. Flat interop. matrix2. Single point administration3. No-cost multipathing
Pooling
1. Higher (pool) utilization2. Cross-pool-striping: IOPS3. Thin Provisioning: free GB
PerformanceCACHE
1. Performance increase2. Hot-spot elimination3. Boost for old SANs
Mirroring Mirroring
×1. License economies2. Cross-vendor mirror3. Favorable TCO
License $$
13 © 2010 IBM [email protected]
Migration into Storage Virtualization (and back!)
SAN Volume Controller
SAN
ZONE
This works backwards too (no vendor lock-in)
Virtual disks in transparentImage Mode, before being converted to Full Striped
16 © 2010 IBM [email protected]
SAN Volume Controller : Virtualization Device
Single product number
Clustered ×2…8
SVC comes in pairs withmirrored cache (IOgroups)
Multi-use Fibrechannel in & out
Linux bootcode, 100% IBM stack
1 node pair
Acquisition cost:1. Hardware2. per-TB license3. per-TB mirroring license
17 © 2010 IBM [email protected]
3 Success Reasons for SAN Volume Controller
1. Continuity
2. Proven scalability & stability
3. Proven TCO benefits
Market leader (Gartner, IDC…)
20.000+
sold in 7 years …4 node pairs
1 node pair
* 20.000 nodes @ 3500 customers (04/2010)
18 © 2010 IBM [email protected]
Continuity … 5th Generation
Continuous development
Firmware is backwards compatible(64 bit not for 32 bit Hardware)
Replace while online
SAN Volume Controller CF8 – Firmware v5.1
SVC 4F2 - 4GB cache, 2Gb SAN (Rel.3 / 2006)SVC 8F2 - 8GB cache, 2Gb SAN (ROHS comp.)SVC 8F4 - 8GB cache, 4Gb SAN 155.000 SPC-1™ IOPSSVC 8G4 - +Dual-core Processor 272.500 SPC-1™ IOPSSVC CF8 - 24GB cache, Quad-core 315.043 4-node SPC-1 IOPS
380.483 6-node SPC-1 IOPS
MO
DE
LS
initial Release
:
:
19 © 2010 IBM [email protected]
Proven Scalability & Stability
Fleet availability: 99,999 ~ 99,9999%
Full redundancy and cache mirroring
Very low overhead (invisible 60µs)
SVC shows predictable & deterministic characteristicsunder heavy load, due to avoidance of I/O interruptsTechnology = State-loop with adapter polling
SVC v5.1
160.000 IOPS / 2-node 60µs
60µs
20 © 2010 IBM [email protected]
TCO Advantage
Isolation
1. Flat interop. matrix2. Single point administration3. No-cost multipathing
Pooling
1. Higher (pool) utilization2. Cross-pool-striping: IOPS3. Thin Provisioning: free GB
PerformanceCACHE
1. Performance increase2. Hot-spot elimination3. Boost for old SANs
Mirroring Mirroring
×1. License economies2. Cross-vendor mirror3. Favorable TCO
License $$
In many cases SVCs had a return on investment within < 18 months due to these characteristics.
21 © 2010 IBM [email protected]
Attractive Entry Price : SVC "lite"
SAN Volume Controller Entry Edition
"Lite" hardware e.g. single core
Attractive price pointapprox. 60% performance for 60% cost
Licensed for up to 250 virtualized spindles (unlimited capacity)
Optional mirroring license* is spindle-based (unlimited capacity)
FlashCopy and Multipathing for all clients included in base license
SVC Entry Edition
25 © 2010 IBM [email protected]
SVC adds fine-grained "thin provisioning" to any storage
The smallestSVC grain size is 32kB
Maximizes the use of your storage
Thin Provisioning and integrated Flash Memory*
SVC
IBM non-IBM
Flash*700µs
* automated "easy tiering"to become available soon
27 © 2010 IBM [email protected]
Symmetric Disk Mirroring with "stretched" SVC
VMHost
VMHost
SVC 1 node A SVC 1 node B
High availability + protectionfor virtual machines
VM VM
LUN1 LUN1'FC longwave Distance (x km)
One storage system. Two locations.
VM VM
VM VM
28 © 2010 IBM [email protected]
Planned & unplanned Failover Scenario
VMHost
VMHost
SVC 1 node A
VM
LUN1 LUN1'
SVC 1 node B
VMVM
VMotion, Partition Mobility, …
No LUNrescan
required
VM
VM
SVC IO group must be interconnected over 1 switch hop (no ISL)
FC FC
DR failover works w/o
training
Quorum =consistency
guaranteeSplit-brain Tiebreaker
Quorum
30 © 2010 IBM [email protected]
333,00083,00019,000Mixed 4KB IOPs(70/30)
800,000+200,000+35,000+Read 4KB IOPs
4672GB1168GB146GBRaw Capacity
Per Cluster (Mirrored SSDs)
Per IO Group(Mirrored SSDs)
Per SSD
SVC 5 (Model CF8) with Flash SSD Option
Boost any storage with SSD drives – at the heart of the SAN
8×
31 © 2010 IBM [email protected]
New Chip-Memory
FC 15KSAS 15K
SAN Volume Controller QoS Virtualization
SATA
Flash
Applications
SVC R5 since 2009+Integrated Flash tier
SVC R5.x – 2010+Easy Tier Automation
SVC
Preview
Dynamic Assignment
(QoS-based data placement)
33 © 2010 IBM [email protected]
SAN Volume Controller
SAN Volume Controller
SAN Volume Controller
SAN Volume Controller
Multicluster Mirroring "any-to-any"
SAN Volume Controller
SAN Volume Controller
SAN Volume Controller
Datacenter1 Datacenter 2
Datacenter 4
Datacenter 3
34 © 2010 IBM [email protected]
SAN Volume Controller
SAN Volume Controller
SAN Volume Controller
Multiple Flashcopies with individual "Flashback"
SAN Volume Controller
Saved state 12:00
Saved state 13:00
Saved state 14:00
Saved state 15:00:
×256
Reverse Flashcopy is instant. Earlier and later copies stay consistent.
Virus
t0
35 © 2010 IBM [email protected]
SAN Volume Controller
MS Exchange / MS SQL Data Protection / Backup
SAN Volume Controller
Saved state 12:00(space efficient)
Saved state 13:00(space efficient)
t0
TSM for Copy Services in conjunction with SVC's Space Efficient FlashCopy function can provide multiple, incrementally updated backups for MS Exchange and MS SQL Server.When the VSS provider for SVC 4.3 or later is configured to use Space Efficient (SE) target volumes in the pool used to satisfy VSS snapshot requests (and the background copy rate is set to 0), TSM will be able to perform frequent snapshot backups of Exchange and SQL server data volumes where each snapshot contains only the changed blocks since the prior VSS snapshot backup. There is no background copy of the full source volumes in this case so snapshots can be created at a high frequency because there is no need to wait for a background copy to finish. Thus, use of SE target volumes on SVC enables frequent, block level incremental backups to be created through VSS snapshots where multiple backup versions can be retained. However, SVC does not currently support FlashCopy restore from SE target volumes so the TSM instant restore feature is not available when SE target volumes are used. TSM fast restore (file copy) can be done from the VSS snapshot backups. These VSS backups can also (optionally) be sent to TSM server storage (tape or disk) as usual.
Since SE target volumes depend on the source volumes for any unchanged data, we recommend use of mirrored RAID configurations to protect against physical disk failures.
Check out IBM FlashCopy Manager
MS Exchange MS SQL
VSS VSS
t0
:
37 © 2010 IBM [email protected]
SVC Third-Party Mgmt Software available*SVC Third-Party Mgmt Software available*
Large, Gold-class VDiskswith low average load.
Drag'n'drop onto suitable storage tier, using BVQ*
SVC will manage the migration w/o disruption.
Large, Gold-class VDiskswith low average load.
Drag'n'drop onto suitable storage tier, using BVQ*
SVC will manage the migration w/o disruption.
*BVQ, Business Volume Qualicision®, from IBM Partner SVA
38 © 2010 IBM [email protected]
Free "Community" Software Tools for SVC
http://www.alphaworks.ibm.com/tech/svctools/faq
An interface and scripting tools using Perl for
automating tasks in SAN Volume
Controller
46 © 2010 IBM [email protected]
Managed Disk Group
Cluster: All nodes participating in a logical SVC instance and ‘knowing’ the virtual layout.
SAN Volume Controllers nodes
Managed Disks: Hidden beneath SVC. Static. Typically grouped in pools of LUNs from each storage device, RAID level, or rpm speed.
SAN Volume Controller Naming Scheme
I/O Group I/O Group
Virtual Disks:May have ‘any’ size, independent from underlying storage layout.
IO group: Two nodes keeping write cache consistency. An IO is acknowledged when both caches accept the write operation.
Managed Disk Group
47 © 2010 IBM [email protected]
Available Virtual Disk Modes in SVC
Virtual Disks
MDG1
MDG2
MDG3
Image Mode:Pass thru; Virtual Disk = Physical LUN
Sequential Mode:Virtual Disk mapped sequentially to a portion of a managed disk
Striped Mode:Virtual Disk stripedacross multiple managed disks (=preferred mode)
A
A
B
B
C
CC
51 © 2010 IBM [email protected]
No need to change theSAN layout!
SVC Drop-in Installation in single or dual fabrics
8 ports per Node-pair
4 ports
4 ports
Simple or redundant
SAN fabrics supported
Free MultipathingMPIO
SAN1 SAN2
53 © 2010 IBM [email protected]
Simplified Zoning with SAN Volume Controller
Static Device Zone:Devices are zoned only to the SAN Volume Controller.
This does never change.(except for subsystems replacement)
Static Host Zones:Hosts are zoned only to SAN Volume Controller.
This does never change.
SAN Volume Controllernode pair
54 © 2010 IBM [email protected]
Traditional Zoning X-to-Y Complexity
Traditionally, host systems are zoned to
the disks they are allowed to ‘talk’ to.
Zoning administration is “duplicate work” and needs to always match LUN mapping.
57 © 2010 IBM [email protected]
SAN Volume Controller – Ever growing Support Matrix
Current Version on ibm.com/storage/svc under “Interoperability”.
SANVolume Controller
SAN with 4Gbps fabric
HPMA, EMA, MSA
EVA 4/6/8400XP 24000/20000
HitachiLightningThunder
TagmaStoreAMS, WMS, USP
EMCCLARiiONSymmetrix
MicrosoftWindowsHyper-V
IBM AIXIBM i 6.1
SunSolaris
HP-UX 11iTru64
OpenVMS
Linux(Intel/Power/zLinux)
RHELSUSE
IBMBladeCenter
SAN
SANVolume Controller
Continuous CopyMetro MirrorGlobal Mirror
(log file enhanced)
VMware
Point-in-time CopyFull volume, Copy on write
256 targets, Incremental, Cascaded
Space-Efficient
NovellNetWare
SunStorageTek
IBMDS
DS4000DS5000DS6000DS8000
IBMESS,
FAStT
1024Hosts
iSCSI to hostsVia Cisco IPS
(native iSCSI in R5)
IBMN series
NetAppFAS
SGI IRIX
IBM N series& Netapp Gateway
IBM TS7650G
BullStoreWay
FujitsuEternus
NECiStorage
Space-Efficient Virtual DisksEntry Edition software
Virtual Disk Mirroring
AppleMac OS
PillarAxiom300, 500
600
IBMXIV
IBMz/VSE
59 © 2010 IBM [email protected]
– Simplified administration, including copy services: 1 same process
– Online re-planning is now possible due to great migration flexibility
– Storage effectiveness (ongoing optimization) can be maintained over time
– Move applications up one tier as required, or down one tier when stale
– Don't care about data placement on RAID arrays, just define striped pools
Summary : When to consider Disk Virtualization?
1. Low capacity utilization
2. Compatibility chaos
3. Too high migration effort
4. Unhappy with storage performance
5. Too complex site failover process
6. Need to realize quick ROISVC
60 © 2010 IBM [email protected]