© 2014 VMware Inc. All rights reserved.
The next step in Software-Defined Storage with Virtual SAN
VMware vForum, 2014
What’s on the agenda?
• Where Virtual SAN fits in the Software Defined Data Center
• Overview of Virtual SAN
– How to build and configure
– Ecosystem
– Features: Resiliency, Scaling, Performance, Simplicity, Integration
• Virtual SAN Use Cases
• Additional Resources
The Software-Defined Data Center
3
Transform storage by aligning it with app demands
Management tools give way to automation
Expand virtual
compute to all
applications
Virtualize the network for speed and efficiency
The Software-Defined Data Center
4
Transform storage by aligning it with app demands
Today’s Challenge: Massive Increase in Storage Demand & Complexity
5
24%
26%
28%
28%
31%
42%
Management
Complexity
Provisioning
Time/budget
DataMigrations
Troubleshooting
MeetingSLA
Most Pressing Storage Challenges
M
20M
40M
60M
80M
100M
120M
2008 2009 2010 2011 2012 2013 2014 2015 2016
Terabytes Sold
Terabytes Sold
Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293
Storage Growth
41% YoY
Source: IDC, Storage Predictions 2014, January 2014, General Storage QuickPoll, #243511, n=307
Storage Market in Midst of Disruption
6
Key
Drivers Server flash
Falling storage prices
Abundant CPU cycles
Hypervisor-converged
infrastructure
Cloud economics
Server Storage
20-30 years ago
Shared
Storage
10-15 years ago
New
Forms
Today
New Storage Tiers Are Rapidly Growing
7
• Flash: Enables New Storage Architectures
• Flash is 50x – 2,000x faster than HDD
– 110K/140K IOPs R/W from 360GB MLC PCIe card1
– Less than $0.10 per IOP
• Eliminates the need to stripe across 100s of HDDs
• Enables high performance server-side storage
• Cloud: Enables Cost-Effective Storage
• Highly scalable, pay-as-you-go
• Access through standard APIs
• Low cost for capacity
– $0.05 per GB per month2
• Forecasted to grow at 40% annually to 20183
Cloud Storage
1. Source: FusionIO ioDrive2, Feb 2014 2. Source: Amazon S3, Feb 2014 3. Source: MarketsandMarkets Cloud Storage report - http://www.marketsandmarkets.com/PressReleases/cloud-storage.asp
The Hypervisor Opens Up New Opportunities
8
SAN /
NAS
x86
Servers
Cloud
Storage
vSphere
The virtualization
platform:
• Knows the needs
of all apps in real
time
• Sits directly in the
I/O path
• Global view of
underlying
infrastructure
• Hardware agnostic
Object-based
Pool
SAN/NAS
Pool
Hypervisor
Converged
Pool
Leveraging The Hypervisor We Can Transform Storage
9
• Today • Software-defined Storage
LU
N
Array A
LU
N
LU
N
Array B
LU
N LU
N Abstract and
pool (Virtualized Data Plane)
Automate SLAs
via VM-centric
policies (Policy-based Control
Plane)
VM level Data
services (Virtual Data Services)
SAN /
NAS
x86 Servers
Cloud
Object
Storage
vSphere
Replicati
on
Snapshot
s
Software-Defined Storage
10
Bringing the efficient operational model of virtualization to storage
Virtual Data
Services Data
Protection Mobility Performance
Policy-driven Control Plane
SAN /
NAS
SAN/NAS Pool
Virtual Data Plane
x86 Servers
Hypervisor-converged Storage pool
Object Storage
Pool
Cloud
Object
Storage Virtual SAN
VMware Virtual SAN 5.5 Radically Simple Hypervisor-Converged Storage
Virtual SAN: Radically Simple Hypervisor-Converged Storage
12
vSphere + Virtual SAN
…
• Software-defined storage
embedded in vSphere
• Runs on any standard x86 server
• Pools HDD/flash into a shared
datastore
• Managed through storage policy-
based management framework
• High performance through flash
acceleration
• Highly resilient - zero data loss in
the event of hardware failures
• Deeply integrated with the
VMware stack
The Basics
Hard disks SSD
Hard disks SSD
Hard
disks
SSD
Virtual SAN
Shared Datastore
Flash Based Devices
In Virtual SAN ALL read and write operations always go directly to the Flash tier.
Flash based devices serve two purposes in Virtual SAN
1. Non-volatile Write Buffer (30%)
– Writes are acknowledged when they enter prepare stage on SSD.
– Reduces latency for writes
2. Read Cache (70%)
– Cache hits reduces read latency
– Cache miss – retrieve data from HDD
Choice of hardware is the #1 performance differentiator between Virtual SAN configurations.
13
Magnetic Disks (HDD)
• SAS/NL-SAS/SATA HDDs supported
– 7200 RPM for capacity
– 10000 RPM for performance
– 15000 RPM for additional performance
• NL SAS will provide higher HDD controller queue depth at same drive rotational speed and similar price point
– NL SAS recommended if choosing between SATA and NL SAS
• Differentiate performance between clusters with SSD selection, and SSD:HDD ratio. Rule of thumb guideline is 10% of anticipated capacity usage
14
Storage Controllers
• SAS/SATA Storage Controllers
– Pass-through or “RAID0” mode supported
• Performance using RAID0 mode is controller dependent
– Check with your vendor for SSD performance behind a RAID-controller
• Storage Controller Queue Depth matters
– Higher storage controller queue depth will increase performance
• Validate number of drives supported for each controller
15
Network
• 1Gb / 10Gb supported
– 10Gb shared with NIOC for QoS will support most environments
– If 1GB then recommend dedicated links for Virtual SAN
• Jumbo Frames will provide nominal performance increase
– Enable for greenfield deployments
• Virtual SAN supports both VSS & VDS
– NIOC requires VDS
– Nexus 1000v – Should work but hasn't been fully tested
• Network bandwidth performance has more impact on host evacuation, rebuild times than on workload performance
16
12,000+ Virtual SAN
Beta
Participants
95% Beta
customers
Recommend
VSAN
90% Believe VSAN
will impact
Storage like
vSphere did to
Compute
Unprecedented Customer Interest And Validation
17
Why Virtual SAN?
18
• Two click Install
• Single pane of glass
• Policy-driven
• Self-tuning
• Integrated with VMware
stack
Radically Simple
• Embedded in vSphere
kernel
• Flash-accelerated
• Up to 2M IOPs from 32
nodes
• Granular and linear
scaling
High Performance Lower TCO
• Server-side economics
• No large upfront
investments
• Grow-as-you-go
• Easy to operate with
powerful automation
• No specialized skillset
Two Ways to Build a Virtual SAN Node
• Completely Hardware Independent
19
1. Virtual SAN Ready Node
…with multiple options available at GA + 30
Preconfigured server ready to use Virtual SAN…
2. Build Your Own
…using the Virtual SAN Compatibility Guide*
Choose individual components …
SSD or PCIe
SAS/NL-SAS/ SATA
HDDs
Any Server on
vSphere Hardware
Compatibility List
HBA/RAID Controller
Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page
Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other
components is unsupported
Flexibly Configure For Performance And Capacity
20
Performance
2xCPU – 8-core
128GB Memory
2xCPU – 8-core
128GB Memory
2xCPU – 8-core
128GB Memory
1x
400GB MLC SSD (~15% of usable capacity)
1x
400GB MLC SSD (~10% of usable capacity)
2x
400GB MLC SSD (~4% of usable capacity)
5x
1.2TB 10K SAS
7x
2TB 7.2K NL-SAS
10x
4TB 7.2K NL-SAS
IOPS1
Raw
Capacity
~20-15K
6TB
~15-10K
14TB
~10-5K
40TB
Capacity
1. Mix workload 70% Read, 80% Random
Estimated based on 2013 street pricing,
Capex
(includes storage hardware + Software
License costs)
Broad Partner Ecosystem Support for Virtual SAN
21
Storage Server / Systems
Solution
Data Protection
Solution
vSphere + Virtual SAN
22
Simple to set up via policy
Delivered on per VM basis
Zero data loss in case of disk, network or host failures
Ensures zero downtime from disk or network failures
Interoperable with vSphere HA and Maintenance Mode
Virtual SAN Is Highly Resilient Against Any Hardware Failure Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures
Failure handling philosophy
Traditional SANs
– Physical drive needs to be replaced to get back to full redundancy
– Hot-spare disks are set aside to take role of failed disks immediately
– In both cases: 1:1 replacement of disk
Virtual SAN
– Entire cluster is a “hot-spare”, we always want to get back to full redundancy
– When a disk fails, many small components (stripes or mirrors of objects) fail
– New copies of these components can be spread around the cluster for balancing
– Replacement of the physical disk just adds back resources
Scale UP Add more
Disks
IOPS Capacity
40 TB
400 TB
4.4 PB
Scale OUT
Add more
nodes
Elastic Grow or shrink on demand
Granular Add single nodes or disks
Non-disruptive No app downtime
Virtual SAN Enables Elastic Linear Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments
“Virtual SAN enables us to
scale our storage
infrastructure and while
providing the necessary
redundancy. This allows us
to be more agile and bring
our solutions to market
faster.” Frans Van Rooyen,
Cloud Architect, Adobe 24
Virtual SAN Delivers Enterprise-Grade Scale
25
2M IOPS
3,20
0 VMs
4.4 Petabytes
Maximum Scalability per Virtual SAN Cluster
32 Hosts
“Virtual SAN allows us to build
out scalable heterogeneous
storage infrastructure like the
Facebooks and Googles of the
world. Virtual SAN allows us
to add scale, add resources,
while being able to service
high performance
workloads.” — Dave Burns
VP of Tech Ops, Cincinnati Bell
High Performance with Elastic and Linear Scalability
26
80K 160K
320K 480K
640K
253K
505K
1M
1.5M
2M
4 8 16 24 32
IOP
S
Number of Hosts In Virtual SAN Cluster
Mixed 100% Read
286
473
677
767 805
3 5 7 8
Number of Hosts In Virtual SAN Cluster
Number of VDI VMs
VSAN All SSD Array
Notes: based on IOmeter benchmark Mixed = 70% Read, 4K 80% random Notes: Based on View Planner benchmark
Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash
Array
Virtual SAN Simplifies Storage
27
Two clicks to deploy!
If You Know vSphere, You Know Virtual SAN
Virtual SAN: Deeply Integrated with VMware Stack
28
Ideal for VMware Environments
vMotion
vSphere
HA
DRS
Storage
vMotion
vSphere
Snapshots
Linked
Clones
VDP Advanced
vSphere
Replication
Data Protection
VMware
View
Virtual Desktop
vCenter Operations Mgr
vCloud Automation
Center
IaaS
Cloud Ops and
Automation
Site Recovery
Manager
Disaster Recovery
Site A
Site B
Storage Policy-Based
Management
Virtual SAN
Virtual SAN Puts The App In Charge
• Simpler and Automated Storage Management Through Application-centric Approach
29
Today
1. Pre-define storage
configurations
2. Pre-allocate static bins
3. Expose pre-allocated bins
4. Select appropriate bin
5. Consume from pre-allocated
bin
1. Define storage policy
2. Apply policy at VM creation
Resource and data service are automatically provisioned and maintained.
Virtual SAN
Shared
Datastore ✖ Overprovisioning
(Better safe than sorry!)
✖ Wasted resources, wasted time
✖ Frequent data migrations
No overprovisioning
Less resources, less time
Easy to change
Today
Virtual SAN Simplifies And Automates Storage Management
30
Per VM Storage Service Levels From a Single Self-tuning Datastore
Storage Policy-Based
Management
Virtual SAN
Shared
Datastore
vSphere + Virtual SAN
SLAs
Software Automates Control of Service
Levels
No more LUNs/Volumes!
Policies Set Based on Application
Needs
Capacity
Performance
Availability
Per VM Storage Policies
“Virtual SAN is easy to deploy, just a few check boxes. No need to configure RAID.”
Jim Streit, IT Architect,
Thomson Reuters
Virtual SAN Reduces CAPEX and OPEX for Better TCO
31
CAPEX
• Server-side economics
• No Fibre Channel network
• Pay-as-you-grow
OPEX
• Simplified storage configuration
• No LUNs
• Managed directly through vSphere Web Client
• Automated VM provisioning
• Simplified capacity planning
As Low
as
$0.50/GB2
As Low
as
$0.25/IOP
S
5X Lower
OPEX4
Up to 50%
TCO
Reduction
As Low
as
$50/Desk
top1
1. Full clones 2. Usable capacity 3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
4. Source: Taneja Group
• Compared to external storage at scale
• Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
• Additional savings come from reduced Opex through automation
• Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance
Granular Scaling Eliminates Overprovisioning
• Delivers Predictable Scaling and ability to Control Costs
32
VSAN enables predictable linear
scaling
Spikes correspond to
scaling out due to IOPs
requirements
$40
$90
$140
$190
$240
500 1000 1500 2000 2500 3000
Sto
rag
e C
ost
Per
Deskto
p
Number of Desktops
$/VDI Storage Cost Virtual SAN
Running a Google-like Datacenter
• Modular infrastructure. Break-Replace Operations
33
"From a break fix
perspective, I think there's
a huge difference in what
needs to be done when a
piece of hardware fails. I
can have anyone on my
team go back and replace
a 1U or 2U servers. …
essentially modularizing
my datacenter and
delivering a true
Software-Defined
Storage architecture."
— Ryan Hoenle
Director of IT, DOE Fund
Virtual Desktop
(VDI) Tier 2 / Tier 3 / Staging DR Target
• Rapid storage
provisioning and
complete
automation
• Ideal
price/performance
• Enables Cloud
Architect to easily
provision storage
• Integrated with
vSphere Replication
and VMware SRM
• Reduces cost of
storage
• Minimizes data
center footprint
• Handle peak
performance
requirements (boot,
login, read/write storms)
• Granularly scale from
POC to production
without huge upfront
investments
• Support high VDI
density
Virtual SAN Use Cases
• Use Cases for Virtual SAN 5.5
34
Site A Site B
Additional Resources
35
Product Page http://www.vmware.com/products/virtual-san/
VSAN Community https://communities.vmware.com/community/vmtn/vsan
VIP Tool vip.vmware.com/salessignup
Hands-On-Lab
http://vmware.com/go/vsanlab
Virtual SAN 60-day Free Evaluation
http://www.vmware.com/go/try-vsan-en
Software-defined Storage Sales Team
Thank You Rouan Hugo [email protected]