1 © Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big
Data For
VMware
Environments
<Phil King
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
2 © Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big Data
• Cloud Architecture And Mission Critical Applications – Oracle, Microsoft, SAP
• Big Data Impact On IT Infrastructure – Scale-Out vs. Scale-Up Computing
• VMware = The Core Platform For IT – Seamless Mobility And Control Across Applications
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
CLOUD COMPUTING
4 © Copyright 2011 EMC Corporation. All rights reserved.
Application Environments Historically Physical Infrastructure Limits Value
Challenges
Limits on Performance Different
environments
(prod/test/dev)
Physical silos of
servers and storage
Multiple software versions
Underutilized Hardware
Management Complexity
Complex Recovery
5 © Copyright 2011 EMC Corporation. All rights reserved.
Strong Momentum – Virtualizing Business Critical Applications
38%
53%
43%
25% 25%
18%
42%
67%
47%
34% 28% 28%
0%
10%
20%
30%
40%
50%
60%
70%
80%
MicrosoftExchange
MicrosoftSharePoint
Microsoft SQL OracleMiddleware
Oracle DB SAP
2010 2011
% Of Workload Instances Running on VMware
6 © Copyright 2011 EMC Corporation. All rights reserved.
Why Virtualize Applications? Cost Savings And Service Quality Improvement
14%
14%
19%
20%
20%
24%
14%
14%
14%
20%
17%
11%
65%
65%
64%
56%
60%
57%
7%
7%
3%
4%
4%
8%
Oracle enterprise apps
Custom enterprise apps
SQL database
SAP
MS Exchange
Oracle database
Cost savings Service improvement Both Neither
7 © Copyright 2011 EMC Corporation. All rights reserved.
Cloud – A New Architecture
Dedicated, Vertical Stacks
Old World – Physical New World – Virtual
Dynamic Pools Of
Compute & Storage
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
8 © Copyright 2011 EMC Corporation. All rights reserved.
vSphere
vFabric
vC
en
ter
Virtual Storage Requirements
vSphere
vFabric
vC
en
ter
Flash SATA
Automated Storage Tiering
VMware Integration
Cloud Infrastructure
Dynamic Pools Of
Compute & Storage
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
9 © Copyright 2011 EMC Corporation. All rights reserved.
The Performance Gap Challenge CPU Improves 100 Times Every Decade; HDD Remains Flat
100-times Improved
10,000-times Improved
2000 2010 2020
MOORE’S LAW:
100x PER
DECADE
CPU Continues To Improve
While Disk Drive
Performance Remains Flat
As A Result, Applications Will
Increasingly Suffer Unless
We Rapidly Move To Flash
FLASH
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
10 © Copyright 2011 EMC Corporation. All rights reserved.
Oracle server
Static Association Of Disk Groups To Applications
Based On Best Gues
Exchange server
SQL server
MANUAL PROCESS • FAST Cache continuously ensures
that the hottest data is served from high performance Flash SSDs
• FAST VP (Virtual Pools)* optimizes storage pools automatically, ensuring that active data is being served from SSDs, while cold data is moved to lower cost disk
• EMC Proven Solution Results:
– 150% more OLTP TPM
– 3X more users
– 80% faster tuning
– Powered by Intel® Xeon® Processor Technology
SSD NL-SAS
SAS
Dynamic, Self-Optimizing Storage Pools
Based On Actual Data Activity
Oracle Microsoft SAP
100% AUTOMATED
Flash And EMC FAST Automation
FAST Cache & FAST VP
Optimizes Production Application Environments
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
11 © Copyright 2011 EMC Corporation. All rights reserved.
EMC VFCache For Virtualized Server Performance
• Server Flash caching solution that uses intelligent caching software and PCIe Flash technology to reduce latency and increase throughput
• “Hottest” data accessed on the PCIe card in the server increasing performance
• EMC Proven Solution Results:
– 200% more TPM
– 60% decrease in latency
– 50% more IO serviced within 1 ms or less
– Powered by Intel® Xeon® Processor Technology
VFCache VFCache VFCache VFCache
Extends EMC FAST To The Server Layer
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
12 © Copyright 2011 EMC Corporation. All rights reserved.
Virtualized Production Applications
CLAL Insurance
• Doubled Oracle server
utilization from 15-20%
to nearly 50%
• Increased database
performance and mobility
with VMware
Synopsis
• SAP production
runtime increased
by 9x through FAST
• Database response
efficiency increased
470%
Vanderbilt
• Virtualized SQL Server
• FAST Cache deployed
• 78% of all I/O serviced
by just 1.6% EFD
13 © Copyright 2011 EMC Corporation. All rights reserved.
Maximize Application Quality of Service C
ap
ab
ility
Quality of Service
IMPOVE BACKUPS
Off-load backups to
dedicated storage device
Maintain use of native
backup management tools
De-Duplication
SIMPLIFY
REPLICATION
Snaps and clones for
recovery and multi-tasks
Server failover and
maintenance
Self-service for DBAs
Storage and Server
Replication
ACCELERATE
RECOVERY
Protect all application
tiers with one solution
Recover applications
to any point-in-time
locally or remotely
Application Recovery
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
14 © Copyright 2011 EMC Corporation. All rights reserved.
Deduplication Improves Backup Efficiency Perform More Full And Incremental Backups With Less Disk
Production
Dedupe &
Compress
EMC Data Domain DD800 Appliance
• Up to 50% faster backup
– Throughput of up to 26.3 TB/Hour
– Send only de-duped and compressed
data over network
– Ex: 40:1 de-dupe ratio reduces cost
• Improved recoverability
– Instant restore and rollback
– Extended online backup retention
• No changes to backup scripts,
processes or system architecture
Remote Site
EMC
Networker
DD Boost
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
15 © Copyright 2011 EMC Corporation. All rights reserved.
Simplify Data Replication
• Replicate data in minutes vs.
hours
– Clones for full, consistent recovery
– Snaps for space efficiency
– GUI interface enables DBA control
CloneDB
Snap or
Clone
CloneDB Clone
• Combined with VMware:
– Move workload within or across virtual
servers transparently
– Provision production or test/dev
servers in minutes vs. hours
– Perform maintenance on servers
without application downtime
Production
Server A Server B
Virtual Server Virtual Server
vMotion
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
16 © Copyright 2011 EMC Corporation. All rights reserved.
Virtualized Backup, Recovery, Deduplication
Washington Trust
• 95% de-duplication of backup
• 10:1 server consolidation
• New database deployment in
<1 hour
Swedbank
• 95% faster deployment of
test and development
• Deployed more Oracle
software on the same host
increases ROI
17 © Copyright 2011 EMC Corporation. All rights reserved.
Standardize Visibility And Control
End-to-end visibility and control across
physical and virtual environments
• Analyze SAN topologies and relationships
across your virtual and physical environment
• Monitor impact of FAST policies across all
virtualized application environments
• Monitor alerts and view properties for both
physical and virtual objects
• Track capacity consumption and perform
chargeback reporting C
ON
TR
OL
CE
NT
ER
: E
ND
-TO
-EN
D V
ISIB
ILIT
Y A
ND
CO
NT
RO
L SAN
VMware ESX Servers
Physical or Virtual Storage
VMware VMware VMware
Symmetrix VNX Third party
EMC Control Center
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
18 © Copyright 2011 EMC Corporation. All rights reserved.
EMC Virtual Storage Integrator (VSI) for VMware vSphere • VM Administrator Control OF VNX/VNXe
storage – Create VMFS datastores (iSCSI, FC, FCoE) – Create RDM Volumes (iSCSI, FC, FCoE) – Create NFS datastores – Configure FAST-VP Tiering Policies – Legacy support for Celerra and CLARiiON
• Clone virtual machines (VNX File) – Provision cloned VMs to VMware View – Refresh desktops in VMware View
• Compress virtual machines (VNX File) – Reduce the storage space for VMs through VNX File
Deduplication and Compression – Uncompress VMs on demand
Celerra
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
19 © Copyright 2011 EMC Corporation. All rights reserved.
Big Data
Impact On
Virtual
Infrastructure EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
20 © Copyright 2011 EMC Corporation. All rights reserved.
Unstructured Data
New Big Data Applications
Clickstream
Analysis Genomics
Seismic
Exploration
Movie
Rendering
Social
Graphing
?
Enterprise Applications
VMAX VNX
Structured Data
Cloud Infrastructure Cloud Infrastructure
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
21 © Copyright 2011 EMC Corporation. All rights reserved.
Big Data In Enterprise Applications
Example Big Data
Sources
• Large Scale Test,
Development
• Large Home Directories
• Unstructured Data
Source: IDC
By 2012, 80% of all storage capacity sold will be for file-based
data
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology
22 © Copyright 2011 EMC Corporation. All rights reserved.
Data goes global
23 © Copyright 2011 EMC Corporation. All rights reserved.
Pressure from new markets •5.9 billion mobile subscribers (87% of world) - 30% in China/India
•1.9 billion have smartphones
•1.2 billion use smartphones on the internet
•Forrester predict 2 billion PCs and laptops in use by 2013
•80 million ipads will be sold in 2012, accessing 300k apps
•Other viable devices include thin client terminals, most new internet
enabled TVs, Xboxes and playstations......
Current addressable market driven by c.4bn viable end point devices.
When VMware first launched VDI in 2005, they foresaw 500m viable end-
points by 2010.
24 © Copyright 2011 EMC Corporation. All rights reserved.
EMC Isilon.
Record Capacity.
Record Scalability.
Remarkable
Simplicity. EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
25 © Copyright 2011 EMC Corporation. All rights reserved.
Isilon Single Volume Simplicity
EM
PT
Y
EM
PT
Y
EM
PT
Y
EM
PT
Y
EM
PT
Y
FU
LL
F
UL
L
FU
LL
F
UL
L
BA
LA
NC
ED
BA
LA
NC
E
D
BA
LA
NC
E
D
BA
LA
NC
ED
BA
LA
NC
E
D
Directories and files striped across nodes
in a single volume
60 sec
Upgrade
Seamless Scale-Out For VMware With Isilon Uneven Utilization/Complex To
Scale
Many Systems or 2-way clusters
Many File Systems and Volumes
Many Points of Management
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
26 © Copyright 2011 EMC Corporation. All rights reserved.
Unstructured Data
Big Data Applications Enterprise Applications
Structured Data
Big Data Storage For Big Data Applications
VMAX VNX Isilon
Cloud Infrastructure Cloud Infrastructure
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
27 © Copyright 2011 EMC Corporation. All rights reserved.
Enterprise Applications
Next-Generation Cloud Infrastructure Big Data Applications
vM
otio
n
Fully Automated Storage Tiering (FAST)
Compute
Tier
Storage
Tier
Cloud Infrastructure
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
28 © Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big Data
• Cloud Architecture Is Ready For Mission Critical Apps – More Performance And Easier Management
• Big Data Requires New Approach To Infrastructure – Isilon = Scale Out Infrastructure Standard For Big Data
• VMware = Platform For Cloud + Big Data – Seamless Mobility And Control Across Applications
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
29 © Copyright 2011 EMC Corporation. All rights reserved.
THANK YOU