Dell EMC Unity All-Flash: Flash Technology Deep Dive
Nick Principe Performance Engineering Midrange & Entry Solutions Group
© Copyright 2017 Dell Inc. 2
Optimized for All-Flash Performance & Simplicity
What’s New with Dell EMC Unity
4 new Broadwell based All-Flash models New 80 drive 3U enclosure 4X file power with 256TB file system Compression for file AppSync integration, snapshots & thin
clones for iCDM Dynamic Pools
Up to 40% more cores; 2X the memory
650F
550F
450F
350F
© Copyright 2017 Dell Inc. 3
Dell EMC Unity All Flash: Flash Technology Deep Dive
3D TLC Flash Drives Compression
Intelligent Wear Leveling Host I/O Limits
Dynamic Pools Replication
Capacity
Reliability
Data Protection
Hardware and Endurance • 3D TLC Flash Drives • Intelligent Wear Leveling
Efficiency and Affordability • Dynamic Pools • Compression • Host I/O Limits • Replication
Hardware and Endurance 3D TLC Flash Drives
Intelligent Wear Leveling
© Copyright 2017 Dell Inc. 5
3D TLC Flash Drives
• As of Dell EMC Unity OE 4.1, we offer three high capacity 3D TLC Flash Drive choices for Dell EMC Unity All-Flash arrays
• These drives can be mixed with other Flash types in a pool
– Sparing rules still apply separately for each SAS Flash drive type
SAS Flash 4
© Copyright 2017 Dell Inc. 6
Intelligent Wear Leveling and Monitoring
• Intelligent Wear Leveling in Dell EMC Unity OE 4.1 and above
• Monitors flash wear level
• Enables mixing of different flash types within a pool
• Unisphere flash wear alerts
• CloudIQ’s “flash fuel gauge” for flash wear monitoring
• Proactive copy from drives prior to wearing out
Wear Level Monitoring Intelligent Wear Leveling
© Copyright 2017 Dell Inc. 7
Wear Level Monitoring
• Unisphere generates user-visible wear alerts at 180, 90, and 30 days before predicted end of life – Proactive Copy operations are automatically initiated at 30 days
remaining to a spare drive
© Copyright 2017 Dell Inc. 8
Wear Level Monitoring
• CloudIQ analytics provide a “Flash Fuel Gauge” for your flash drives indicating remaining endurance – Indicates endurance remaining in 20% steps – Indicates days remaining until predicted end of life starting at 180
days
© Copyright 2017 Dell Inc. 9
CloudIQ: Monitor, Manage, & Service Dell EMC Unity & SC Series Storage
Analyze and identify storage issues faster, simpler, accurately
Proactive Monitoring
Centrally monitor performance,
capacity, system, configuration,
and data protection.
View details about CPU Utilization, Compliance, RPOs, Storage Pools, LUNs, File Systems, and more.
Predictive Analytics
Identify and predict potential issues
before they occur in the environment.
Plan and optimize for capacity trending and performance.
Proactive Health Score
Present comprehensive
health scores for Dell EMC Unity &
SC Series storage.
Get practical remediation to issues based on best practices and risk management.
© Copyright 2017 Dell Inc. 10
Intelligent Wear Leveling and Monitoring
• Dell EMC Unity tracks, monitors, and predicts:
– Flash drive end-of-life – Expected wear level for drive
age – Current wear level of flash drive
• Remember: a worn-out flash drive is covered under warranty!
Driv
e W
ear
Time
End of LifeExpected WearActual Wear
© Copyright 2017 Dell Inc. 11
Intelligent Wear Leveling
• Flash drives already have internal wear leveling algorithms
• Dell EMC Unity adds another layer of wear leveling in the storage array
• All space allocation decisions now automatically take into account wear level
Intelligent Wear Leveling
= Space Allocation
© Copyright 2017 Dell Inc. 12
Intelligent Wear Leveling
• Dell EMC Unity avoids allocating new slices from a flash resource if it is wearing faster than expected
– Drive wear is checked about once a week Intelligent Wear
Leveling
= Space Allocation
© Copyright 2017 Dell Inc. 13
Intelligent Wear Leveling
• Dell EMC Unity avoids allocating new slices from a flash resource if it is wearing faster than expected
– Drive wear is checked about once a week
• After some time, wear levels reduce to expected level for age of drive
– Write activity is reduced by system › Less wear
– Drive continues to age with few writes
Intelligent Wear Leveling
= Space Allocation
Several Days Later
Efficiency and Affordability Dynamic Pools
Compression
Host I/O Limits
Replication
© Copyright 2017 Dell Inc. 15
Dynamic Pools: Introduction
New Default Pool Technology Available in OE 4.2 on Dell EMC Unity All-Flash Models
Dynamic Pools
Easier Expansion of
Pools
Easier Storage Pool
Planning Reduced
Flash Wear Faster
Rebuilds
Distributed Sparing Across Many Drives Parallel Rebuild Process
I/O Spread Across All Drives No Dedicated Hot Spares
No Specific Drive Multiples Required Still Choose Your RAID Type
Expand by One or More Drives Expand by Capacity Required
© Copyright 2017 Dell Inc. 16
Dynamic Pools: Architecture 25
6MB
25
6MB
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B Traditional Storage Pool
Private LUN
RAID Group
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
Private LUN
RAID Group
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
Dynamic Pools change the relationship between a
pool’s private RAID Groups and its Flash Drives
© Copyright 2017 Dell Inc. 17
Private RAID Groups
Private LUNs
Traditional Storage Pool
Dynamic Pools: Architecture
Flash Drives
Drive Extents
RAID Extents
DP Private RAID Groups
Private LUNs
Dynamic Storage Pool Similar Look-and-Feel Easier to Manage
256MB Slices 1 per RG
Now Made of RAID Extents
New! Made of Drive Extents
New! A Portion of a Flash Drive
Now Utilized More Efficiently
© Copyright 2017 Dell Inc. 18
Flash Drives
RAID Extents
DP Private RAID Groups
Private LUNs
Dynamic Storage Pool
Dynamic Pools: Architecture 400GB 800GB
DE: 1 DE: 2 DE: 3 DE: 4 DE: 5 DE: 6
… DE: n
DE: 1 DE: 2 DE: 3 DE: 4 DE: 5 DE: 6 DE: 7 DE: 8 DE: 9
DE: 10 DE: 11 DE: 12 DE: 13 DE: 14
… DE: 2n
• A drive extent is a portion of a drive
• Each drive within a Dynamic Pool is partitioned into drive extents
– Drive extent size is consistent across all drives of the same type within the system
• The number of extents created per drive depends on its size
• A drive extent can either contain: – A single position of a RAID Extent – Spare space
Drive Extents
© Copyright 2017 Dell Inc. 19
Dynamic Pools: Architecture • RAID Extents – RAID 5 (4+1) – Example
D1 DE 1 D1 DE 2 D1 DE 3 D1 DE 4 D1 DE 5 D1 DE 6
… Spare
D2 DE 1 D2 DE 2 D2 DE 3 D2 DE 4 D2 DE 5 D2 DE 6
… Spare
D3 DE 1 D3 DE 2 D3 DE 3 D3 DE 4 D3 DE 5 D3 DE 6
… Spare
D4 DE 1 D4 DE 2 D4 DE 3 D4 DE 4 D4 DE 5 D4 DE 6
… Spare
D5 DE 1 D5 DE 2 D5 DE 3 D5 DE 4 D5 DE 5 D5 DE 6
… Spare
D6 DE 1 D6 DE 2 D6 DE 3 D6 DE 4 D6 DE 5 D6 DE 6
… Spare
D1 DE 1 D2 DE 1 D3 DE 1 D4 DE 1 D5 DE 1 D6 DE 1 D1 DE 2 D2 DE 2 D3 DE 2 D4 DE 2 D5 DE 2 D6 DE 2 D1 DE 3 D2 DE 3 D3 DE 3
RAID Extent 1
D6 DE 1 D1 DE 2 RAID Extent 2 D2 DE 2 D3 DE 2 D4 DE 2
D5 DE 2 D6 DE 2 RAID Extent 3 D1 DE 3 D2 DE 3 D3 DE 3
*Note: This configuration is only an example and may not reflect the actual algorithm
D1 DE 1 D1 DE 2 D1 DE 3
D2 DE 1 D2 DE 2 D2 DE 3
D3 DE 1 D3 DE 2 D3 DE 3
D4 DE 1 D4 DE 2
D5 DE 1 D5 DE 2
D6 DE 1 D6 DE 2
© Copyright 2017 Dell Inc. 20
Flash Drives
Drive Extents
DP Private RAID Groups
Private LUNs
Dynamic Storage Pool
Dynamic Pools: Architecture
• A RAID extent is a collection of drive extents
• The number of Drive Extents in a RAID Extent is determined by – RAID type (RAID 5, RAID 6, or RAID 1/0)
– RAID width (4+1, 4+2, 1+1, etc.)
• Effectively a stripe width + parity: 5 drive extents for a RAID 5 (4+1) RAID extent
• A RAID extent will never have more than one drive extent from the same drive
D1 DE 1 D2 DE 2
RAID Extent: RAID 5 (4+1)
D3 DE 2 D4 DE 2 D5 DE 2
1 2 3 4 P
RAID Extents
© Copyright 2017 Dell Inc. 21
Dynamic Pools: Architecture
*Note: This configuration is only an example and may not reflect the actual algorithm
RAID Group 1
• Dynamic Pool Private LUN and RAID Group – Example
RAID Extent
1
RAID Extent
2
RAID Extent
3
RAID Extent
4
RAID Extent
5
RAID Extent
6
RAID Extent
7
RAID Extent
8
Private LUN
© Copyright 2017 Dell Inc. 22
DP RAID Group 1 (RAID 5 4+1) RE 1
RE2
RE3
RE4
RE5
RE6
RE7
RE8
Dynamic Pools: Architecture 25
6MB
25
6MB
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B Dynamic Storage Pool
Private LUN
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
Private LUN
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
256M
B
User LUN
DP RAID Group 2 (RAID 5 4+1) RE 1
RE2
RE3
RE4
RE5
RE6
RE7
RE8
DE1 DE2 DE3
DE1 DE2 DE3
DE1 DE2 DE3
DE1 DE2 DE3
DE1 DE2 DE3
DE1 DE2 DE3
DE1 DE2 DE3
*Note: This configuration is only an example and may not reflect the actual algorithm
© Copyright 2017 Dell Inc. 23
Dynamic Pools: Adding A Single Drive
RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE7
… Spare
RG1_RE1
RG1_RE3 RG1_RE4 RG1_RE6 RG1_RE7
… Spare
RG1_RE1 RG1_RE2
RG1_RE5 RG1_RE6 RG1_RE7
… Spare
RG1_RE1 RG1_RE2 RG1_RE4
RG1_RE6 RG1_RE7
… Spare
RG1_RE1 RG1_RE3 RG1_RE4 RG1_RE5
RG1_RE7 …
Spare
RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE6 RG1_RE8
… Spare
RG1_RE1 RG1_RE2 RG1_RE3 RG1_RE5
RG1_RE6 … …
1. Expand the Pool by a single drive
2. Rebalance drive extents within the Pool RG1_RE1
RG1_RE2 RG1_RE3
RG1_RE5 RG1_RE6
RG3_RE1 RG3_RE1
RG3_RE1 RG3_RE1
RG3_RE1 RG3_RE2
*Note2: This configuration is only an example and may not reflect the actual algorithm *Note1: Not all RAID extents are shown
© Copyright 2017 Dell Inc. 24
Dynamic Pools: Proactive Copy / Rebuild
*Note2: This configuration is only an example and may not reflect the actual algorithm
RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE7
Spare Spare
RG1_RE3 RG1_RE4 RG1_RE6 RG1_RE7
Spare Spare
RG1_RE2
RG1_RE5 RG1_RE6 RG1_RE7
Spare Spare
RG1_RE1 RG1_RE1 RG1_RE2 RG1_RE4
RG1_RE6 RG1_RE7
Spare Spare
RG1_RE3 RG1_RE4 RG1_RE5
RG1_RE7 Spare Spare
RG1_RE1 RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE6 RG1_RE8
Spare Spare
RG1_RE2 RG1_RE3 RG1_RE5 RG1_RE6 RG1_RE6
Spare Spare
1. A drive is identified for proactive copy or rebuild
2. Spare space is identified and drive extents are copied or rebuilt RG1_RE1
RG1_RE2 RG1_RE3
RG1_RE5 RG1_RE6
RG3_RE1 RG3_RE1
RG3_RE1 RG3_RE1
RG3_RE1 RG3_RE2
RG1_RE1
RG1_RE1 RG1_RE1
RG1_RE2 RG1_RE4 RG3_RE1 RG1_RE6
RG1_RE7
*Note1: Not all RAID extents are shown
RG1_RE2 RG3_RE1
© Copyright 2017 Dell Inc. 25
© Copyright 2017 Dell Inc. 26
© Copyright 2017 Dell Inc. 27
© Copyright 2017 Dell Inc. 28
© Copyright 2017 Dell Inc. 29
© Copyright 2017 Dell Inc. 30
© Copyright 2017 Dell Inc. 31
© Copyright 2017 Dell Inc. 32
© Copyright 2017 Dell Inc. 33
© Copyright 2017 Dell Inc. 34
© Copyright 2017 Dell Inc. 35
© Copyright 2017 Dell Inc. 36
Efficiency and Affordability Dynamic Pools
Compression
Host I/O Limits
Replication
© Copyright 2017 Dell Inc. 38
Dell EMC Unity Compression: Introduction
Unified Compression for Block and File with Dell EMC Unity OE 4.2
Unified Compression
Inline Space Savings
No Additional License
Required
Compression is Included with Base System License for Dell EMC Unity OE 4.1 and up
Writes Logged and Held in Cache Data Written to Flash Only Once
Lower TCO of Your Storage Solution Improve Utilization of Flash Capacity
© Copyright 2017 Dell Inc. 39
Unified Compression: Architecture
• Life of an I/O (Host Perspective) – Host write – Data saved in cache – Host acknowledged
• Compression does not change this process
– Compression is inline between cache and drives
– Not between host write and acknowledgement
Empty Page
Dirty Page
System Cache
Acknowledgement
Host write
© Copyright 2017 Dell Inc. 40
Dell EMC Unity Compression: Architecture
• After an acknowledged write – Data is aggregated and sorted – Compression attempted with LZ
algorithm – If compression savings are
sufficient, compressed data replaces existing data in cache
System Cache
Host write Dirty Page
Compression
Compressed Page
Empty Page
Sorting/Aggregation
© Copyright 2017 Dell Inc. 41
Dell EMC Unity Compression: Considerations
• No additional license required – included in the Dell EMC Unity OE license – Only supported on physical Dell EMC Unity hardware and only on All Flash Pools
• Compression takes advantage of thinly provisioned storage resources – Supported on Thin LUNs, File Systems, VMware VMFS Datastores, and VMware NFS
Datastores – File Systems and VMware NFS Datastores must have been created with OE 4.2
• Storage resources supporting compression may have compression: – Enabled at any time
› Any existing data will remain uncompressed unless re-written
– Disabled at any time › Any existing data will remain compressed unless re-written
• Compression utilizes Dell EMC Unity CPU cycles to achieve compression
Efficiency and Affordability Dynamic Pools
Compression
Host I/O Limits
Replication
© Copyright 2017 Dell Inc. 43
Dell EMC Unity Host I/O Limits: Introduction
Policy-Based Host I/O Limits for LUNs, Snapshots, VMFS Datastores, and VVols
Dell EMC Unity Host I/O Limits
Multiple Limit Types
Density-Based Limits VVol Support I/O Limit
Exceptions
Pause / Resume Individual Policies Add I/O Burst Exceptions
Both Block and File VVols Can Now Have Host I/O Limits Applied
Limit Max IOPS and/or MB/s per GB Same Language as Public Cloud
Limit by Maximum IOPS or MB/s Ability to Limit by both IOPS and MB/s
4.1 4.1 4.2
© Copyright 2017 Dell Inc. 44
Dell EMC Unity Host I/O Limits: Considerations Flash Drive Capacity
Drives in a Storage Pool
Using Dynamic Pools
• Desire to use as few storage pools as possible
• Workload isolation substitute – Use Host I/O Limits to limit noisy
neighbors – Multiple classes of workloads can share
a pool
• Budget available performance between different tenants
– Density-based host I/O limits provide familiar and consistent service levels
– Allow I/O burst exceptions via policy
Efficiency and Affordability Dynamic Pools
Compression
Host I/O Limits
Replication
© Copyright 2017 Dell Inc. 46
Replication: All-Flash Considerations
All-Flash Considerations
Replication
Compression-Independent Replication
Hybrid / VSA Destination
OK
Destination May Have Different Configuration or Features Must Have Sufficient Resources to Maintain Desired RPO
Compression May Be Enabled on Destination Data on Destination Recompressed if Enabled and Supported
Data Transmitted Uncompressed Data on Source Remains Compressed
© Copyright 2017 Dell Inc. 47
Dell EMC Services Driving the rapid adoption and optimization of your digital technologies
CONSULTING
Harness the power of business urgency with help from our consultants
DEPLOYMENT
Accelerate technology adoption with expert deployment designed for you
MANAGED SERVICES
Gain efficiencies with our hosted cloud, managed applications, storage, archiving, and back-up
TRAINING
Develop and retain valuable IT talent through continuous learning
IT PROVEN
Learn how to invest from extreme users such as Dell IT
SUPPORT
Maximize productivity with expert support backed by proactive, predictive tools
Booth #347
© Copyright 2017 Dell Inc. 48
Related Sessions for SC and Dell EMC Unity Series Session Title Day/Time Dell EMC Unity & SC Series: Midrange Storage Portfolio Overview Mon @ 12:00 PM + Wed @ 01:30 PM CloudIQ: Cloud-Based Storage Analytics for Dell EMC Unity and SC Series Mon @ 04:30 PM + Wed @ 08:30 AM Dell EMC Unity All-Flash: What’s New Tue @ 03:00 PM + Wed @ 01:30 PM Dell EMC Unity: Architectural Overview Mon @ 01:30 PM + Thu @ 08:30 AM Dell EMC Unity: Best Practices For Best Performance Wed @ 08:30 AM + Thu @ 10:00 AM Dell EMC Unity: Performance Analysis Deep Dive Wed @ 03:00 PM + Thu @ 01:00 PM Dell EMC Unity: Next Generation NAS & File Capabilities Mon @ 03:00 PM + Thu @ 11:30 AM Dell EMC Unity: Data Protection & Copy Management Options Mon @ 08:30 AM + Wed @ 12:00 PM Dell EMC Unity: Virtualization & Cloud Integration Mon @ 12:00 PM Dell EMC Unity: Migration From VNX Tue @ 08:30 AM Dell EMC Unity: Using Dell EMC UnityVSA In Converged Environments Mon @ 08:30 AM Dell EMC Unity All Flash: Flash Technology Deep Dive Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: What's New Mon @ 04:30 PM + Tue @ 03:00 PM SC Series: Architectural Overview Mon @ 01:30 PM + Tue @ 03:00 PM SC Series: Performance Best Practices Mon @ 04:30 PM + Thu. @ 01:00 PM SC Series: Affordable Data Mobility & Business Continuity With Multi-Array Federation Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: Virtualization & Ecosystem Integrations Wed @ 03:00 PM + Thu @ 08:30 AM
© Copyright 2017 Dell Inc. 49
Hands on Labs for SC and Dell EMC Unity Series Self-Paced Day/Time
Dell EMC Unity CloudIQ – Event Correlation & Analytics
Monday: 8:30AM – 9:00PM
Tuesday: 7:00AM – 5:30PM
Wednesday: 7:00AM – 5:00PM
Thursday: 7:00AM – 2:00PM
Dell EMC Unity – Simplified Storage Management & Administration
Dell EMC Unity – VMware vSphere Integration
Dell EMC Unity – Configuring Snapshots & Replication
SC Series: Introduction to SC Series and Dell Storage Manager
Guided Day/Time
Dell EMC Unity CloudIQ – Event Correlation & Analytics (Registration required and limited availability)
Tuesday: 1:30PM – 2:30PM
Thursday: 8:30AM – 9:30AM
© Copyright 2017 Dell Inc. 50
Thank You for Attending
PLEASE TAKE A MOMENT TO • Visit the Storage & Data Protection Booth • Tweet: @DellEMCStorage
A STAR IS BORN • Shoot an in-room 10 second reference video
(where applicable)
Talk with us in the booth about the:
Modern Infrastructure Assessment &
Storage Efficiency Guarantee
SITES TO BE SEEN • Efficiency Guarantee: dellemc.com/4to1guarantee • CloudIQ: dellemc.com/cloudiq • All-Flash Storage: dellemc.com/all-flash
Questions?
© Copyright 2017 Dell Inc. 52
WANT TO WIN A LEVITATING DEATH STAR SPEAKER?
• Follow @DellEMCStorage while at Dell EMC World
• 2 Winners will be chosen daily from
Monday May 8 through Thursday May 11 • All winners will be notified through
Twitter Direct Message
NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/