Post on 13-Dec-2015
transcript
www.buildwindows.com
Platform storage evolved
Rajeev NagarGroup Program ManagerMicrosoft Corporation
SAC-474T
www.buildwindows.com
What We’ve Covered So Far …Business and Partnering Opportunities:
“Windows Server 8” Continuous Availability
Designing Systems for Continuous
Availability and ScalabilitySession 446
Designing Systems for Continuous
Availability – Multi-node with
Remote File Storage
Session 444
Building Continuously Available File Server NAS AppliancesSession 449
Platform Storage Evolved
Session 474
Designing Systems for Continuous
Availability – Multi-node with Block StorageSession 450
Building Continuously
Available Systems
with Hyper-V Session 451
Session 443
www.buildwindows.com
Agenda
• Windows 8 enables partners to deliver differentiated, continuously available, scalable, cost-effective storage solutions
• Evolution of the storage platform• Availability• Manageability• Optimal Utilization
• Delivering cost-effective business-critical storage solutions with industry standard storage
• Maximizing value from external storage subsystems
• OEMs• System Integrators• Storage ISVs• Storage IHVs• Server application
developers
WHO WILL BENEFIT FROM THIS TALK
TOPICS WHAT YOU’LL LEAVE WITH
www.buildwindows.com
Windows 8 is the most cost-effective platform for continuously available and highly scalable data
access
www.buildwindows.com
Storage Platform (r)EvolutionOverview• Availability & Manageability
• Maximized file system availability• Comprehensive storage management
• Cost-effective business critical storage solutions• Windows virtualized storage: Storage Spaces
• Maximized utility from external storage subsystems• Offloaded data transfer
• Optimal utilization• Thin-provisioning notifications• Storage optimization• Data deduplication
www.buildwindows.com
Maximized File System AvailabilityNTFS – Online scan & repair
• Prioritized volume availability for service uptime• Online repair• Online scan & corruption logging
• Minimal downtime• Scheduled repair• Downtime proportional only to # logged corruptions• Failover Clustering & CSV integration
• Better manageability• File system health via Action Center, PowerShell, Server
Manager
Confidently deploy 64TB NTFS volumes with Windows 8
Attend session #446 for more information
www.buildwindows.com
Operational SimplicityComprehensive storage management• Extensible Storage Management API• WMI programmatic interfaces• PowerShell for remote access & scripting – easy E2E
provisioning• All new in-box applications moving to one new API• Foundational infrastructure for reducing operational
expenditure• Multi-vendor interoperability - common interface for
IHVs• SMI-S standards conformant: proxy service enables broad
interoperability with existing SMI-S capable storage hardware
• Storage Management Provider interface enables host-based extensibility
www.buildwindows.com
Operational SimplicityComprehensive storage management
Microsoft Applications ISV or Storage Vendor Applications
One Storage Management Interface
Vendor array SMI-S compliant array
Storage
Spaces
Storage Spaces compatible JBOD
www.buildwindows.com
Operational SimplicityComprehensive storage management
Management Software
Unified Storage
Mgmt. API
Windows Storage Management API (PowerShell and WMI)
Pass-through API for extensibility (WMI)
Storage Vendor
Hardware and
Software
Third-party application System CenterFile Server
Administration Console
SMI-S Hardware Provider
SMI-S Hardware Provider
Storage Management Provider Interface (+ pass-through for extensibility enabling all of SMI-S and vendor proprietary extensions; Transport = WMI)
Proprietary Transport and/or Protocol
SMP: UniversalSMI-S Service (Proxy)
SMP: 3rd Party Providers
SMP: Storage Spaces
Storage Array / RAID Controller
Storage Array / RAID Controller
Storage Array / RAID Controller
PowerShell Based E2E Storage Management#Enumerate available physical disks and form a Storage Pool
(New-StoragePool -StorageSubSystemId (Get-StorageSubSystem).ID -FriendlyName “DemoPool” -PhysicalDisks (Get-PhysicalDisk))
#Create a Virtual Disk from the Storage PoolNew-VirtualDisk -FriendlyName "SQLLogs" -StoragePoolFriendlyName "DemoPool" -StorageAttributesName Simple -ProvisioningScheme Sparse -Size 5TB
#Obtain the OS disk object for the Virtual Disk, initialize it, and create a partition$SQLLogDisk = Get-VirtualDisk -FriendlyName “SQLLogs” | Get-DiskInitialize-Disk -InputObject $SQLLogDisk New-Partition -InputObject $SQLLogDisk
#Retrieve the partition for use by the file-system$SQLLogPartition = Get-Partition -DiskId $SQLLogDisk.ID | Where-Object {$_.Type -ne "Reserved"}
#Format the volume & assign a drive letterFormat-Volume -inputobject ($SQLLogPartition | Get-Volume) -NewFileSystemLabel "SQLLogs" Get-Volume -FileSystemLabel "SQLLogs" | Get-Partition | Add-PartitionAccessPath -AccessPath N:\
www.buildwindows.com
Cost-Effective Business Critical StorageStorage Spaces• Powerful new platform abstractions• Storage Pools – Units of Aggregation, Administration &
Isolation• Storage Spaces (virtual disks): Resiliency, Provisioning &
Performance• Target design point• Industry standard interconnects: SATA or (Shared) SAS• Industry standard storage: JBODs
Storage Spaces enable partners to deliver a new category of highly capable storage solutions to all Windows customer segments at dramatically lower price-points & maximized operational simplicity
www.buildwindows.com
Windowsvirtualizedstorage
Storage SpacesConceptual deployment model
Windows Application Servers or Windows File ServersPhysical or
virtualized deployments
Physicalstorage
(Shared) SAS or SATA
File Server Administration
Console
Hyper-V
Cluster Shared Volumes
Failover Clustering
SMB2 Multichannel
NFS Windows Storage Mgmt.
Integrated with otherWindows 8 capabilities
NTFS SMB2 Direct
Storage Pool
Storage
SpacesStorage Pool
Storage
Spaces Storage Pool
Storage
Spaces
www.buildwindows.com
Storage SpacesPhysical Deployment Topologies
OR
Direct-Attached
Shared – Availability & Scale
SATA or SAS Shared SAS
www.buildwindows.com
Storage SpacesCapabilities• Optimized storage utilization• Resiliency & application-driven error correction• High-availability & scale-out with Failover Clustering
& Cluster Shared Volumes• Operational simplicity• Delegated administration & isolation for multi-tenant
deployments• Workload optimized performance via heterogeneous
media supportAttend session #446 for more
information
www.buildwindows.com
Demo Configuration & Overview
40x Intel® SSDs
Dell® Server5x LSI ® HBAs
ConfigurationComponents Quanti
ty
Dell® PowerEdge® T7102x Intel® Xeon® X5570, 48GB memory, 5x LSI® 9205-8e SAS HBA
1
Intel® X25-M 160GB SSD
40
www.buildwindows.com
Demo Configuration & Overview
SpaceforCSV
Supermicro® 4U JBOD
.\VMLibrary Unified CSV Namespace
ConfigurationComponents Quanti
ty
Supermicro® 2U server2x Intel® Xeon® X5570, 12GB memory, LSI 9200-8e SAS HBA
2
Supermicro® 4U JBOD 1
Seagate® 2TB 3.5”near-line SAS HDDs
45
Node #1 [SFSDemo3
]
Node #2 [SFSDemo2
]
SpaceforFinance
FinanceVM
SpaceforVHDStore
VHDStoreVM
www.buildwindows.com
Maximized Utility: External Storage SubsystemsOffloaded data transfer
External Storage Array
Virtual Disk
Virtual Disk
Actual data transfer
Offload Read Token
OffloadWrite with
Token
ReceiveResult
Token
www.buildwindows.com
Maximized Utility: External Storage SubsystemsOffloaded data transfer
• Utilize storage subsystem capabilities for efficient data movement• Minimal-to-zero impact to host CPU and networking
resources• Offloaded transfers between virtual disks, arrays, and
across data centers – spanning physical and virtual machine boundaries
• Tight platform integration enables application transparency
• Sophisticated applications can transfer tokens using application-specific protocol and transport• Token represents point-in-time view of data
Efficient data transfer within & across storage arrays
www.buildwindows.com
Demo Configuration & Overview
Dell® EqualLogic®
PS5000
Node #1 [SFSDemo3
]
Node #2 [SFSDemo2
]
Anaheim
DELLEQ-ODX1
DELLEQ-ODX2
\\SFSDemo2\G
\\SFSDemo2\H
VHD
VHD
Non-Offloaded Transfer Offloaded Transfer
Redmond
Building 10, Room 2120
MSFT Main Campus
Offloaded Data Transfer – Read Token FSCTL_OFFLOAD_READ_INPUT ReadInput; FSCTL_OFFLOAD_READ_OUTPUT ReadOutput; ReadInput.Size = sizeof(ReadInput); ReadInput.Flags = 0; ReadInput.TokenTimeToLive = 0; ReadInput.Reserved = 0; ReadInput.FileOffset = 0; ReadInput.CopyLength = 0x1000000; Success = DeviceIoControl(SourceHandle, (DWORD) FSCTL_OFFLOAD_READ,
&ReadInput, ReadInput.Size, &ReadOutput,sizeof(ReadOutput), &NumberOfBytes, &Overlapped);
Offloaded Data Transfer – Write Token FSCTL_OFFLOAD_WRITE_INPUT WriteInput; FSCTL_OFFLOAD_WRITE_OUTPUT WriteOutput;
RtlZeroMemory( &Overlapped, sizeof(Overlapped) ); Overlapped.hEvent = CreateEvent (NULL, FALSE, FALSE, NULL); WriteInput.Size = sizeof(WriteInput); WriteInput.Flags = 0; WriteInput.FileOffset = 0; WriteInput.CopyLength = ReadOutput.TransferLength; WriteInput.TransferOffset = 0; RtlCopyMemory(WriteInput.Token, ReadOutput.Token, ARRAYSIZE(WriteInput.Token));
Success = DeviceIoControl(DestHandle, (DWORD) FSCTL_OFFLOAD_WRITE, &WriteInput,WriteInput.Size, &WriteOutput, sizeof(WriteOutput),&NumberOfBytes, &Overlapped);
www.buildwindows.com
Optimized UtilizationThin provisioning notifications
• Identification• Identify thinly-provisioned virtual disks via PowerShell, &
WMI• Query mapped/unmapped state of virtual disk extents
• Notification• Events indicate when capacity consumption crosses
threshold boundaries• Standardized notification mechanism consumable by
applications
Safely maximize utilization with thinly provisioned virtual disks
www.buildwindows.com
Optimized UtilizationStorage optimizer• Optimization• End-to-end transparency of application and file
system allocations (including Hyper-V and within virtual machines)• From the application through to storage
• Un-map requests provided both on real-time and scheduled basis
• Scheduled slab consolidation ensures smallest storage footprint
• Compatibility• Windows certification requirement for arrays that
support thin provisioning• Automatically works with Storage Spaces
VM
Virtual Disk Or Storage
Space
Hyper-V
NTFS
Filters
Spaces
www.buildwindows.com
Optimized UtilizationData deduplication High optimization savings
• State of the art chunking and compression• Typical savings by workload
Transparent to primary server workload
• Minimal IO impact through scheduled and selective optimization
• Minimal server impact through low resource use
Reliability and data integrity
• Built-in insurance against natural risk of data reduction
• Data integrity validation on all data and metadata• Redundancy for metadata and popular chunks
Storage & network optimization
• Integration with BranchCache for faster file download times and reduced bandwidth consumption over WAN
User Home Folder (MyDocs)General File Share
Software Deployment ShareVHD Library
0% 20% 40% 60% 80% 100%
www.buildwindows.com
Data DeduplicationEnhanced Storage Efficiency
demo
Ahmed El-ShimiPrincipal Program Manager
www.buildwindows.com
SummaryPlatform Storage Evolved
Focused enhancements to platform storage enable:• Significant reduction for customers in storage related capital and
operational expenditure• Best leverage of external storage arrays• Highly scalable & continuously available, physical and Hyper-V based
(virtualized) workload deployments
Extensive opportunities for partners to build on the new platform• ODM, SI, & OEM opportunity to deliver new cost-effective solutions• Application developer opportunity to optimally utilize and manage
storage• IHV opportunity to deliver against new Windows capabilities – follow
certification requirements (Storage Spaces, Thin Provisioning, ODX, Flush, Physical Sector Size)
For more information, contact sfsquestions@microsoft.com
www.buildwindows.com
A Big Shout Out …
These partners are currently building hardware solutions to light up the Offloaded Data Transfer and Thin
Provisioning capabilities
www.buildwindows.com
For more information
• SAC-443T – Business and partnering opportunities: Windows Server 8 continuous availability
• SAC-444T – Designing systems for continuous availability - multi-node with remote file storage
• SAC-446T – Designing systems for continuous availability and scalability
• SAC-449T – Building continuously available file server NAS appliances• SAC-450T – Designing systems for continuous availability - multi-
node with block storage• SAC-451T – Building continuously available systems with Hyper-V
RELATED SESSIONS
www.buildwindows.com
• Feedback and questions http://forums.dev.windows.com
• Session feedbackhttp://bldw.in/SessionFeedback
thank you
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.