Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5

© Copyright IBM Corporation 2015

Spectrum Scale 4.2Elastic Storage Server 3.5NameTitle

© Copyright IBM Corporation 2015 2

• Family of Software-Defined-Storage – Common management and user experience– Deployment flexibility as software, appliance or cloud service– High-performance, enterprise storage

• Securely manage the explosive growth of data– Unified analytics-driven management for any storage– Advanced data placement to maximize

performance, availability, and cost efficiency– Built upon proven, flexible and scalable solutions from IBM FlashSystemAny

StoragePrivate, Public

or Hybrid Cloud

Control

Virtualize Accelerate Scale

Family of Storage Managementand Optimization Software

Protect Archive


IBM Spectrum Storage Family

FlashSystem

Any Storage

Private, Publicor Hybrid Cloud

IBM Spectrum Control

IBM Spectrum Protect

IBM Spectrum Archive

IBM Spectrum Virtualize

IBM Spectrum Accelerate

IBM Spectrum Scale

Storage and data optimization to reduce storage costs by up to 73 percent

Optimized data protection to reduce backup costs by up to 53 percent

Fast data retention that reduces TCO for active archive data by up to 90%

Virtualization of mixed environments stores up to 5x more data

Enterprise storage for cloud deployed in minutes instead of months

High-performance, highly scalable storage for file, object and analytics

3


FlashSystem

Any Storage

Private, Publicor Hybrid Cloud

IBM Spectrum Control

IBM Spectrum Protect

IBM Spectrum Archive

IBM Spectrum Virtualize

IBM Spectrum Accelerate

IBM Spectrum Scale

Storage and data optimization to reduce storage costs by up to 73 percent

Optimized data protection to reduce backup costs by up to 53 percent

Fast data retention that reduces TCO for active archive data by up to 90%

Virtualization of mixed environments stores up to 5x more data

Enterprise storage for cloud deployed in minutes instead of months

High-performance, highly scalable storage for file, object and analytics

IBM Spectrum Scale: Store everywhere. Run anywhere.

4


• Remove data-related bottlenecks Demonstrated 400 GB/s throughput

• Enable global collaboration Data Lake serving HDFS, files & object across sites

• Optimize cost and performance Up to 90% cost savings & 6x flash acceleration

• Ensure data availability, integrity and security End-to-end checksum, Spectrum Scale RAID, NIST/FIPS certification

Introducing IBM Spectrum Scale

Highly scalable high-performance unified storagefor files and objects with integrated analytics


The History of Spectrum ScaleThis infographic is the genealogy of IBM Spectrum Scale, from it’s birth as a digital media server and HPC research project to it’s place as a foundational element in the IBM Spectrum Storage family. It highlights key milestones in the product history, usage, and industry to convey that Spectrum Scale may have started as GPFS, but it is so much more now. IBM has invested in the enterprise features that make it easy to use, reliable and suitable for mission critical storage of all types.

8


What’s New in IBM Spectrum Scale 4.2 and IBM Elastic Storage Server 3.5

• Reduce capital and operating expense for storage supporting cognitive applications– Enable a common pool of storage for modern workloads with unified file and object storage– Policy-driven compression and QoS

• Accelerate analytics applications – Eliminate need to move data back and forth from Hadoop/HDFS storage silos with integrated HDFS– Automate Big Data deployment with Apache Ambari support

• Speed and simplify deployment– New Spectrum Scale GUI modeled on IBM Spectrum Storage family and improved ESS setup– Expand management options with Spectrum Control integration– Fully functional virtual machine demonstration lowers barriers to adoption


Reduce Expenses: Redefining Unified Storage

• Challenge– Managing data growth

o Lowering costs with archiveo Managing data retrieval & app supporto Data movement & translation overhead

• Unified Scale-out Content Repository – File In/Out, Object In/Out, Integrated Analytics– High-performance native protocols– Single Management Plane– Enterprise storage features across file and object

SSD FastDisk

SlowDisk

Tape

Spectrum ScaleNFS SMBPOSIX Swift/S3HDFS


Accelerate Analytics: Native HDFS Transparency

• Challenge– Separate storage systems for ingest, analysis, results

o HDFS requires locality aware storage (namenode)o Data transfer slows time to resultso Different frameworks & analytics tools use data differently

• Native HDFS support– Map/Reduce on shared, or shared nothing storage– No waiting for data transfer between storage systems– Immediately share results– Single ‘Data Lake’ for all applications


• Reduce administration overhead– Graphical User Interface for common tasks

• Easy to adopt– Base interface on common IBM Storage

Framework

• Integrated into Spectrum Control– Storage portfolio visibility

o Consolidated management o Multiple clusters

14

Speed and Simplicity: Graphical User Interface


• System Health• Node performance• Network traffic• Historical Trends

Speed and Simplicity: Performance Monitoring Highlights


Reduce Costs: Compression

• Improved storage efficiency– Typically 2x improvement in storage efficiency

• Improved i/o bandwidth– Read/write compressed data reduces load on storage backend

• Improved client side caching– Caching compressed data increases apparent cache size

• Compression is controlled per file – By administrator defined policy rules

Vision• Which files to compress

• When to compress the file data

• How to compress the file data


Remove Data Bottlenecks

• Quality of Service – Throttle background functions such as rebuild or async replication– Set by flexible policy, such as day-of-week and time-of-day

• Highly Available Write Cache (HAWC)– Improves performance of small synchronous writes– Small synch writes are written to the log. As log fills, rewrite to home.

• Local Read Only Cache (LROC)– Extend the page pool memory to include local SSD for read caching

• Distributed and flash accelerated metadata– Metadata includes directories, inodes, indirect blocks

• Lift data to the highest tiers based on the file’s “heat”


New Feature Benefit

Client ExperienceFocus •Common interface across Spectrum Portfolio

•GUI Phase 1

Easy to learn UI and integration across Spectrum Storage portfolio

Simplify common management functions, including •Enabling protocols •Policy driven placement and ILM•Monitoring•Troubleshooting

Object Storage •Unified File and Object•Extended S3 API support

Single view of data with wither file or object read and writeEnable applications originally written for AWS

Big Data & Analytics •Native Hadoop Support•Ambari Integration

Higher performance and broader integration with HDFS applications to go beyond Hadoop and embrace Map/Reduce ecosystem

General

•Quality of Service for File•Compression for File and Object•z Linux Asynch DR and Backup

Expanding functionality in Spectrum Scale data aware policy engine:•Performance reservations to meet SLAs – even by time of day•Efficiently reduce data size by up to 50% based upon business or technical policy

•Extending multi-site resiliency features to z-Linux

Spectrum Scale RAID •Expanding erasure code support on Elastic Storage Server

Higher resiliency and faster rebuild times for Elastic Storage Server

New in Spectrum Scale 4.2


Software Cloud serviceAppliance

Get it your way


IBM Elastic Storage Server (ESS)Integrated scale out data management for file and object data• Optimal building block for high-performance, scalable,

reliable enterprise storage– Faster data access with choice to scale-up or out– Easy to deploy clusters with unified system GUI– Simplified storage administration with IBM Spectrum Control integration

• One solution for all your data needs– Single repository of data with unified file and object support– Anywhere access with multi-protocol support:

NFS 4.0, SMB, OpenStack Swift, Cinder, and Manila– Ideal for Big Data Analytics with full Hadoop transparency with 4.2

• Ready for business critical data– Disaster recovery with synchronous or asynchronous replication– Ensure reliability and fast rebuild times using Spectrum Scale RAID’s

dispersed data and erasure code


Advantages of Spectrum Scale RAID

JBODs

Elastic Storage Server• Use of standard and inexpensive disk drives– Erasure Code software implemented in Spectrum Scale

• Faster rebuild times – More disks are involved during rebuild– Approx. 3.5 times faster than RAID-5

• Minimal impact of rebuild on system performance– Rebuild is done by many disks– Rebuilds can be deferred with sufficient protection

• Better fault tolerance– End to end checksum– Much higher mean-time-to-data-loss (MTTDL)

o 8+2P: ~ 200 Yearso 8+3P: ~ 200 Million Years

Spectrum Scale RAID


Integrates with localand cloud storage

“Big Storage” technology previewEasy to use enterprise-class cloud-based storage service tier, suitable for very large archives with occasional retrieval needs that offers very low cost storage with affordable and predictable retrieval costs

Intuitive interface with manual or policy-based archival

Fast retrieval and global namespace across all tiers

Enterprise level security

Supports large archives (TBs - PBs) with retrieval times in minutes (versus hours)

Storage for large amounts of data at $0.005 per GB peak / month

Future releases will provide the ability to run analytics on the archived data

Easy to use

Enterprisegrade

Price/Perf.Analytics

Data retrieval at $0.09 per GB

Big Storage

Spectrum ScaleSwift

Spectrum Scale


Spectrum Scale virtual machine • Turn-key Spectrum Scale VM available for download

– Try the latest Spectrum Scale enhancements– Full functionality on laptop, desktop or server– Incorporate external storage

• Use for live demonstrations, proof of concepts, education, validate application interoperability– Scripted demonstrations

• Limitations– VirtualBox hypervisor only– Type-2 Hypervisor limits performance– Not supported for production workloads– Can not be migrated to bare metal


IBM Spectrum Scale Value

Storage management at scale

• New GUI & health monitoring

• Unified File, Object & HDFS

• Distributed metadata & high-speed scanning

• QoS management

• 1 Billion files & yottabytes

• Multi-cluster management with Spectrum Control

Store everywhere. Run anywhere.

• Advanced routing with latency awareness

• Read or Write Caching

• Active File Management for WAN deployments

• File Placement Optimization

• End-to-end data integrity

• Snapshots

• Sync or Async DR

Improve data economics

• Tier seamlessly

• Incorporate and share flash

• Policy driven compression

• Data protection with erasure code and replication

• Native Encryption and Secure Erase compliance

• Leading performance for Backup and Archive

Software Defined Open Platform

• Heterogeneous commodity storage

• Software, appliance or Cloud

• Data driven migration to practically any target

• OpenStack SWIFT and S3

• Transparent native HDFS

• Integration with Cloud


Client workstations

Users and applications

Compute farm

25

Spectrum Scale: Redefining Unified Storage

Traditionalapplications

Powered by

Single name space

Spectrum Scale

SMB NFS POSIX

Transparent HDFS

Disk Tape Shared Nothing Cluster

Flash

Off Premise

OpenStack Object

Swift S3

Cinder Swift

Glance Manilla


Questions?


Technical Features v4.2 (planned delivery 4Q15)

27

IBM and Business Partner Use Only

Express Edition Standard Edition Advanced Edition

Support for maximum file system size, number of files, file systems and number of nodes Node roles: Collector node, Admin node Free Free FreeNode roles: Cluster Config Server, Manager, quorum, tie-breaker, NSD server Multi-cluster Quotas (user and group only) Snapshots (file system) (file set) (file set)Management GUI Compression (2:1 to 5:1 ratio) Quality of Service Filesets Multi Protocol access Storage Pools ILM Placement and Management policies HSM with TSM or LTFS MC Store cloud gateway [Tech Preview only] AFM caching and Asynchronous DR (gateway nodes) Encryption of data at rest and secure erase

Date post:	13-Jan-2017
Category:	Technology
Upload:	doug-oflaherty
View:	1,496 times
Download:	2 times

Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5

Technology