THE POWER OF RED HAT CEPH STORAGE

And how it’s essential to your software defined datacenter

Rodrigo MissiaggiaPrincipal Solutions Architect28/07/2016

WHY YOU SHOULD CARE

Essential – Critical component of software-defined datacenterElastic – Massively scalable for next generation workloadsEconomical – Runs on standard servers and disksEfficient – Unifies infrastructures to support different data typesElegant – Sophisticated & powerful – designed for IT practitionerEasy – Now included with Red Hat OpenStack Platform / Cloud Suite

AGENDA● Requirements and trends● Software-defined storage● Red Hat Ceph Storage 101● OpenStack integration● Product features, benefits, and

differentiation● Service offerings● Where to go next

REQUIREMENTS, TRENDS, AND SOFTWARE-DEFINED STORAGE

CUSTOMER REQUIREMENTS● Greater cost-efficiencies (30-40% annual data growth, while 60%

storage budgets flat or declining)

● Control of data growth with flexible multi-workload architectures

● Freedom from worsening labor constraints of proprietary storage

● Better day-to-day maintenance of complex storage infrastructures

● Enterprise-readiness: resilience, performance, data protection

● Agile infrastructure to match capabilities of cloud services

Traditional Open, software-defined

Standardcomputersand disksSt

anda

rdH

ardw

are

Ope

n So

urce

Soft

war

e

Ceph Gluster +++

Control Plane (API, GUI)

ADMIN USER

THE FUTURE OF STORAGE

ADMIN

USER

ADMIN

USER

ADMIN

USER

Interface de AdminsitraçãoSoftware e Hardware proprietários

FOUNDATIONAL SHIFTS

PROPRIETARY HARDWARE

HARDWARE-BASED INTELLIGENCE

SCALE-UP ARCHITECTURE

CLOSED DEVELOPMENT PROCESS

Standards-based, interoperable hardware

Lower cost, standardized supply chain

Scale-out architectureIncreased operational flexibility

Software-based intelligenceMore programmability, agility, and control

Open development processMore flexible, well-integrated technology

RISING TIDE OF SOFTWARE-DEFINED STORAGE

“By 2020, between 70-80% of unstructured data will be held on lower-cost storage

managed by SDS environments.”

“By 2016, server-based storage solutions will lower storage hardware costs by 50% or more.”

Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry”

Innovation Insight: Separating Hype From Hope for Software-Defined Storage

~20% CAGR between 2015 and 2019

2013 2014 2015 2016 2017 2018 2019

$1,349M

$1,195M

$1,029M

$859M

$706M$592M

SDS MARKET SIZE BY SEGMENT

$457M

Block StorageFile StorageObject StorageHyper converged

Source: IDC

“By 2019, 70% of existing storage array products will also be available as software only versions”

Innovation Insight: Separating Hype From Hope for Software-Defined Storage

THE RED HAT STORAGE MISSIONTo offer, with our partners, a unified, open

software-defined storage portfolio for next generation workloads thereby accelerating the

transition to modern IT infrastructures.

RED HAT CEPH STORAGE 101

RED HAT CEPH STORAGE

12

Distributed, enterprise-grade object storage, proven at web scale

Open, massively-scalable, software-defined Flexible, scale-out architecture on clustered commodity hardwareSingle, efficient, unified storage platform (block, object, file) User-driven storage lifecycle management with 100% API coverage Integrated, easy-to-use management consoleDesigned for cloud infrastructure and emerging workloads

BUSINESS BENEFITS● Open source - no proprietary lock-in, large ecosystem, community backing

● Lower cost - than traditional NAS/SAN, particularly petabyte workloads

● Peace of mind - decade of development, production proven, overwhelmingly preferred, supported and integrated by Red Hat

TECHNICAL BENEFITS OF CEPH

● Massive scalability, to support petabytes of data

● Maximum uptime, with no single point of failure

● Reduced maintenance, via self-management and self-healing

● Operational efficiency, by distributing data dynamically among servers and disks

RED HAT CEPH STORAGE FEATURES AND BENEFITS

COMPLETE, DEEPLY INTEGRATED STORAGE FOR OPENSTACK● Deeply integrated with modular architecture and components for ephemeral

& persistent storage Nova, Cinder, Manila, Glance, Keystone, Swift

● Optimized for Database as a Service (DaaS) with MySQL workloads● Bundled in Red Hat OpenStack Platform

ADVANTAGES FOR OPENSTACK USERS● Instantaneous booting of 1 or 100s of VMs● Instant backups via seamless data migration between Glance, Cinder, Nova● Tiered I/O performance within single cluster● Multi-site replication for disaster recovery or archiving

SCALABILITYHundreds of nodesCRUSH algorithm (placement and rebalancing)No single point of failure

SCALABILITYHundreds of nodesCRUSH algorithm (placement and rebalancing)No single point of failure PROTOCOLS

S3, SwiftCinder block storagePOSIX (Tech preview - TP)NFS to S3 gateway (TP)iSCSI (2.1)

PROTOCOLSS3, SwiftCinder block storagePOSIX (Tech preview - TP)NFS to S3 gateway (TP)iSCSI (2.1)

SECURITYPool-level authenticationActive Directory, LDAP, Keystone v3At-rest encryption

SECURITYPool-level authenticationActive Directory, LDAP, Keystone v3At-rest encryption DATA SERVICES

Snapshots, cloning, and copy-on-writeGlobal clusters for S3/Swift storage (New)Disaster recovery for block storage (New)

DATA SERVICESSnapshots, cloning, and copy-on-writeGlobal clusters for S3/Swift storage (New)Disaster recovery for block storage (New)

PERFORMANCEClient-side cachingServer-side journalingBlueStore (TP)

PERFORMANCEClient-side cachingServer-side journalingBlueStore (TP)

EFFICIENCYStandard (commodity) hardware Erasure coding (reduced footprint)Thin provisioning

EFFICIENCYStandard (commodity) hardware Erasure coding (reduced footprint)Thin provisioning

FEATURES, NO FLUFF

Red Hat Ceph Storage 2

WHAT’S NEW IN 21. New storage management platform, “Red Hat

Storage Console 2” 2. RGW geo-clusters with single namespace3. RBD Mirroring to enable multi-site replication for

disaster recovery and archival4. Support for Active Directory, LDAP, and Keystone v3 5. Improved S3 and Swift protocol API support 6. Tech preview of CephFS7. Tech preview of NFS to S3 gateway 8. Tech preview of BlueStore turbocharge

NEW INTEGRATED MANAGEMENT WITH RED HAT STORAGE CONSOLE 2

• Easy to use graphical interface to manage storage cluster life cycle

• Ansible-based deployment tools for installation, importation, and granular configuration from CLI or GUI

• Monitoring and troubleshooting with statistical and graphical information about cluster components

RADOS. RGW, RBD, CALAMARI

RED HAT STORAGE CONSOLE 2

CLUSTER OF STANDARD SERVERS AND MEDIA

CLIENTSADMINS

RED HAT STORAGE CONSOLE 2BENEFITS

• Ease of use Integrated on-premise management console and service dashboard Easy installation, management, and monitoring from modern UI

• Comprehensive visibility Unified view of storage infrastructure Enhanced discovery, insight, and management

• Operational intelligence Proactive health management, capacity and performance utilization

through advanced monitoring and diagnostic information

Great improvements to RGW, Ceph’s object storage interface:• Support for authentication using Active

Directory, LDAP & OpenStack Keystone v3• Greater compatibility with the Amazon S3

and OpenStack Swift object storage APIs• AWS v4 signatures, object versioning, bulk deletes

• New NFS gateway for bulk import and export of object data (tech preview)

OBJECT STORAGE IMPROVEMENTS

Global object storage clusters with single namespace• Enables deployment of clusters across

multiple geographic locations• Clusters synchronize, allowing users to

read from or write to the closest oneMulti-site replication for block devices• Replicates virtual block devices across

regions for disaster recovery and archival

NEW MULTISITE CAPABILITIES

USERUSER

CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY

USERUSER

CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY

STORAGE CLUSTERUS-EAST

STORAGE CLUSTERUS-WEST

PERFORMANCE BOOST WITH BLUESTORE

• New storage backend optimized for modern media - Tech preview in RHCS 2

• Replaces FileStore, optimized for HDDs – file system for object data management impacted performance

• Benefits of BlueStore:• 2-3X performance  • Mitigates need for underlying file system or dedicated journal device• Flexible media topologies (SSDs, K/V drives, persistent memory

devices) to help optimize data or metadata I/O• Native checksumming to detect data corruption on media

OPENSTACK FILE SUPPORT WITH CephFS• POSIX-compliant file system to store data in accordance

with OpenStack Manila Project• Tech Preview RHCS 2 – Manila Tech Preview OSP 7, 8• FUSE or kernel clients (RHEL 7.2) • CephFS Manila driver (tech preview) with OSP 9 • Roadmap: robustness, hardening, then scalability

November 2015: Manila Tech

Preview in OSP 7

July 2016: CephFS tech preview in RHCS 2 and clients

August 2016: CephFS Manila

driver tech preview in OSP 9

November 2016: Manila production support in OSP 10

2017: CephFS production

support RHCS 2.x

Timeline is Red Hat Confidential

The other guys

Description Software-defined, unified storage and distributed object store

Traditional NAS & SAN appliance (still requiring two storage systems)

Capacity 1000s of nodes, limitless petabytes ~6 PBs

Scalability Easy to add and manage- via single nodes on standard servers and disks

Difficult - via forklift installation of additional appliances

VM migration and backups

Live, instantaneous, for high agility in cloud environments

Cumbersome and slow: Image pulled from Swift for each instance

Design process Open source Proprietary

Maintenance Nodes added and removed on fly Appliance replacement impacts data migration and downtime

Cost Pay-as-you-go OPEX, economical at scale Large upfront CAPEX, much (75%+) more expensive on PB+ workloads

COMPARING AND CONTRASTING THE OPTIONS

SERVICE OFFERINGS

SERVICES AVAILABLE FROM RED HATSpanning Red Hat Ceph Storage and Red Hat OpenStack Platform

Subscription Benefits – Streamlined product and resource access, lifecycle management, Knowledgebase and deployment resources, security and accountability

Jumpstart - 3 day consulting for pre-production cluster implementation at customer site Health Check - 3-5 day evaluation of total solution best practice engagement Red Hat Storage Consulting Services - recommended for initial storage design and set-up Global Services and Support - production subscriptions for smooth lifecycle deployments Red Hat Storage training – 2 and 5 day for storage or cloud admins, including OpenStack

REFERENCE ARCHITECTURES

http://www8.hp.com/h20195/v2/GetPDF.aspx/4AA5-8638ENW.pdf

REFERENCE ARCHITECTURES Performance and Sizing Guide: Red Hat Ceph Storage on Supermicro Storage Performance and Sizing Guide: Red Hat Ceph Storage on QCT Servers Deploying Red Hat OpenStack Platform 7 with Red Hat OSP director 7.1 (Access via customer portal)

Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 7 Cloud (Access via customer portal)

Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 6 Cloud (Access via customer portal)

Deploying Highly Available Red Hat OpenStack Platform 6 with Red Hat Ceph Storage Deploying Red Hat OpenStack Platform 6 with Ceph Storage Dell Red Hat Cloud Solutions Reference Architecture Guide Cisco UCS C3160 High-Density Rack Server with Red Hat Ceph Storage

 

CLOSING TIME

WHERE TO GO NEXT? Red Hat Subscriptions: https://access.redhat.com/subscription-value

Evaluation, Pre-production, and Production contracts available through Red Hat sales Red Hat Consulting: http://www.redhat.com/en/services/consulting/storage Red Hat Storage training: https://www.redhat.com/en/services/training Red Hat Storage test-drive: http://red.ht/cephtestdrive

Web: www.redhat.com/storage Blog: http://redhatstorage.redhat.com/ Twitter: www.twitter.com/redhatstorage Facebook: www.facebook.com/RedHatStorage/ YouTube: www.youtube.com/user/redhatstorageSlideshare: www.slideshare.net/Red_Hat_Storage

THANK YOU,and please stay in touch!