Date post: | 15-Apr-2017 |
Category: |
Technology |
Upload: | redhatstorage |
View: | 115 times |
Download: | 0 times |
Persistent Storage for Containers with Red Hat Gluster Storage
Red Hat Storage Day, NYC Sayan Saha Product, Red Hat Storage Oct 2016
Linux for app/dev-centric IT
• The “cluster” is the computer
• The scope of the OS is now the “cluster” – automate deployment, scaling and upgrade of workloads
• Orchestrators (like Kubernetes, Marathon,
Swarm) is the heart of this new OS
Meet OpenShift! • Red Hat’s next gen app platform -
kubernetes for enterprise + Add-Ons. • Why?
• Consistent application run time across the hybrid cloud
• Anti lock-in abstraction layer • Runs everywhere including public clouds, VMW and
OSP!
APPLICATION
Abstraction Across Hybrid Cloud
DEVELOPER CONTENT ECOSYSTEM
PACKAGED SERVICES ECOSYSTEM
DEVELOPER TOOLING
MANAGEMENT TOOLS
Storage Network Identity ...
Stand A
lone / B
are Metal
RH
EV
RH
EL O
SP
VM
Ware
PU
BLIC
C
LOU
D
- AW
S
- AZU
RE
- G
OO
GLE
OpenShift provides a scale-out, “the cluster is the computer platform” to deploy fully-orchestrated multi-container applications. Built on RHEL Atomic Host in the immutable infrastructure paradigm, the docker project, OCI, etcd, kubernetes, systemd. Application is defined in abstraction from Infrastructure provider details, works across different cloud providers, integrates with infrastructure services. Fully Open Source, Standards-based, pluggable.
OpenShift RHEL / Atomic Host
Docker / OCI Kubernetes Registry
Host Automation Infrastructure Service Integration (Storage, Network, Identity,...)
Log / Metrics Security
CONTAINERS NEED PERSISTENT STORAGE
“For which workloads or application use cases have you used/do you anticipate to use containers?” Data Apps
Cloud Apps Systems of Engagement
Systems of Record Web and Commerce
Software Mobile Apps Social Apps
77% 71% 62% 62% 57% 52% 46%
Scalable, Cost Effective, Distributed Storage for Containers
Base: 194 IT operations and development decision-makers at enterprise in APAC, EMEA, and North America Source: A commissioned study conducted by Forrester Consulting on behalf of Red Hat, January 2015
The new face of storage in app-centric IT
• Greater abstraction between storage and applications allows more flexibility
in deployment
• Developers want persistent storage but do not want the overhead of
lengthy storage provisioning cycles
• Traditional storage appliances cannot offer the speed and agility required
in app-centric IT
DRIVING THE FUTURE OF STORAGE
Nov 2015 Mar 2016 July 2016
CONVERGENCE OF STORAGE AND COMPUTE
RHGS Container
● Dedicated storage cluster for containerized and PaaS environments
● Containerized Red Hat Gluster Storage pooling and serving storage from local hosts
CONTAINER READY STORAGE CONTAINERIZED STORAGE CONTAINER NATIVE STORAGE
● Containerized Red Hat Gluster Storage inside OpenShift Enterprise
● Enabled by the RHGS 3.1.3
release
● Enterprise class storage for container platforms
CONTAINER NODE 1
CONTAINER NODE 2
NGINX Container
Wordpress Container
CONTAINER READY STORAGE
• Storage provided by a dedicated Red Hat Gluster Storage cluster and accessed over the network
• Enterprise grade storage provider
support for OpenShift
• Storage & compute can scale independently
CONTAINER NODE 1
CONTAINER NODE 2
NGINX Container
NGINX Container
CONTAINERIZED RED HAT GLUSTER
STORAGE
CONTAINERIZED RED HAT GLUSTER STORAGE
• Red Hat Gluster Storage can be deployed inside a container
• Storage Container can pool and
serve out storage from local hosts • Available for download from Red
Hat’s container registry
OPENSHIFT NODE 2
CONTAINER NATIVE STORAGE
OPENSHIFT NODE 3
OPENSHIFT NODE 1
RHGS Container RHGS Container
OPENSHIFT NODE 4
MASTER NGINX Container NGINX Container
Elasticsearch
RHGS Container
• Gluster runs inside OpenShift in a container
• App & Gluster containers can
run side-by-side. Lower TCO. • Unified orchestration &
upgrade for applications and storage via kubernetes
Red Hat Gluster Storage Features þ Data Services
þ Erasure Coding þ Tiering þ Bit-Rot Detection þ Snapshots þ Quotas þ Mirroring/Sync Replication þ Async Geo Replication
þ Protocols þ Active/Active NFSv4 þ SMB3 (protocol negotiation, in-flight
encryption, server-side copy, VSS)
þ Management þ Dashboard þ Device Management þ SNMP þ Ansible based deployer þ Rolling Upgrades þ AD integration
þ Security & Data Integrity
þ SSL based in-flight encryption þ At-rest encryption using dm-crypt þ SELinux Enforcing Mode þ Self Healing
Static V/S Dynamic Provisioning With Static Provisioning in kubernetes (available now) • Storage volumes are statically provisioned • Admins provision a bunch of Persistent Volumes (PVs) in advance • They carry the details of storage available in a cluster
With Dynamic Provisioning (available in a couple of months) • Allocate (and deallocate) storage volumes (PVs) on demand • Storage claims from developers are “bound” dynamically to volumes with
zero admin intervention
Persistent Storage for OpenShift 3.4
Container Native + Container Ready
Dynamic Provisioning
support
Usability improvements
GA: Dec 2016
Persistent Storage for OpenShift 3.5+
Container Native + Container Ready
Support for containerized database workloads via non-shared persistent
storage
GA: H1-2017 Support databases like MySql,
PostGres, MariaDB are often the #1 workloads enterprises
containerize
Address customer pain point of static/inflexible storage
provisioning.
ROADMAP
Resources Webinars, data sheets, videos, blogs
redhat.com/containerstorage
Demo
https://asciinema.org/a/50531
Live Presentation (Red Hat Summit 2016)
https://youtu.be/gmEUnOmDziQ
Product Documentation
http://red.ht/2bjxOTX
Heketi Project
https://github.com/heketi/heketi
Dynamic Provisioning of Storage
Developer Developer owned
Configures Classes
claim
Claim for “Gold”
Claim request specifies a class
References claim in pod
Pod
Administrator
Gold Silver Bronze
IOPS_SSD GP_SSD NFS
Administrator owned
Persistent Storage for OpenShift 3.1
Container Ready
Native Kubernetes driver
Support for RHGS 3.1
Support for RHCS 1.3
Released: Nov 2015
Persistent Storage for OpenShift 3.3
Container Native
Revalidate the solution
PV Selector Support
Released: Oct 2016
Persistent Storage for OpenShift 3.2
Container Native
RHGS runs inside OpenShift
in containers/pods
API driven volume allocation
Statically Provisioned Volumes
Released: July 2016 ● Revalidate that it still works!
● PV selector helps developers select the correct storage back-end from similar kinds (NFS v/s Gluster)
Enterprise grade storage provider for app
containers.
● Unified compute + storage orchestration for developers
● Lower TCO. No separate storage h/w