red hat netapp openstack webinar-final Storage August 21, 2014 ... Cloud Solutions Group, NetApp...

Deploying Red Hat Enterprise Linux OpenStack Platform 5 on NetApp Storage  August 21, 2014   Bob Callaway  Technical Marketing Engineer, Cloud Solutions Group, NetApp

 Colin Devine  Technical Partner Development Manager, Virtualization & OpenStack, Red Hat

© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only 1

Agenda

1)  Introductions

2) Overview of RHEL-OSP5

3) NetApp’s OpenStack Integrations

4) Deploying RHEL-OSP 5 and NetApp in an HA configuration

5) Manila: OpenStack File Share as a Service

6) Q & A


Introductions Who are Bob & Colin?


!  Technical Marketing Engineer, Cloud Solutions Group, NetApp

!  ATC on various OpenStack projects

!  PhD from NC State University

Introductions

!  Technical Partner Business Development Manager, Virt/OpenStack

!  8 years at Red Hat

!  RHCE, RHCVA, CL210


Red Hat Enterprise Linux OpenStack Platform 5 Overview


RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908

WORKLOADS ARE EVOLVING

TRADITIONALWORKLOADS

● Typically resides on a single large Virtual Machine

● Cannot tolerate any downtime● Needs expensive high availability

toolsfound in VMware vSphere

● Application scales up rather than out

CLOUDWORKLOADS

● Workload resides on multiple Virtual Machines

● Tolerates VM failure – if one fails, another quickly replaces it

● Fault tolerance often built into workload

● Application scales out rather than up


OPENSTACKCLOUD INFRASTRUCTURE FOR CLOUD

WORKLOADS

● Modular architecture, designed to easily scale out● Based on (growing) set of core services


● Modular architecture, designed to easily scale out● Based on (growing) set of core services ● It is dependent on the underlying Linux...

OPENSTACKCLOUD INFRASTRUCTURE FOR CLOUD

WORKLOADS

LINUX


RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM 4.0

OPTIMIZED FOR AND INTEGRATED WITH RED HAT ENTERPRISE LINUX

RED HAT ENTERPRISE LINUX


OPENSTACK ARCHITECTURE

● Modular architecture

● Designed to easily scale out

● Based on (growing) set of core services


RED HAT CONTRIBUTION TIMELINE


RED HAT UPSTREAM FOCUS

● Heavily engaged in community since 2011

● Established leadership position in community

● Both in terms of governance and technology

● Including several PTLs on multiple core services projects

● Creating and leading stable tree

● 2nd largest contributor to Folsom Release

● Largest contributor to Grizzly, Havana, and Icehouse releases

● Note: These statistics do not include external dependencies

eg. libvirt, kvm, Linux components


RED HAT UPSTREAM FOCUS

Source: Bitergia http://activity.openstack.org/dash/releases/index.html?data_dir=data/icehouse

Top Contributor to Icehouse Release

0

500

1000

1500

2000

2500

3000

3500

Red Hat

IBM

HP

Rackspace

Mirantis

SUSE

OpenStack Foundation

eNovance

Intel

0

50

100

150

200

250

300

350

400

Red Hat

Others

HP

Mirantis

IBM

Rackspace

Canonical

OpenStack Foundation

Dreamhost

● Overall commits per company (aggregated)

● Closed Tickets per company (aggregated)


RED HAT'S OPENSTACK LEADERSHIPWHY DO THESE STATISTICS MATTER?

● Proof that Red Hat has skills, resources to:● Support customers● Drive new features● In;uence strategy and direction of project● Enable partner collaboration

● Wide ranging participation, contrasts with most others who are more narrowly focused

● Important to highlight our leadership in the whole stack● Linux, KVM, libvirt, etc

● RHEL-OSP is an enterprise-grade distribution with ecosystem, lifecycle, and support that customers expect from Red Hat


BUILDING A COMMUNITY

● RDO Project

● Community distribution of OpenStack

● Packaged/tested for *EL6 and *EL7 and derivatives

● Freely available without registration

● Easy to install

● Vanilla distribution – closely follows upstream

● Upstream release cadence

● 6 month lifecycle – limited updates based on upstream


OPENSTACK PROGRESSION

Enterprise hardened

Red Hat OpenStack

technology

optimized for

and integrated with

Red Hat Enterprise Linux

Red Hat Support

Red Hat ecosystem

certi5cations

1+ year lifecycle

Bleeding edge upstreamOpenStack source code

Unstable community Linux

No certiCcationsCommunity supportSix month lifecycle

Bleeding edge upstreamOpenStack packaged as

RPMs

Enterprise Linux distros

(CentOS, RHEL, Fedora)

No certiCcationsCommunity supportSix month lifecycle


WHY RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

● All beneCts of community OpenStack and...● Enterprise hardened code

● Co-engineered and integrated with Red Hat Enterprise Linux

● Enterprise software lifecycle

● World-class global support

● Worlds largest OpenStack partner ecosystem

● OpenStack training and certiCcation

● Integrated with trusted Red Hat stack● Red Hat CloudForms ● Red Hat Enterprise Virtualization● Red Hat Storage


● A typical OpenStack cloud is made up of at least 10 core services (Nova, Cinder, Keystone, Neutron,

glance, etc) + plugins to interact with 3rd party systems – eg. storage arrays, network switches.

● These services run on top of a Linux distribution with a complex set of userspace dependencies, requiring tight integration

● A supported, stable platform requires integration and testing of each of the components

THE IMPORTANCE OF INTEGRATION WITH LINUX...


● Many of the most complex features are provided by Linux with OpenStack providing management and orchestration

● For example: virtualization provided by the KVM hypervisor, with libvirt management interface, interacting with Open vSwitch userspace switch, transitioning to the kernel's networking stack to handle network namespaces – Each potentially managed by diGerent OpenStack services.

● These components need to be engineered & productized together

● OpenStack cannot be productized as a layered product



● Examples of RHEL optimized enablers for OpenStack:

● Virtualization – guest performance, reliability, and Windows

● Security - SELinux enforcing guest isolation● Network – SDN/OVS performance optimized● Storage – vendor plugins, performance, thin provisioning● Ecosystem – certiCcation of hardware, storage, and

networks

● The pairing of the Linux operating system and OpenStack is so tight that Red Hat Enterprise Linux OpenStack Platform is the only combination that can most eGectively support functionality, performance, security, system-wide stability, and ecosystem support



Red Hat Enterprise Virtualization Hypervisor*Red Hat Enterprise Linux KVM

● Lightweight / small footprint

● Less overhead

● Smaller attack surface

● Cost effective

● Closer to operating system DNA

● Provides massive scale-out capabilities

RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

HYPERVISOR SUPPORT

VMware vSphere*vCenter Driver

● Co-exist with existing infrastructure assets

● Provides a seamless path to future migration to OpenStack

● Uses NSX1 plugin for Neutron

1NSX is only supported in production environments, per VMware's support requirements

*ESXi driver not supported


●Red Hat Enterprise Linux 3




*32 and 64 bit for all versions

●SUSE Linux Enterprise Server 10

●SUSE Linux Enterprise Server 11

*32 and 64 bit for all versions

●Windows XP SP3+1

●Windows 73

●Windows 83

Microsoft SVVP Certified●Windows Server 2003 SP2+3

●Windows Server 20083

●Windows Server 2008 R22

●Windows Server 20122

1 32 bit only2 64 bit only3 32 and 64 bit

GUEST SUPPORT


WORLD'S LARGEST OPENSTACK PARTNER ECOSYSTEM

OEMs and IHVs ISVs

Cloud Service ProvidersSystem Integrators

Channel PartnersManaged Service Providers

● Over 235+ members since launch in April 2013

● Over 900 certified solutions in partner Marketplace

● Over 4,000 RHEL certified compute servers

● Over 13,000 applications available on RHEL

● Large catalog of Windows certified applications

Red Hat OpenStack Cloud Infrastructure Partner Network


THREE WAYS TO GET OPENSTACK FROM RED HAT

2

3

1

PURCHASE SUPPORTED PRODUCT90-DAY EVALUATION

redhat.com/openstack/evaluation

Learn more at: redhat.com/cloud

RED HAT ENTERPRISE LINUX OPENSTACK PLATFORMDOC144908 RED HAT OPENSTACK TECHNOLOGY (TECHNICAL PRESO) | 2013

NetApp’s Integrations with OpenStack Overview


!  OpenStack Foundation !  Charter member (Gold level) !  OpenStack Summit Sponsors

NetApp’s OpenStack Involvement

!  1st Major Storage Provider !  Upstream Contributions !  Production Deployments

!  Deployer of OpenStack


NetApp Joins

Integration Announced

Folsom Summit Sponsor

7-mode driver in

Essex

Havana Summit Sponsor

Direct Drivers in

Grizzly

Kilo Summit Sponsor

Manila

Incubation*

Essex Summit Sponsor

7-mode driver

previewed

Grizzly Summit Sponsor

Clustered

ONTAP driver in Folsom

Icehouse Summit Sponsor

RHEL-OSP on

FlexPod

Swift on E-series

2012.4 2013.4 2014.10 2011.3 2011.10 2012.10 2013.10 2014.4

Juno Summit Sponsor

E/EF-series

drivers in Icehouse

Integration Overview


Shared Files

Compute

Image Object Storage

Block Storage

Clustered Data ONTAP

Image

Networking

Shared Services

E/EF-Series FlashRay StorageGRID

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute

Persistent, rapid, space-efficient instances

NetApp’s Core Competencies


E-Series FAS

Service Automation Quality of Service

Unified Architecture

Storage Efficiency Seamless Scaling

Secure Multi-Tenancy

Continuous Operations

Data Mobility Data Protection

Simplicity

Vast Bandwidth Density

Consistency Horizontal Scaling

Broad Connectivity

Versatility

Data Mobility All-Flash

!  File or Swift backends !  Simplicity advantage to File !  Rapid instance creation capability with File

Storage Efficient Image Registry & Repository Glance on Data ONTAP



Glance on NetApp

RHEL Fedora CentOS

CentOS Fedora CentOS CentOS CentOS Fedora

RHEL RHEL Fedora RHEL RHEL Fedora

90%+ Deduplication rates are often

observed

3 Copies… Commonly More Swift on JBOD


Swift Deployment

Storage Node

Storage Node

Storage Node Any single object stored three or more

times

Efficient Storage and Scaling Swift & Dynamic Disk Pools

!  Dynamic distribution / re-distribution of data “De-clustered” RAID

!  Deploying Swift with NetApp E-Series reduces: !  Required storage capacity !  Ongoing cost of operations !  Deployment footprint !  Replication traffic between Swift nodes


DDP reduces disk rebuild

times by

90%

Cinder deployment with NetApp Diverse Options for Diverse Use Cases


Clustered ONTAP

7-mode

E-Series

EF-Series

pNFS

NFS iSCSI

NFS

iSCSI

iSCSI

iSCSI

Cinder Volume Types Deliver Differentiated Block Storage Offerings

!  Craft a catalog based upon tenant workload requirements

!  Compose Cinder volume types with: !  Efficiency !  Performance !  Availability !  Protection


Cinder Volume Types

Archival

netapp:raid_type

netapp:disk_type

netapp:qos_policy_group

netapp_mirrored

netapp_dedup

netapp_nodedup

netapp_compression

netapp_thin_provisioned

netapp:raid_type

netapp:disk_type


netapp_mirrored

netapp_dedup

netapp_nodedup

netapp_compression


netapp:raid_type

netapp:disk_type


netapp_mirrored

netapp_dedup

netapp_nodedup

netapp_compression


netapp:raid_type

netapp:disk_type


netapp_mirrored

netapp_dedup

netapp_nodedup

netapp_compression


netapp:raid_type

netapp:disk_type


netapp_mirrored

netapp_dedup

netapp_nodedup

netapp_compression


Analytics Streaming Temporal Database

Policy-Based Block Storage Service


Cinder

SnapMirror

Silver

Remote Clustered ONTAP

Boot 8 CentOS LAMP instances with 2TB of

Silver please

Volume Types

Gold Bronze Silver Silver

Enhanced Instance Creation Instant, storage efficient persistent root disks



Boot 8 persistent RHEL instances… Glance on NetApp

Cinder on NetApp

Hypervisor

RHEL RHEL RHEL RHEL

RHEL RHEL RHEL RHEL

RHEL RHEL RHEL

RHEL RHEL RHEL RHEL

•  Cloned, not copied •  Instances, instantly

RHEL Fedora CentOS

RHEL

Highly Available Deployments of RHEL-OSP 5 and NetApp Storage


Staypuft choices Architecture of a highly available OpenStack deployment

!  With/without Neutron

!  Database

!  Messaging subsystem


!  Individual Cinder volumes are represented by: !  A File on NFS export !  An iSCSI LUN

!  A Cinder backend should map to a storage virtual machine

!  NFS is the recommended storage protocol !  More scalable than iSCSI !  Negligible performance degradation !  Proven solution with hypervisors for many years

Clustered DATA ONTAP NetApp Storage Layout


Networking Best Practices

!  Follow the best practices in the OpenStack Security Guide

!  10GbE

!  Separate storage management traffic from storage data traffic

!  Use bonding (link aggregation) to provide resiliency to link failure & improved bandwidth

!  NTP

!  Use iSCSI multipath

!  Jumbo frames for storage data traffic

!  Load balancers with health checks for OpenStack services


Network Diagram


Logical Management Networks


Logical Data Networks


Available today! HA Reference Architecture

!  TR4323-DESIGN: “Highly Available OpenStack Deployments Built on NetApp Storage Systems” !  Solution Design document based on Icehouse !  Includes best practices for networking, storage, high availability

!  Available for download from http://www.netapp.com/openstack/

!  Follow us on Twitter for @openstacknetapp – we’ll tweet out a direct link when it’s posted !  Also NetApp’s OpenStack blog: http://netapp.github.io/openstack/

!  RHEL-OSP5 & NetApp Solution Deployment guide (based on TR4323) !  Scheduled to be published before Kilo design summit in Paris


Manila: The OpenStack File Share Service Brief Overview


* Per IDC report, 2012


storage sold in 2012 for Shared File Systems* 65 %


Manila


Finance R&D Marketing

Share “R&D” with Instances 1 & 3

Create a “Marketing” share

for 2 & 4

Nova

Hypervisor

VM VM VM VM VM VM

Processes & Interaction Manila Architecture


REST

Manila Processes

Horizon Control Path

manila-api manila-scheduler

manila-share Driver

manila-share Driver

manila-share Driver

!  Not in the path of storage data traffic

!  Closely mirrors architecture of Cinder !  API, Scheduler, Share processes !  Multiple backends supported !  Share types

!  Interacts with Neutron !  Ensure shares are accessible over tenant-

specific network !  Align multi-tenancy models between share

backend and Neutron network

Manila: NetApp Clustered Data ONTAP Driver

! Driver points at an existing Clustered Data ONTAP deployment

! A new storage virtual machine (SVM) is created for each share network

! Create a new Data Logical Interface (LIF) with the VLAN tag set to same VLAN tag of the Neutron network associated with the share network

! Access permissions are set at the controller for guests


manila create!

Control Path

Data Path

Manila

mount -t nfs!

Neutron

nova-compute

NFS

nova-compute

Manila: Gluster Driver

! Use Gluster to provide a Distributed Scale Out File System backend for Manila File Shares

! Current: Single Tenant GlusterFS driver using Gluster-NFS

! Future: Multi-Tenant driver that uses NFS Ganesha


/Gluster_Manila_Volume

/Marketing • 10.1.1.1 • 10.1.1.2

/Sales • 10.1.1.1

/Eng • 10.1.1.3

10.1.1.1 • Sales • Marketing

10.1.1.2 • Marketing • Eng

10.1.1.3 • Eng

manila create!manila access-allow!

Nova Compute

Control Path

Data Path

Manila Processes

manila-api manila-scheduler

manila-share Gluster Driver

manila-share Driver

manila-share Driver

Summary


A Winning Combination Red Hat Enterprise Linux OpenStack Platform 5 & NetApp

!  The combination of RHEL-OSP 5 and NetApp allows you to: !  efficiently and effectively deploy OpenStack in an enterprise environment with strict SLAs !  take advantage of your current infrastructure investment !  make OpenStack consumable and safe for the enterprise

!  NetApp’s OpenStack Block Storage drivers are certified by Red Hat for use with: " NetApp clustered Data ONTAP & Data ONTAP operating in 7 Mode " NetApp E-Series & EF-Series " Both NFS and iSCSI storage protocols " Red Hat Enterprise Linux OpenStack Platform versions 3, 4, and 5


Questions?


Date post:	10-Mar-2018
Category:	Documents
Upload:	trandang
View:	220 times
Download:	2 times

red hat netapp openstack webinar-final Storage August 21, 2014 ... Cloud Solutions Group, NetApp...

Documents