Extending TripleO for OpenStack Management

( slide ) previous | next#RedHatCloud

Extending TripleO for OpenStack Infrastructure Management

1

Keith BasilPrincipal Product Manager, Red Hat

OpenStack Summit AtlantaMay 2014


Keith Basil

๏ personalVirginia hare scrambler, plays chess..

๏ professionalRed Hat

Cloudscaling, Time Warner Cable,FederalCloud.com, Cisco and a couple of startups

๏ blendedskype/twitter/github/irc, life: noslzzp

2

( slide ) previous | next#RedHatCloud 3

๏ Setting Context๏ TripleO Explained (easy)๏ TripleO Explained (detail)

๏ OpenStack in a Minute or So

๏ OOO

๏ Tuskar

๏ Deployment Flow

๏ TripleO as Management Platform

๏ OpenStack Vendor Integration Profiles

๏ TripleO Momentum๏ Questions

Agenda


Setting Context

4


OpenStack Deployment and Management facilitates planning, deployment and on-going operations of OpenStack clouds.

5


Our Goal: A Deployed and Managed Cloud

6

๏ Planning๏ What will this OpenStack deployment look like? Topology? Resource

capacity?

๏ Deployment๏ Hardware and service lifecycle

management. Policy driven process.

๏ Operations and Management๏ Visualize capacity, metrics & instrumentation


“bla,bla,bla, OpenStack, bla,bla,bla, Cloud, bla,...”

COMPLEXITY!


Deployment & Management Landscape Today

8

Open Source Deployment Options Some Commercially Supported Options

Razor

DIY(do it yourself)

Crowbar

PackStack

Highly fragmented and mostly about solving the complexity of deployment!


Where’s the Love?

9

OpenStack Operators

OpenStack Developers

Over 16,000 community members!

138 countries!

Wait, how many operators?

Who cares!,

just +1 my code!


Operator Heroes..

need love too..

10

http://sharpwriter.deviantart.com/art/Welcome-to-the-Internet-Please-Follow-me-322248378http://creativecommons.org/licenses/by-nc-nd/3.0/

Operator headband, BOFH Slayer gun handle and OpenStack unicorn branding added for effect. Not for redistribution.


Provides a complete end-to-end infrastructure management solution for OpenStack business planning, system deployment and ongoing operations.

๏ Core features:๏ Comprehensive Operator Dashboard

๏ Cloud resource planning and modeling

๏ Deployment and provisioning

๏ Cloud metrics and instrumentation

TripleO For Infrastructure Management

11

block storage (NetApp)


TripleO Explained (easy)

12


OpenStack on OpenStack

13

... but let’s ignore the complexity for now.


Imagine if you will..

14

An OpenStack Deployment and Management Application


An Application Featuring ...

๏ Deploying OpenStack to bare metal

๏ OpenStack community adopted๏ Providing visual status of core

services and cloud infrastructure

๏ Offering platform extensibility๏ Providing integration via well

known APIs๏ Is cloud operator focused!๏ Naturally resilient and scalable

15



Sounds cool ... more please!

16


TripleO Explained (more detail)

17


OpenStack in a Minute or So

18


๏ OpenStack components* manage compute, network and storage resources

OpenStack - a quick review..

19

Heat

Glance

Neutron

Nova

VMOS image, network, disk,

instrumentation

Virtual MachineDeployment

Ceilometer

*Only a select subset of OpenStack components are shown here.



OpenStack - Nova, Heat & Ceilometer

20

Heat

Glance

Neutron

Nova


instrumentation


Ceilometer

Nova provides command and control services for compute nodes.

It orchestrates rendering of virtual machines.




21

Heat

Glance

Neutron

Nova


instrumentation


Ceilometer

Heat provides an orchestration engine to launch multiple cloud applications based on templates.

Heat manages the whole lifecycle of the application by managing the underlying virtual infrastructure




22

Heat

Glance

Neutron

Nova


instrumentation


Ceilometer

Ceilometer provides acquisition of usage data across OpenStack core

components.

Ceilometer data is used to reconcile billing or chargeback of consumed

cloud resources.


OOO

23


๏ Re-uses OpenStack components to deploy OpenStack on hardware.

The Concept of TripleO

24

Heat

Glance

Neutron

Nova

Hardware NodeDeployment & Management

Ceilometer

Bare MetalOS image, network, disk,

instrumentation


๏ TripleO uses Nova and Ironic to deploy to hardware

Nova provides command and control services for hardware

nodes. Nova’s scheduler matches bare metal flavors to hardware.

It orchestrates the rendering of bare metal* by treating Ironic’s API as a

special bare metal hypervisor.


25

Heat

Glance

Neutron

Nova

Ceilometer

* Today, TripleO uses Nova bare metal drivers. As Ironic matures these will be deprecated.


instrumentation

Hardware NodeDeployment


๏ For hardware, Heat templates encapsulate the equivalent of a cloud resource reference architecture

Here, Heat provides deployment orchestration for hardware nodes.

Heat templates capture hardware configuration for consistent and

repeatable deployment scenarios.


26

Heat

Glance

Neutron

Nova

Ceilometer Hardware NodeDeployment Orchestration


instrumentation


instrumentation


instrumentation


๏ Ceilometer provides the framework for metrics and instrumentation data collection

Ceilometer is used to collect metrics on the underlying OpenStack infrastructure.

Metrics and instrumentation data can be rolled up for visualization.


27

Heat

Glance

Neutron

Nova

Ceilometer Hardware NodeStatus


instrumentation


Tuskar

28


๏ Tuskar provides deployment management services for TripleO๏ Follows same component re-use model as TripleO๏ Introduces the Tuskar operator UI, CLI and API

Tuskar Overview

29

Ceilometer

Tuskar

Horizon

# create an overcloud with 1 controller and 1 compute nodetuskar overcloud-create overcloud \ --description "My overcloud" \ --attribute "AdminToken=${OVERCLOUD_ADMIN_TOKEN}" \ --attribute "AdminPassword=${OVERCLOUD_ADMIN_PASSWORD}" \ --attribute "CinderPassword=${OVERCLOUD_CINDER_PASSWORD}" \ --attribute "GlancePassword=${OVERCLOUD_GLANCE_PASSWORD}" \ --attribute "HeatPassword=${OVERCLOUD_HEAT_PASSWORD}" \ --attribute "NeutronPassword=${OVERCLOUD_NEUTRON_PASSWORD}" \ --attribute "NovaPassword=${OVERCLOUD_NOVA_PASSWORD}" \ --attribute "NeutronPublicInterface=$NeutronPublicInterface" \ --attribute "SwiftPassword=${OVERCLOUD_SWIFT_PASSWORD}" \ --attribute "SwiftHashSuffix=${OVERCLOUD_SWIFT_HASH}" \ --attribute "NovaComputeLibvirtType=$OVERCLOUD_LIBVIRT_TYPE" \ --attribute "GlanceLogFile=''" \ --attribute "NeutronDnsmasqOptions=dhcp-option-force=26,1400" \ --role-count $controller_role_id=1 \ --role-count $compute_role_id=$COMPUTESCALE \ --role-count $blockstorage_role_id=$BLOCKSTORAGESCALE \ --role-count $swiftstorage_role_id=$SWIFTSTORAGESCALE

tripleo wait_for_stack_ready 220 10 overcloud

echo "Overcloud CREATE_COMPLETE"

Tuskar

Ceilometer

Horizon


๏ OpenStack Programs are efforts which are essential to the completion of the OpenStack mission.๏ TripleO is the Deployment program

๏ Tuskar’s focus has been on infrastructure management

๏ Tuskar has been merged into TripleO

TripleO is an OpenStack Program

30


Deployment Flow

31


Remember this?

๏ Deploying OpenStack to bare metal

๏ OpenStack community adopted๏ Providing visual status of core

services and cloud infrastructure

๏ Offering platform extensibility๏ Providing integration via well

known APIs๏ Is cloud operator focused!๏ Naturally resilient and scalable

32



๏ Production cloud๏ The OpenStack you know and love

๏ The Cloud that your tenants will use

๏ Also known as the “Overcloud”

๏ Deployment and Management Application๏ Command and Control cloud (TripleO/OpenStack)

๏ Only for Cloud Operator use.

๏ Also known as the “Undercloud”

Key Concept: We Have Two Clouds

33

OpenStack as Deployment and Management Application


Our Goal? We Want an Operational Cloud

34


Deployment and Management Process

35

1. One or more Management Nodes are installed in the control rack.



36

2. Operator logs into Operator Dashboard to configure the infrastructure



37

3. Operator defines the Controller rack.



38

4. Operator defines the Resource racks.



39

5. Controller and Resource racks get provisioned.(Tuskar -> Heat -> Nova -> Ironic -> Hardware)


TripleO as Management Platform

40


OpenStack Management Application Platform๏ TripleO was initially focused on deployment. But, why stop there?

๏ Underlying OpenStack components are there for our use.

๏ Component APIs are well known and understood.

๏ Operations focused use cases are very natural here.

๏ Community partners can build on an open, distro agnostic platform.

๏ We believe TripleO can work as a platform foron-going cloud operations

๏ We believe this will significantly increase OpenStack adoption.

41* http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey

*


OpenStack Vendor FAQs

42

block storageobject storage

HPCcompute

security managementnetwork

service monitoring

What does this mean for ______________________ vendors?


๏ Operator Dashboard๏ Deployment Orchestration

๏ Roles, Services, Elements

๏ Instrumentation Agents๏ Bare Metal Drivers๏ Supporting Components

๏ Adding resources to the production cloud

๏ Special flavor support

๏ Scheduling modifications, etc.

Platform Integration Points (logical view)

43

hardware node hardware node hardware node

Ironic

hardware driver hardware driver

Ironic API

Ceilometer Tuskar Nova

Heat

Horizon


Community Vendor Integration Matrix

44

Integration Component Hardware Vendor Interest? Software Vendor Interest?

Operator Dashboard(Horizon/Tuskar UI) Yes Yes

Bare Metal Drivers(Ironic) Yes Probably Not

Instrumentation(Ceilometer) Yes Probably

Infrastructure Orchestration(Roles, Services, Elements) Yes Maybe / As needed

Supporting Components(scheduler, network, etc) Depends on resource Maybe / As needed


OpenStack Vendor Integration Profiles

45


Warning!

The profiles you are about to see are not promises, product roadmaps or availability announcements

made by the vendors shown or Red Hat.

These are sketches of what could be interesting for OpenStackand exist solely to illustrate possible TripleO integration points.

Got it?

Now back to our show.


NetApp๏ Conducting early work to bring NetApp product line to TripleO

๏ Storage utilization analysis๏ Storage efficiency metrics

๏ System reserve capacity

๏ Free/unused reserve capacity

๏ Cloning, dedupe, snapshot, etc

๏ Heat, Ceilometer, Ironic,Horizon integration points

block storage (NetApp)


Dell๏ Dell and Red Hat working on

TripleO integration๏ Hardware management and

metrics via Ironic(DRAC driver support)

๏ Orchestration of firmware, BIOS, drivers, etc, configuration via Heat

๏ Integration: Horizon, Ironic, Ceilometer, Heat

48


PrivateCore๏ “Privacy of computation” vision๏ Trusted boot, attestation, node

integrity services, etc.๏ Already using Horizon today

๏ Bare metal to tenant use cases๏ Integration points:

๏ Horizon, Ironic, Ceilometer, Tuskar, Overcloud scheduling

49


GroundWork๏ OpenStack Unified Monitoring ๏ Seurat Heat maps๏ GroundWork appliance as

Glance image

๏ Horizon plugin architecture blueprint may be needed

๏ Integration points:๏ Glance, Ceilometer, Tuskar, Horizon

50


Solinea๏ OpenStack infrastructure

monitoring and management ๏ Analysis, diagnostics and Ops

automation

๏ Topology discovery and reports๏ API performance, VM spawns, etc.

๏ Integration points:๏ Horizon, Glance, Heat

51


Ceph and Calamari๏ Ceph cluster visualization,

monitoring, performance statistics and diagnostics

๏ Rolling, continuous upgrades

๏ Heat stacks for Ceph clusters, pre-built images in Glance

๏ Integration points:๏ Glance, Ceilometer, Tuskar, Horizon

52


TripleO Momentum

53


Diverse and Strong Community Work

๏ Red Hat releases InStack, a TripleO based installer for RDO Icehouse๏ HP’s Helion uses TripleO for installation๏ Rackspace doing advanced work with Ironic

(solving for multi-tenancy use case)

54

IronicTripleOTuskar


Gaps๏ Auto-discovery of nodes๏ Complex hardware configuration needs to be supported๏ Infrastructure topology awareness

55


Questions?

56


Thank You!

57

Date post:	26-Jan-2015
Category:	Technology
Upload:	keith-basil
View:	112 times
Download:	2 times

Extending TripleO for OpenStack Management

Technology