+ All Categories
Home > Technology > Heat monasca auto scale

Heat monasca auto scale

Date post: 12-Apr-2017
Category:
Upload: kanagaraj-m
View: 370 times
Download: 1 times
Share this document with a friend
19
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 1 © Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission. Tokyo OpenStack® Summit
Transcript
Page 1: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.1

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

TokyoOpenStack®Summit

Matt Young
I think it is important to provide a quick Heat overview but is there a way to consolidate it into 1 or 2 slides?
Kanagaraj Manickam
should we skip this slide as slide 11 will give more details
Page 2: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

About speakers

Matt Young Product leader with a proven track record for delivering successful products currently leading HP’s Helion cloud operations product strategy. Primary focus areas include deep customer research, agile product discovery, strategic vision definition, sales enablement, product marketing, and holistic user experience.I am an open source advocate and a core contributor to the OpenStack Monasca Project: A highly scalable fault tolerant monitoring system that has been optimized for OpenStack. https://wiki.openstack.org/wiki/Monasca 

Kanagaraj Manickam Sr. Software Engineer @ HP, BangaloreCore-reviewer @ Heat, Openstack.Having 8+ years of experience in HP data-center Server, Storage management and automation products. Having 3+ years of experience in Openstack Cloud.(Trying to bring a new service namos)

Page 3: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Heat Auto-Scaling w/MonascaMatt Young ( [email protected]) Kanagaraj Manickam ([email protected])October 28th, 2015

Page 4: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

“Automate All Things”

Many smart people who enjoy sleeping…

Page 5: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5

Agenda

• About Auto Scaling? -5 mins• Auto-Scaling Cloud Applications Walkthrough -25 mins• Demo – 10 mins• Q&A -5 mins

Page 6: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

About Auto-Scaling?

Page 7: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7

What is Auto Scaling?

“Auto scaling is a cloud computing feature that allows users to automatically scale cloud services, like virtual machines (VM) and server capacities, up or down, depending on defined situations”. - techopedia

3 Types of Auto Scaling● Scheduled● Reactive● Predictive

“Horizontal Scaling” - Add/remove number of compute resources

“Vertical Scaling”- Increase/decrease size of compute resources

Up/Down Performance

Rules

OrchestrationCompute

Load Balancing

Page 8: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8

Why Auto Scale?

1. Reduce Wasted Capacity• Decrease costs• Increase utilization• “Do more with less”

2. Manage Unexpected Spikes • Avoid outages• Maintain SLAs

Time

Cap

acity

Fixed CapacityPredicted UsageActual demand

Wasted Capacity

Unexpected Spike

Page 9: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

Auto Scaling Cloud Applications

Page 10: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10

OverviewReactive Horizontal Auto Scale

1. Monasca monitors VM scale group memory and CPU

2. Combined CPU and Memory utilization > X

3. Monasca alarm sends webhook notification to Heat

4. Heat orchestrates nova and neutron to create new VMs and rebalance traffic

5. Monitoring continues...

Up/Down Performance

Rules

OrchestrationCompute

Load Balancing

Monasca

Neutron Heat

HeatNova & ...

Page 11: Heat monasca auto scale

What is Monasca?

Analytics Engine

Seconds

Integrations

Service

Metrics

Platform

Infra

App

Logs

Events

Lifecycle

Usage

App

future

Page 12: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12

Heat

• Openstack Orchestrator

• Cloud app auto-scaling

• Software deployment and configuration

• Template (HOT / CFN)• TOSCA->HOT Translator• Nested template

• Resource plug-in• Services under big-tent

• Stack• Instances of template• Nested stack

• Events

• OpenStack

• TripleO

• Murano

• Magnum

• Any Cloud application.

HOWWHAT WHO

Page 13: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

Cloud application auto-scaling

• (more details at https://wiki.openstack.org/wiki/Heat-Monasca-Auto-Scaling YTD)

OS::Heat::AutoScalingGroup Properties

resource (scaling element) desired_capacity (initial count) max_size min_szie

Outputs current_size outputs/output_list

• Scale Group

• Scaling policy

• Alarm Notification

• Alarm definition• Metadata-

Dimension

OS::Heat::AutoScalingGroup

OS::Heat::ScalingPolicy Properties

auto_scaling_group_id cooldown (timing-window for

scaling) adjustement_type Scaling_adjustment (+/- 1, n, x%)

Outputs alarm_url ( CFN signal type) signal_url (HOT signal type)

OS::Heat::ScalingPolicy

OS::Monasca::Notification Properties

type (webhook, email) address signal / alarm url

OS::Monasca::Notification

signal / alarm url

OS::Monasca::AlarmDefinition Properties

name expression match_by=scale_group alarm_actions

OS::Monasca::AlarmDefinition

OS::Heat::AutoScalingGroup resource:

type: OS::Nova::Server

properties:

metadata: {"scale_group": <stack-id>}

OS::Monasca::AlarmDefinitionexpression: avg(vm.cpu.utilization_perc{scale_group=<stack-id>}) > 90

Page 14: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14

Heat

Monasca

VMVMVM

heat_template_version: 2015-10-15resources: group: type: OS::Heat::AutoScalingGroup scaleup_policy: type: OS::Heat::ScalingPolicy notification: type: OS::Monasca::Notification cpu_alarm_high: type: OS::Monasca::AlarmDefinition

13

4

5

6

2 7

1. Call Heat with a cloud application HOT template2. Heat creates cloud application stack with scale group

and scale policy3. Heat creates alarm definitions and scaling

notifications in Monasca 4. Monasca start to monitor the scale group elements [[CLOUD APPLICATION AUTO-SCALING SETUP IS DONE]]5. When Scale group reaches the alarm threshold

monasca detects and generates alarm6. Monasca signals cloud application stack in heat7. Heat either scale up or scale down based on the signal (here, increment scale group elements by 1)5-7 runs for ever ! (auto-scale)

5

Auto-scaling (work-flow)

Page 15: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15

Cloud application load-balancing

LBaaS

Auto-scale resource YAMLOS::Neutron::Monitor

OS::Neutron::Pool

OS::Neutron::LoadBalancer

OS::Nova::Server

OS::Neutron::PoolMember

OS::Heat::AutoScalingGroup

Page 16: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

Demo

Page 17: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

Q&A

Page 19: Heat monasca auto scale

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The OpenStack TM attribution statement should used: The OpenStack wordmark and the Square O Design, together or part, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation’s permission.

Thank you


Recommended