Crowbar:An operations framework for

Cloud Scale Environments

Joey JablonskiPrincipal Solution Architect

Revolutionary Cloud Solutions Focus is green field and scale Advanced technologies Open Source

Team Introduction

2

Crowbar DevOps inspired Cloud deployment solution

OpenStack IaaS ….. PaaS

Hadoop Rapid deployment RA & DG

Projects Introduction

3

Dell Cloud Solutions 4

We needed Cloud Infrastructure that

Had support from major industry players Was collaboratively developed without a single

owner Had an API that was Service Provider license friendly Could be demonstrated to run at scale Was built on open source components Had global reach and support

Community Cloud Infrastructure

Dell Cloud Solutions 5

Intersection of two major technology waves: Operational Automation (DevOps) Open Source Cloud (OpenStack)

Together, a practical approach to cloud scale Manages elastic resources Embraces constant change Productizes best practices

Open Cloud Operations

Dell Cloud Solutions 6

Hyper-scale (1000s of servers) forced customers to change their core assumptions.

To operate large systems, customers Embraced scale out design (inconsistency is

OK) Eliminated hardware redundancy (too

expensive) Shunned manual steps (too slow)

Lessons from Hyper-scale

Crowbar

Images: Replacement

Images vs. Layers: Lifecycle

Layers: Upgrade

I+A+U+O/S

Config

OSU

Bar v1Foo

I

Config

I+A+U+O/S

Config

I+A+U+O/S

Config

I+A+U+O/S

Config

OSU

Bar v2 Foo

I

Config

Bar v2

8

Modular Design: BarclampsD

ell “

Cro

wb

ar”

Op

s M

an

ag

em

en

t

Core Components & Operating Systems

Cloud Infrastructure & Dell IP Extensions

Physical Resources

APIs, User Access, & Ecosystem Partners

Crowbar

Deployer

Provisioner

Network RAID

BIOS IPMI

NTP

DNS Logging

Hadoop

Nagios Ganglia Dashboard

9

OpenStack Barclamps

Crowbar = Install State Machine

10

Dell Cloud Solutions 11

Dashboard

Dell Cloud Solutions 12

Barclamps and Proposals

Dell Cloud Solutions 13

Monitoring

OpenStack

AP

I C

lien

tsO

ps I

nfr

astr

uctu

re

Hypervisor (KVM, Xen, etc)

Nova

VM Mmgt.

Amazon API Compatibility

Operations Mgmt.

Operating Systems (Ubuntu, RedHat, CentOS, Windows, etc)

Swift

Obj. Mgmt.

Part

ner

Ecosyste

m

Part

ner

Ecosyste

m VM mgmt

OrchestrateTemplates

Provisioning

Billing

AggregateCharging

Thresholds

Portals

User Mgmt.DelegationVM Mgmt.

Monitoring

StatusHealthAlerts

NetworkMonitoringMeteringConsoleSecurity

Security& Perform.

IdentityIP Inspect

Log Monitor

Physical Infrastructure: Servers & NetworksCrowbar

Chef

LDAP

Nagios

Glance

Image Mgmt.

OpenStack Cloud API

Dell’s Destination for OpenStack

15

OpenStack Timeline

SepMarNov 2010 Dec Jan 2011 Feb JulApr May Jun Aug Oct DecNov

Feb 2011:OpenStack

Bexar Release

Apr 2011:OpenStack

Cactus Release

Sep 2011:OpenStack

DiabloRelease

Oct 2011:OpenStackDesign Summit

• OpenStack Compute and Storage

• Image Registry & Delivery service

• Compute & storage enhance - ments

• 8 options for host virt (incl KVM, Hyper-V, Xen, ESX)

• Live migration (KVM)

• Compute API 1.0• Glance CLI• IPv6

• Network as a Service• Volume as a Services (LunR)• GPU accelerators, larger multi-core• Multi-cluster container sync• Multi-zone support, intra-data

center and federation across data centers.

• Stability and QA automation• Complete, stable OpenStack API

1.1

1.0 1.5

16

https://github.com/cloudedge http://dell.com/hadoop http://dell.com/openstack

Links

17

Dell Cloud Solutions 18

OpenStack Community