Scale Cloud Across the Enterprise

Chris Haddad

Vice President, Technology Evangelism

Follow me on Twitter @cobiacomm

Read architecture guidance at http://blog.cobia.net/cobiacomm

Skate towards the puck

Business Value

Best Practice Adoption

Process Repeatability

Fast time to value

Cloud Business Value For Development Teams

3

• Lower development barriers

• Lower adoption barriers

Best Practice Adoption and Process Repeatability

• Cost-effective, development, collaboration, and

deployment infrastructure enabling a long tail of

application development

• A shared environment for cross-organization

application development and delivery

• Infrastructure enabling user experience composition

across multiple disparate application providers

Fast Time to Value – Increase Agility

• Rapidly adapt and fulfill new market demand

• Reduce time to introduce new services,

applications, and products into long tail market(s)

Enterprise Architecture Business Model Challenges

• Unable to cost-effectively support long tail of

application delivery

• Lack of metrics and baseline measurements

• Limited ability to influence adoption

• High friction and interaction cost when building

cross-team business processes

• Inability to capitalize on business opportunities

due to long IT solution lead times

12/11/2012 6

Cloud Business Value Blockers

• Silo owners

• Adoption curve

• Trust barrier

• Unknown baseline

• Funding model

Source: http://blog.industryweapon.com/2010/01/beware-of-the-business-blocker/

To succeed and scale Cloud – Build a Digital Ecosystem Platform

8

Digital Ecosystem

Your Core Business Capability

3rd Party Partners

DevOps Forge and Governance

Cloud Deployment App Store

Personalized SaaS Solution

Your Digital Business

Ecosystem

New Enterprise Architecture Approach

• Self-organization

• Crowdsourcing – source apps and capabilities from crowd

• Dynamic distribution channels and fluid connections

• Adaptation and evolution

• Local autonomy leading to unforeseen ecosystem partner extensions

• Spontaneous selection and aggregation across services and solutions

• Low interaction cost

• Frictionless information flow

• Enables cost effectively serving a smaller, niche audience

12/11/2012 9

Recommendations from the Coach

Business Value

Best Practice Adoption

Process Repeatability

Fast time to value

Cloud Business Value For Development Teams

11

• Lower development barriers • Provide on-demand Application Development project

infrastructure and run-time environments

• Catalogue of re-usable open APIs, cloud services,

and domain frameworks

• Lower adoption barriers • On-demand web application and Cloud API

subscriptions via a self-service provisioning portal

• Establish searchable registry of app, service, api, and

data descriptors

• Reliable, available, and scalable solutions

Best Practice Adoption and Process Repeatability

• Cost-effective, development, collaboration, and deployment infrastructure enabling a long tail of application development

• Architecture templates and application platform services

• A shared environment for cross-organization application development and delivery

• Governed, iterative lifecycle management across hybrid clouds and composite applications

• IT Business performance metrics and analytics

• Infrastructure enabling user experience composition across multiple disparate application providers

Fast Time to Value with On-demand Contextual Personalization

• Increase agility

• Rapidly adapt and fulfill new market demand

• Reduce time to introduce new services, applications, and products into long tail market(s)

• On-demand Contextual Personalization

• Information access and social network access privileges

• Information aggregation and composition

• Business processes and rules

• Service levels, Quality of Service, and monetization rates

• Security policies

Fast path to goals!

Cloud DevOps Factory

Platform as a Service

API Management

Business Activity Dashboards

Embrace DevOps Processes

• Self-service configuration

• Automated provisioning

• Continuous build

• Continuous integration

• Continuous delivery

• Automated release management

• Incremental testing

Command Line Compilers and Linkers

Integrated Development Environments (IDE)

Application Lifecycle Management (ALM)

Development Forges

Cloud

Factories

Time

Scale best practices with Cloud Factories

12/11/2012 16 2012+

What is a Cloud Factory?

A Cloud-based, automated, DevOps approach to agile application design, development, delivery, and visibility

• Simplifies the developer experience

• On-demand self service and Cloud provisioning

• Continuous build, continuous integration, continuous test, and

continuous delivery

• Governed, iterative lifecycle management across hybrid

clouds and composite applications

• Architecture templates and application platform services

• IT Business performance metrics and analytics

• Builds a Digital Business Ecosystem

• Enable a long tail of application development

• Fosters cross-organization development collaboration

Open Source DevOps, Agile, and Cloud Tooling

12/11/2012 18

Project and Team

Management Software development

workflow

Governance and

Compliance

Development Dashboards

Develop Code

Issue Tracking

Source Control

Continuous Build

Continuous Integration

Test Automation

Continuous Deployment

• Resource monitoring

• Resource management

• Performance management

• Traffic orchestration

• Metering

• Reporting

• Billing

• Service catalogue

• Service tiers

• Demand and capacity management

• Lifecycle management

• Infrastructure Authority integration

• Self service configuration

• Automated provisioning

• Policy configuration

• Process automation

Dev Ops Tooling

Automated Governance

Service Level Management

Consumption based

Funding

Platform as a Service Capabilities

Cloud-aware Reference Architecture

Cloud Platform

Cloud Management

PaaS Manager

Cloud Governance

Identity Management

Asset Repositories and Registries(tenant code,

service endpoints, meta-data, configuration, policies)

Infrastructure as a Service (AWS, Eucalyptus,

OpenStack, CloudStack)

Platform as a Service Run-time Framework (i.e. WSO2 Stratos, Cloud Foundry, RedHat OpenShift)

Service-aware, tenant-aware

Elastic Load Balancer

Stratos Controller

Asset/Code Deployer

Asset/Code Synchronizer

Metering and Billing

Cloud Native Container(s)

Application Platform Services (web server,

database, ESB)

Tenant 1

Tenant (n)

Platform as a Service Reference Architecture

Carbon ESB

Cartridge

Carbon

App Server

Cartridge

Stratos Controller

Message

Service

Logging

Service

Security

Service

Registry

Service

Relational

Data

Service

Elastic

Load

Balancer

Cloud

Controller/

Autoscaler

Artefact

Distribution

Controller

Deployment

Synchroniser

Management

Console

Column

Storage

Service

File

Storage

Service

Task

Mgmt

Service

Billing

Service

Other Carbon

Cartridges

PHP

Cartridge

Any

Pluggable

Cartridge

Infrastructure Cloud (EC2, vmWare, Rackspace, OpenStack, Eucalyptus, etc)

Load

Monitor

IaaS

PaaS

Foundation

aP

aaS

iPaaS

Cloud API promotion, exploration, subscription, and collaboration

On-demand self-service access to approved Cloud Services and APIs

Explore Cloud Services and APIs

Business Activity Dashboards

TODO

Business Activity Monitoring

Cloud Strategy Goals

1. Decrease solution provisioning time

2. Right-size infrastructure, improve resiliency, and enhance Quality of Service (QoS)

3. Accelerate software development iterations

4. Share across multiple users and groups

5. Integrate and bridge heterogeneous Cloud environments

6. Optimize Cloud footprint and lower application cost

Cloud Characteristic Roadmap

Cloud

On-demand

Self-service

Multi-tenancy

Service Catalogue

Elastic Scalability

Provisioning

Activity Monitoring

Resource Pooling

Usage Policies

Federation

Consumption based Funding

Portfolio Models

Metering and Billing

7 +/- 2 Objectives

1. Engage stakeholders in a collaborative development workspace

2. Promote best practice workflow, architecture, and governance practices

3. Deploy applications into a Cloud run-time environment

4. On-demand application subscriptions via a self-service provisioning portal

5. Share applications across multiple tenants (e.g. departments, workgroups, employees, partners)

6. Scale run-time to meet usage

7. Deploy Open APIs

8. Encourage API adoption via API Store

9. Track business activity and analyze Cloud service usage, performance, and cost

29

Resource Tier

Sharing Business Capabilities at Scale

Functional Role

Client Tier

Integration Services

Integration Services Resource Services

Functional Role

Presentation and Mashups

Functional Role

Functional code

Presentation Role

Presentation and Mashups Presentation

and Mashups

Resource Services

Private Applications

Public Cloud Services

Business Proces

Business Process

Business Process

Business Process and

Business Rules

Scaling through API composition

Mobile Application

Application Portfolio

Hybrid Platform Services

Presentation

Services

Resources Services

Functional Services

Business Process and

Rules Services

Integration Services

Composite Application

Business Service Portfolio

Integration Services

Cloud API

Endpoint

Infrastructure as a Service (IaaS)

SaaS Application

Web

application

Endpoint

Scaling across Regions and Zones Multiple IaaS (hybrid) Deployment

Availab

ilit

y

Co

st

LOWEST

HIGHEST

32

Private cloud (data center)

Zone 1

Zone 2

Amazon EC2

Zone 1

Zone 2

Rackspace Cloud

Zone 1

Zone 2

Cloud Scale = High Availability at a cost

33

Sin

gle

Node

Prim

ary

-Secondary

, sin

gle

LB

Multi-node a

ctive

clu

ste

r

- S

ingle

zone

Multi-re

gio

n

Prim

ary

-Secondary

,

with m

ultip

le L

Bs

Multi-zone

M

ulti-Ia

aS

Scaling Best Practices

New-Normal Cloud architecture practices

• Distributed and federated interactions

• Event based, heterogeneous systems, network latency

• Configurable containers and engines

• Declarative data, rules, and process definitions

• De-normalized and simplified data models

• Hadoop/BigTable, Hypertext media, simple NoSQL entities

• Expect failure

• Systems span transactional control

• Applications decomposed into distinct services

• Federated environment drives autonomy, statelessness, and composition

Mission-critical Cloud requires new architecture components

Availability Scalability Management

State replication Tenant partitioning

Private jet mode

Management nodes

Session replication Ghost deployment Logging infrastructure

Multiple load

balancers with

keepalived or DNS RR

BAM 2.0 architecture Deployment

synchronization

Auto-scaling

Elastic Load Balancer

Tenant-awareness impacts Cloud Scaling

Tenant Scaling Method Impacts Value Proposition

Single Application Tenant per

Dedicated Application Server Container

Multiple Application Tenants per

Shared Application Platform

Service Container

Cloud Topology and Value

Tenant Context

Container

Tenant Partition

Application Solution Tenant Traffic

Tenant-1

AS-1

Tenant-1

ESB-1

Tenant-1

Tenant-2

AS-2

Tenant-2

ESB-2

Tenant-2

Tenant-3

ESB-3

Tenant-3

Five (5) Container Instances, Three Tenants

Cloud Topology and Value

Tenant Context

Container

Service Partition

Application Solution Tenant Traffic

ESB

ESB-1

Tenant-1 Tenant-3

ESB-2

Tenant-2

Web Application

AS-1

Tenant-1 Tenant-2

Three (3) Container Instances, Three Tenants

Scaling a Cloud Business

Measuring Revenue versus Cost

Source: http://giffconstable.com/2009/11/freemium-business-model-template/

Scale Strategy and Tactics

• Gain Credibility

• Demonstrate improved resiliency and QoS

• Converge teams

• Offer standard shared application platform services

• Establish and promote the service catalogue

• Be inclusive

• Support multiple development languages, environments, and use cases

• Lower barriers to entry (e.g. financial, tooling, skills)

7 +/- 2 Objectives

1. Engage stakeholders in a collaborative development workspace

2. Promote best practice workflow, architecture, and governance practices

3. Deploy applications into a Cloud run-time environment

4. On-demand application subscriptions via a self-service provisioning portal

5. Share applications across multiple tenants (e.g. departments, workgroups, employees, partners)

6. Scale run-time to meet usage

7. Deploy Open APIs

8. Encourage API adoption via API Store

9. Track business activity and analyze Cloud service usage, performance, and cost

42

Questions?

43

http://www.flickr.com/photos/oberazzi/

Measuring Value

• Time

• Cost

• Resources

Key Metrics

Foundation

Time to create new application environment

Time to redeploy application

• Optimize Minimum and maximum scale

Scale frequency (i.e. time to scale up/down)

• Transformation Time and effort required integrating business process, event

processor – creating a complex app.

Time and effort required to apply policy across tenant(s)

Cost to operate application per user or transaction

What is your value baseline?

Quick Start Use Cases

1. DevOps Tooling and On-demand self-service

2. Automated Governance

3. Service level management and elastic scale

4. Consumption based pricing and billing

Quick Start Use Cases

DevOps Tooling and On-demand self-service

• Use Cases

• Rapidly provision application environment

• Rapidly provision application tenant

• Allocate, provision, monitor, manage, and administer resources across multiple tenants, nodes, and locations

• Develop complex, composite integrated applications

• Key metrics

• Time to create new application environment

• Time to redeploy application

Quick Start Use Cases

Automated Governance

• Use Cases

• Create users and configure rights

• Deploy on preferred topology that meets deterministic performance requirements (e.g., replication, utilization, latency, bandwidth, and coherency)

• Create service throttling and security governance (XACML) policies

• Key Metrics

• Time and effort required integrating business process, event processor – creating a complex app.

• Time and effort required to apply policy across tenant(s)

Quick Start Use Cases

Service level management and elastic scale

• Use cases

• Ensure application satisfies consumer demand while maximizing resource utilization

• Scale workload processing and increase performance while minimizing infrastructure spend

• Load test application service

• Demonstrate multi-tenant web application

• Key Metrics

• Minimum and maximum scale

• Scale frequency (i.e. time to scale up/down)

Quick Start Use Cases

Consumption based pricing and billing

• Use cases

• View service logs

• View bill by business value

• Key Metric

• Cost to operate application per user or transaction