Managing Docker Applications in Production

Boyd E. Hemphill @behemphi @stackengine

History - BoydOracle Developer, MySQL DBA, PHP Developer, System Architect, DevOps Director (yea, really)

Started Austin DevOps In 2012

Co-Organizer of DevOps Days Austin

Became involved in Docker Austin in August.

Working with Docker for the first Docker Days Austin

Keep an eye on @stackengine to see if we can make it happen!

History -StackEngine

CopperEgg

Started in May 2014 to address problems arising due to Docker adoptions

Funding announcement October

Currently in private beta

mike@stackengine.com

Common Ground

What is The Goal of Your

Company?

What is The Goal of Your

Company?Make Money!

So … What is DevOps?

Is DevOps a Process?

Is it an intersection of overlapping concerns?

Is DevOps a Culture?

DevOps:

DevOps is the way in which a technology organization embeds itself in a business to the benefit of that business.

The Ideal Docker Application

Netflix (unicorn)Service Oriented Architecture

BenefitsIncrease developer velocity using containers to model application topology

Decrease build and test times using containers as build/test agents rather than VMs

Density - Reduce Costs

Separation of Concerns - “Code to an interface” moves to the infrastructure level

Taken together a company that can get to the end state has a significant and lasting competitive advantage

Today’s Docker Reality

ConcernsThis is still very early days for Docker

Tools to support Dockerized applications immature or do not exist

Service oriented architecture is hard

Increasing developer is only a local optima, thus a false economy

Its the first major DevOps initiative not driven by Ops.

SDLC

Developers are moving forward

QA sees production modeling and large test grids

Build engineers see easier build grids

Operations panics - no tools or instrumentation

The Final Mile

The Final Mile

Developer uses containers

System is built and images are produced

Images stored in a private repo

Now we need to deploy to a QA environment

Umm ….

Docker DeploymentCompleting the final mile

DeploymentContinuous Deployment was published in 2010

In general we still talk about build and integration, not deployment

This is true for all applications, not just those that are Dockerized

Docker promises A/B deployment

StackEngine is working on making A/B deployment a policy based activity

Container Sprawl

Container Sprawl

First there was VMware and suddenly a large corps departments could easily spin up environments

Then there was the cloud and developers could complete circumvent Ops

Now there is Docker and Developers are creating numerous abstractions that are not managed like traditional VMs

Containers on VMs on phyical hardware located in availability zones in data centers in geographic regions.

My Head HurtsContainer Sprawl

Inventory Management

Where’s My StuffHosts

Where’s My StuffImages

Where’s My StuffContainers

Telemetry

Telemetry

What does monitoring a docker app look like?

What does log aggregation look like?

Telemetry

Container size matters - blog

Log aggregation solution - blog

What’s my stuff (not) doing

Containers

What’s my stuff (not) doing

Containers

What’s my stuff (not) doing

Containers

Components

Components

Components are infrastructure abstractions (cloud provider, data center, docker registry, docker image)

Components can be arranged in logic ways to represent physical infrastructure.

Composing and AppComponents

Composing and AppComponents

Composing and AppComponents

Service Discovery

Service Discovery - Consistency Models

Zookeeper

Etcd / Consul

Chef Server / Heira

Service DiscoveryDue out in December

Allows multiple deployments of the same service on the same host.

Containers register themselves upon startup and are found by tags rather than URI’s, fixed ports, etc.

A step towards cattle containers instead of pet containers

Roadmap

Roadmap

Service Discovery

User Management

Addition of new Components

Better telemetry

Scheduling

A/B Deployment support

Live Product DemoAl Gore and his gremlins willing

Boyd Hemphill @behemphi

@stackengine

Thank You for Your Time and Comments.