Container Orchestration Wars (Micro Edition)

transcript

CONTAINER ORCHESTRATION WARS( Micro Edition )

KARL WHO?

Where?

- Mesosphere- Pivotal

- DC/OS- Kubernetes (on Mesos)- CloudFoundry- BOSH

- github.com/karlkfi

- twitter.com/karlkfi

- linkedin.com/in/karlkfi

- karl.isenberg.us

Revisionist History of Distributed Computing

Container Orchestration

Platforms

Competitive Landscape

The Future

AGENDA

IN THE BEGINNING...

Sombrero Galaxy by ESA/Hubble - CC BY 4.0

Hardware

Operating System

Application

COMPUTERS

Hardware

Operating System

Web Application

INTERNET- Remote Users!

Web App

Hardware

Operating System

DISTRIBUTION- Horizontal Scale- Fault Tolerance- Availability- Load Balancing

Operating System

Hardware Hardware

Web App Web App

Service Service Service

Web App Web App Web App

Hardware

Operating System

SERVICE-ORIENTEDARCHITECTURE

- Separation of concerns

- Optimization of bottlenecks

- Smaller teams- API Contracts- Data replication- Complicated

provisioning- Dependency

management

Operating System

Hardware Hardware

Service Service Service

Web App Web App Web App

Machine

Operating System

HARDWAREVIRTUALIZATION

- Fast provisioning- Isolation- Portability- Utilization- Configuration

Management- Virtual Networking- Credential

management

Operating System

Infrastructure

Machine Machine

Operating System

ServiceApp ServiceServiceAppApp

MICROSERVICES- Polyglot- Single Responsibility- Smaller Teams- Utilization- Machine

types/groups- Dependency hell

Machine

Infrastructure

Machine Machine

ServiceService ServiceServiceServiceService

ServiceApp ServiceServiceAppApp

CONTAINERS- Rapid deployment- Dependency

vendoring- Container image

repositories- Spreadsheet

scheduling

Machine

Infrastructure

Machine Machine

Container Runtime Container Runtime Container Runtime

ServiceService ServiceServiceServiceService

Service

Container Runtime Container Runtime Container Runtime

CONTAINERORCHESTRATION

Container Orchestration

Machine

Infrastructure

Machine Machine

App ServiceServiceAppApp

CONTAINER ORCA-WHAT-NOW?

Scheduling, Coordination, & Management

Containerized Processes

Higher Order Abstractions

(e.g., Jobs, Services, Applications, Pods, etc.)

Machine Infrastructure

Web Apps & Services

Scheduling

Resource Management

Container Runtime

Machine & OS

Service Management

CONTAINERORCHESTRATION

Machine & OS Machine & OS

Container Runtime Container Runtime

Expanded

SCHEDULING- Placement- Replication/Scaling- Resurrection- Rescheduling- Rolling Deployment- Upgrades- Downgrades- Collocation

RESOURCE MANAGEMENT

- Memory- CPU- GPU- Volumes- Ports- IPs- Images/Artifacts

SERVICE MANAGEMENT

- Labels- Groups/Namespaces- Dependencies- Load Balancing- Readiness Checking

FUNCTIONAL CAPABILITIES

SCALABILITYPerformance, Responsiveness, Efficiency

AVAILABILITYFault Tolerance, Robustness, Reliability, Resilience, Disaster Recovery

FLEXIBILITYFormat Support, Interoperability, Extensibility, Container Runtimes

USABILITYFamiliarity, Maintainability, Compatibility, Debuggability

PORTABILITYHost OS, Cloud, Bare-Metal, Hybrid

SECURITYAuditability, Secrets Management, Encryption, Isolation

NON-FUNCTIONAL QUALITIES

PLATFORMA base of technologies on which other technologies or processes are built.

PLATFORM AS A SERVICEA managed, multitenant platform.

CLOUD PLATFORMA hosted platform as a service on shared infrastructure.

PLATFORM SPECTRUM

Rainbow by Susanne Nilsson - CC BY-SA 2.0

INFRASTRUCTURE PLATFORMe.g., OpenStack, VMware vSphere

CONTAINER PLATFORMe.g., Kubernetes, DC/OS, Rancher

APPLICATION PLATFORMe.g., Cloud Foundry, Red Hat OpenShift, Deis

PLATFORMS

Oil Platform by Berardo62 - CC BY-SA 2.0

CLOUD INFRASTRUCTURE PLATFORMe.g., Amazon Elastic Compute Cloud, Microsoft Azure,

Google Compute Engine

CLOUD CONTAINER PLATFORMe.g., Google Container Engine, Azure Container Services,

Amazon EC2 Container Service

CLOUD APPLICATION PLATFORMe.g., Heroku, Google App Engine, Pivotal Web Services,

IBM Bluemix

CLOUD PLATFORMS

TODAY’SCONTESTANTS

- Docker Swarm

- Kontena

- Nomad

- Kubernetes

- Rancher

- OpenShift

- DC/OS

Non-Exhaustive List

SCHEDULINGORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Placement

Kubernetes DC/OS ECS Swarm Nomad Cattle Kontena

Replication/Scaling

Readiness Checking

Resurrection

Rescheduling

Rolling Deployment

Collocation

Included External/Partial/Experimental

RESOURCE MANAGEMENTORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Memory

Disk Space

Persistent Volumes

Volumes

SERVICE MANAGEMENTORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Labels

Groups/Namespaces

Dependencies

Load Balancing

Readiness Checking

CONTAINERIZATION- Stability & maturity- Standard image format- Distinct from orchestration- API reverse compatibility guarantees

ORCHESTRATION- Feature parity- Abstraction convergence- Pluggable schedulers- Scale & responsiveness

DISTRIBUTED OPERATING SYSTEMS- Collection of components- Package management- System space vs user space- POSIX for the datacenter

THE FUTURE

DC/OS- Resource Management- Universal Containerizer- Container Orchestration- Pluggable Schedulers- Jobs & Services- Distributed System Services- Virtual Networking- Package Management- Services Catalog & Application Ecosystem- Day 2 Operational Focus

ENTERPRISE DC/OS- E2E Encryption- Identity & Access Management- Secrets Management- Support

"Let's face it, the universe is messy. It is nonlinear, turbulent, and chaotic. It is dynamic. It spends its time in transient behavior on its way to somewhere else, not in

mathematically neat equilibria. It self-organizes and evolves. It creates diversity, not uniformity. That's what

makes the world interesting, that's what makes it beautiful, and that's what makes it work."

Donella H. Meadows

(Thinking in Systems: A Primer)

Container Orchestration Wars (Micro Edition)

Technology