+ All Categories
Home > Documents > Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy...

Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy...

Date post: 07-Mar-2018
Category:
Upload: hadien
View: 212 times
Download: 0 times
Share this document with a friend
61
Mesos: Automate your Data Center David Greenberg Jax London 12/10/2016
Transcript
Page 1: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Mesos:

Automate your Data Center

David Greenberg

Jax London

12/10/2016

Page 2: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Who am I?

Engineer, Architect, and Operator

Page 3: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 4: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Open Source Fan

Page 5: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

Page 6: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

Page 7: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

What are containers?

Page 8: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Application Code +

Operating System +

Isolated Resources

Page 9: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

1st Benefit

Easy to Deploy

Page 10: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Batteries Included

•  Neat image here

Page 11: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

2nd Benefit

Easy to Reproduce

Page 12: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Fast to Clone

Page 13: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

3rd Benefit

Easy to Build

Page 14: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 15: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Challenges

•  How to automate operations?

•  How to migrate from existing

infrastructure?

•  How to manage database storage?

Page 16: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

Page 17: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Scale

10k+ nodes

Page 18: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Offers & Volumes

Page 19: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Offers & Volumes

Page 20: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

I want to run a container

Just tell the system what to do

Page 21: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 22: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

I’d like a

cheeseburger with

fries, please

Page 23: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 24: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 25: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

I’d like a container with 9 CPUs

Too bad our servers only have 8 CPUs

Page 26: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

You should have a choice

Wait for tomorrow Choose an alternative

Page 27: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Offer Model

Mesos allows applications to

react to what’s available

Page 28: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Offers & Volumes

Page 29: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Docker’s Amazing!

Page 30: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Containers are Amazing!

Page 31: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Cattle, not Pets!

These are the rallying cries of

containerization

Page 32: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

So, how do I run my database

on Docker?

Page 33: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 34: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 35: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 36: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 37: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Mesos solves this problem

Would you like a local disk,

or a network disk?

Page 38: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Local Disk

Internal Volumes

Page 39: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Network Disk (like EBS)

External Volumes

Page 40: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Offers & Volumes

Page 41: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

Page 42: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Do you want to do this the

easy way or the hard way?

Page 43: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Easy Way

Page 44: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

DC/OS Bundles the Goodies

It handles

•  Service discovery

•  DNS

•  Docker

•  Authentication

•  Load Balancing

•  3rd Party Integrations

–  Providers

–  Infrastructure

You handle

•  Metrics

•  Logging

Page 45: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

DC/OS 3rd Party Integrations

Bare metal hosting

Performance Insights

Container

Networking

Page 46: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Hard Way

DIY

Page 47: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Why Do It Yourself?

Pros

•  Integrate with existing

tooling

•  Simplify migration from

legacy environment

Cons

•  Must choose everything

•  Custom integration

Page 48: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

3 Tips to Get Started

How to run, how to find, how to serve

Page 49: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Tip #1

Page 50: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Mesos DNS Tip #2

Page 51: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Edge Proxies

Marathon-LB or Bamboo

Tip #3

Page 52: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

Page 53: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Thank you

Questions?

Page 54: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Today

§  What is container orchestration?

§  Why use Mesos?

§  How to get started?

§  Open Source integrations!

Page 55: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 56: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Run Spark in Many Ways

•  DC/OS Spark

– Easily submit jobs

•  Apache Zeppelin

–  Interactive notebook on Mesos

•  Two Sigma’s Cook

–  Share a Mesos cluster among dozens of Spark

users

Page 57: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 58: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Why Run Jenkins on Mesos?

•  Automatically scales workers

•  Use as Continuous Integration Pipeline

•  Just add a plugin to Jenkins’ config

Page 59: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker
Page 60: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Use Those External Volumes

The Same Strategy Applies to

Many Applications

Page 61: Mesos: Automate your Data Center - JAX London you want to do this the easy way or the hard way? Easy Way DC/OS Bundles the Goodies It handles • Service discovery • DNS • Docker

Thank you

Questions?


Recommended