Mesos:
Automate your Data Center
David Greenberg
Jax London
12/10/2016
Who am I?
Engineer, Architect, and Operator
Open Source Fan
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
What are containers?
Application Code +
Operating System +
Isolated Resources
1st Benefit
Easy to Deploy
Batteries Included
• Neat image here
2nd Benefit
Easy to Reproduce
Fast to Clone
3rd Benefit
Easy to Build
Challenges
• How to automate operations?
• How to migrate from existing
infrastructure?
• How to manage database storage?
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
Scale
10k+ nodes
Offers & Volumes
Offers & Volumes
I want to run a container
Just tell the system what to do
I’d like a
cheeseburger with
fries, please
I’d like a container with 9 CPUs
Too bad our servers only have 8 CPUs
You should have a choice
Wait for tomorrow Choose an alternative
Offer Model
Mesos allows applications to
react to what’s available
Offers & Volumes
Docker’s Amazing!
Containers are Amazing!
Cattle, not Pets!
These are the rallying cries of
containerization
So, how do I run my database
on Docker?
Mesos solves this problem
Would you like a local disk,
or a network disk?
Local Disk
Internal Volumes
Network Disk (like EBS)
External Volumes
Offers & Volumes
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
Do you want to do this the
easy way or the hard way?
Easy Way
DC/OS Bundles the Goodies
It handles
• Service discovery
• DNS
• Docker
• Authentication
• Load Balancing
• 3rd Party Integrations
– Providers
– Infrastructure
You handle
• Metrics
• Logging
DC/OS 3rd Party Integrations
Bare metal hosting
Performance Insights
Container
Networking
Hard Way
DIY
Why Do It Yourself?
Pros
• Integrate with existing
tooling
• Simplify migration from
legacy environment
Cons
• Must choose everything
• Custom integration
3 Tips to Get Started
How to run, how to find, how to serve
Tip #1
Mesos DNS Tip #2
Edge Proxies
Marathon-LB or Bamboo
Tip #3
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
Thank you
Questions?
Today
§ What is container orchestration?
§ Why use Mesos?
§ How to get started?
§ Open Source integrations!
Run Spark in Many Ways
• DC/OS Spark
– Easily submit jobs
• Apache Zeppelin
– Interactive notebook on Mesos
• Two Sigma’s Cook
– Share a Mesos cluster among dozens of Spark
users
Why Run Jenkins on Mesos?
• Automatically scales workers
• Use as Continuous Integration Pipeline
• Just add a plugin to Jenkins’ config
Use Those External Volumes
The Same Strategy Applies to
Many Applications
Thank you
Questions?