But wait…
How is this connected to big data??
B E R K E L E Y D ATA A N A LY T I C S S TA C K ( B D A S )
What We Needed
Elastic scaling
High availability
Multi-tenancy
Easy deployment
The Problem
Choose One
OR
Focus on Meta
One Size Does Not Fit All
Containers!
Docker on Mesos
Multiple Frameworks
MapR-FS
Continuous Deployment
GitHubJenkins Docker Build
Docker Private Registry
Jenkins Deploy
JobMarathon Mesos
Cluster
Why Mesos?
Evolution of Infrastructure
Dedicated Servers Datacenter
Evolution of Infrastructure
Virtualization Datacenter
• more machines to manage • lower performance • utilization problem still
unsolved
Evolution of Infrastructure
Mesos Datacenter (One Pool of Resources)
Mesos Architecture
Mesos Architecture
Why Use Mesos?
• allows services to scale
• think about services, not machines
• fault tolerant - no SPoF