Mesos university - Devoxx France 2015 - part 2

transcript

@XebiaFr @YesWeScale#MesosUniversity

Mesos University

@jbclaramonte @plopezFr @jpthiery @aurelienmaury

Agenda• Mesos

• Frameworks

• Mesosphere

• Marathon

@YourTwitterHandle@YourTwitterHandle@XebiaFr @YesWeScale#MesosUniversity

Ressources partagées

Master

Slave Slave Slave Slave

cpu: 2mem: 2048

cpu: 4mem: 16384

cpu: 2mem: 4096

cpu: 32mem: 131072

Resources

• 2 méthodes permettent de décrire les slaves du cluster

• Resources

• Tags (ou « Attributes »)

Resources• Certaines resources types sont pré définies par Mesos

• cpu

• mem

• disk

• port

Resources• Certaines resources types sont pré définies par Mesos

• cpu

• mem

• disk

• port

OBLIGATOIRE !

Resources• Trois différentes types de resources

• scalars

• ranges

• sets

Resources

cpu:24;mem:24576;disk:409600;ports:[21000-24000];disks:{1,2,3,4,5,6,7,8,9}

Resources

Scalar

Resources

par exemple /mnt/disk/{diskNum}

Mesos: Web UI

Framework

Framework = Application

Frameworks

Framework : API

APIScheduler

• Est notifié par le master de la mise à disposition de ressource

• Demande l’exécution de tâches au master

Executor

• Réalise les taches soumises par le master

Scheduler Mesos (master)

register

Executor

registerregistered

Executor

registerregistered

Executor

registerregistered

launch

Executor

registerregistered

launch

updatetime

launch

Executor

update

Framework : API

API du Scheduler

Scheduler : Lifecycle management

Executor

Master

Scheduler

registered(…)

void registered(SchedulerDriver driver, FrameworkID fwkId, MasterInfo masterInfo);

Master

Standby

Executor

Master

Scheduler

Master

Standby

disconnected(…)

void disconnected(SchedulerDriver driver);

Executor

Schedulerreregistered(…)

Master Master

void reregistered(SchedulerDriver driver, MasterInfo masterInfo);

Scheduler : Resource Allocation

Executor

Master

HadoopScheduler

resourceOffers(…)

Master

Standby

CassandraScheduler

void resourceOffers(SchedulerDriver driver, List<Offer> offers);

Offre de ressources

Scheduler : Resource Allocation

CassandraExecutor

Master

HadoopScheduler

offerRescinded(…)

Master

Standby

CassandraScheduler

Le scheduler Cassandra

exécute le premier la tâche

void offerRescinded(SchedulerDriver driver, OfferID offerId);

Scheduler : Communication

CassandraExecutor

Master

HadoopScheduler

statusUpdate(…)

Master

Standby

CassandraScheduler

void statusUpdate(SchedulerDriver driver, TaskStatus taskStatus);

CassandraExecutor

Master

HadoopScheduler

frameworkMessage(…)

Master

Standby

CassandraScheduler

void frameworkMessage(SchedulerDriver driver, ExecutorID execId, SlaveID slaveId, byte[] message);

Scheduler : Error events

CassandraExecutor

Master

HadoopScheduler

slaveLost(…)

Master

Standby

CassandraScheduler

void slaveLost(SchedulerDriver driver, SlaveID slaveId);

CassandraExecutor

Master

HadoopScheduler

executorLost(…)

Master

Standby

CassandraScheduler

void executorLost(SchedulerDriver driver,ExecutorID execId, SlaveID slaveId, int status);

Executor

Master

Scheduler

error(…)

Master

Standby

void error(SchedulerDriver driver, String message);

Framework : API

API de l’Executor

Executor : Lifecycle management

Executor

Master

Scheduler

registered(…)

Master

Standby

void registered (ExecutorDriver driver, ExecutorInfo execInfo, FrameworkInfo fwkInfo, SlaveInfo slaveInfo);

Executor

Master

Scheduler

Master

Standby

disconnected(…)

void disconnected(ExecutorDriver driver);

Executor

Master

Scheduler

Master

Standby

reregistered(…)

void reregistered(ExecutorDriver driver, SlaveInfo slaveInfo);

Scheduler : Task management

CassandraExecutor

Master

launchTask(…)

Master

Standby

CassandraScheduler

void launchTask(ExecutorDriver driver, TaskInfo taskInfo);

Scheduler : Task management

CassandraExecutor

Master

killTask(…)

Master

Standby

CassandraScheduler

void killTask(ExecutorDriver driver, TaskID taskId);

schedulerDriver.killTask(…)

CassandraExecutor

Master

frameworkMessage(…)

Master

Standby

CassandraScheduler

void frameworkMessage(ExecutorDriver driver, byte[] msg);

Mesosphere : Chronos & Marathon

Mesosphere

Florian Leibert

Benjamin HindmanTobi Knaup

Mesosphere

Our mission is to make building and running distributed systems as easy as building or running an

app on your smartphone.

Chronos

Marathon

Quoi ?

“Init Daemon” pour Data Center

Private PaaS

Pourquoi ?

Simplifier

Automatiser

API pour les développeurs

Améliorer l’efficacité

Fonctionnalities

Déploiement élastique

Haute disponibilité

SécuritéSystème

d’évènementsAPI REST

Service Discovery

UI : liste des applications

UI : créer une application

Cycle de vie

Master

Slave Slave Slave Slave

Marathon

Tâches Évènements / Offres

Marathon

API REST

POST /v2/apps { "id": "myrestapi", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT0" }

Démarrer une “Self Contained App”

POST /v2/apps { "id": "myrestapi", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT0" }

Démarrer une “Self Contained App”

Slave myrestapi$PORT0

ports:[0]

POST /v2/apps { "id": "ubuntu", "container": { "type": "DOCKER", "docker": { "image": "libmesos/ubuntu" } }, "instances": 1, "cpus": 0.5, "mem": 512, "uris": [], "cmd": "while sleep 10; do date -u +%T; done" }

Démarrer une application Dockerisée

Health check

• Par défaut, information provenant de Mesos

TASK_RUNNING => Healthy

• Configurable via l’API REST de Marathon

{ "id": "my-restapi-example-app", ... "healthChecks": [ { "protocol": "COMMAND", "command": { "value": "curl -f -X GET

http://$HOST:$PORT0/simpleapi/info" }, "gracePeriodSeconds": 300, "intervalSeconds": 5, "timeoutSeconds": 3, "maxConsecutiveFailures": 3 } ] }

Health check

{ "id": "my-restapi-example-app", ... "healthChecks": [ { "protocol": "HTTP", "path": "/simpleapi/info", "gracePeriodSeconds": 300, "intervalSeconds": 5, "timeoutSeconds": 3, "maxConsecutiveFailures": 3 } ] }

Health check

Les contraintes

Contrôler le “où” lors du déploiement

Les contraintes : tags

Identifier les ressources par des tags : • type de hardware • emplacement physique (datacenter , rack) • …

Positionnées au démarrage du slave

$ mesos-slave … --attributes="rack_id:2"

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNIQUE"] }

Contrainte : UNIQUE

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNIQUE"] }

Contrainte : UNIQUE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt CreditApp

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["harddrive","CLUSTER", "ssd"] }

Contrainte : CLUSTER

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints":[["hostname","CLUSTER", “slave-3”] }

Contrainte : CLUSTER

Slave 1

UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt CreditApp

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["rack_id","GROUP_BY"] }

Contrainte : GROUP_BY

Slave 1

UserMgt

Slave 2

CreditApp

Slave 3 Slave 4

Rack 1

Rack 2

UserMgt CreditApp

UserMgt

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNLIKE", "slave-[2-3]"] }

Contrainte : UNLIKE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt

POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","LIKE", "slave-[1-3]"] }

Contrainte : LIKE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt

Application groups

• Définir des liens de dépendance entre les groupes

• Scaler tout un groupe à la fois

Marathon : Application groups

/myapp/bdd

postgresql instance=3

redis instance=4

/myapp/service

apache instance=5

tomcat instance=8

Dépendance

{ "id": "/myapp", "groups": [ { "id": "/myapp/bdd", "apps": [ { "id": "/myapp/postgresql", ... }, { "id": "/myapp/redis", ... } ] },{ "id": "/myapp/service", "dependencies": ["/myapp/bdd"], "apps": [ { "id": "/myapp/apache", ... }, { "id": "/myapp/tomcat", ... } ] } ] }

Application groups

Service Discovery

Où est mon application ?

HaProxy : reload configuration

• HaProxy - Marathon bridge (script)

• Bamboo

Service Discovery

Slave 1 Slave 2

Marathon

HA Proxy

HA Proxy Marathon Bridge

HA Proxy

Service Discovery

Slave 1 Slave 2

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100

CreditApp Port 31200

UserMgt Port : 10000 CreditApp Port : 20000Marathon

HA Proxy

Service Discovery

Slave 1 Slave 2

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100

UserMgt Port : 10000 CreditApp Port : 20000Marathon

HA Proxy

Service Discovery

Slave 1

Marathon

HA Proxy

Slave 2

HA Proxy

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100

localhost:10000 { slave1:31100 slave1:31200 slave2:31100

} localhost:20000 {

slave2:31200 }

UserMgt Port : 10000 CreditApp Port : 20000

Service Discovery

Slave 1

Marathon

HA Proxy

Slave 2

HA Proxy

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100

localhost:10000 { slave1:31100 slave1:31200 slave2:31100

} localhost:20000 {

slave2:31200 }

UserMgt Port : 10000 CreditApp Port : 20000

Mesos university - Devoxx France 2015 - part 2

Software