Date post: | 13-Sep-2014 |
Category: |
Documents |
View: | 1,127 times |
Download: | 1 times |
18 Mars 2010
Jean-Marc Menaud, Ecole des Mines de NantesBenoit Pelletier, BullFrédéric Dang Tran, Orange Labs
SelfXL projectAutonomic management of PaaS
cloud infrastructure with JASMINe
This research is supported by the french Agence Nationale de la Recherche with the ANR-08-SEGI-017
2© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
SelfXL
Self-management of compleX and Large scale systems Acquire new processes in the field of the
autonomic computing
3© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
PartnersBull
Open Source Java EE Middleware R&D Virtualization system expertise
France Telecom / Orange Labs R&D expertise in distributed systems architecture,
management of virtual IT infrastructuresMines de Nantes
Virtualization and constraint programming expertise.
IRIT Meta-modelisation expertise.
LIG Data mediation
ScalAgent Mediation system
4© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Cloud Computing at France Telecom
Context: Large-scale datacenters (+40,000 x86 servers) JavaEE JOnAS middleware stack: +250 applications,
+1000 application server instances Static server consolidation (12/1) through virtualization:
• Utilization level increased from 20% to 75%Next step: migration to a Cloud model
On-demand JavaEE server provisioning according to demand fluctuations
Automation of the management of virtualized JavaEE clusters: deployment, update, auto-scaling etc.
Open (source) cloud management stacks alternatives to proprietary solutions (IaaS/PaaS)
5© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Self-sizing for Java EE PaaS
Goal : improve the platform efficiency (performance, energy cost)
Challenges Cluster growth/shrink capabilities according to
the load Datacenter multi-tenancy with limited
capacities requires arbitration policies Datacenter placement for minimizing the
energy consumption
6© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Architecture for self-sizing
VM placement
VM provisioning
Scale up/down
7© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
JASMINe
Management tools for SOA platformOW2 Open Source project (license LGPL,
Leadership Bull)Cross-platform (JOnAS AS prime target)Four main features (Design, Deploy,
Monitoring, Self-*)
8© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
JASMINe & MAPE loop
Monitor JMX probes (JavaEE,
Hypervisor) Mediation bus Graphs console
Analyse/Plan Rules engine
Execute Reconfiguration load-balancer
API JASMINe Virtual Machine
Management (VMM) for VM provisioning & deployment
9© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
CLIF is a load injection framework
CLIF is a software framework for load testing load injectors (workload generation and response time
measurement) and probes (resources usage monitoring) open, adaptable/extensible, independent from:
• System Under Test (protocols, probes/observed resources)• workload definition mode• user interfaces (Java/Swing, Eclipse, command line...)
distributed infrastructure designed for high level workloads 100% Java (+ specific or native code for system probes) based on OW2's Fractal component model (fractal.ow2.org)
10© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
CLIF: Self-benchmarking of JavaEE applications
load injector 1
load injector 2
load injector n
automatic control
probes
probes
measures
feedback
saturation criteria definition/choice
PerformancepredictionResponse
time
workload
2 JOnAS VM
1 JOnAS VM
3 JOnAS VM
11© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
JASMINe Virtual Machine Management (VMM)
Support for the following hypervisors: Open-source Xen and
KVM Citrix XenServer VMware virtualCenter 2.x Microsoft Hyper-V
12© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Entropy: Architecture
Entropy is a virtual machine (VM) manager for
clusters and acts as an infinite control loop, which
performs a globally optimized dynamic VM
placement without downtime according to
cluster resource usage and scheduler objectives
13© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Entropy: Dynamic consolidation
Our first result focuses on the dynamic consolidation issue.
Entropy observes the current CPU and memory requirements of each VM and computes a globally optimized placement of
them that satisfy all their requirements while using a minimum number of hosts.
14© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
Entropy in Action
Without Entropy With Entropy
4 s
erv
ers
4 t
ask
sC
on
su
mp
tion
is redu
ced
by 25%
4 Ta
sks, 3 or 4 servers
15© OW2 Consortium 2010 http://selfxl.gforge.inria.fr
To concludeConclusion
Self-management of compleX and Large scale systems
Toward an Open Cloud platformFuture Work
Domain Specific Langage • Shell Console adminstration
Coordination between levelsPointers:
ANR SelfXL project: selfxl.gforge.inria.fr JASMINe: jasmine.ow2.org Entropy: entropy.gforge.inria.fr CLIF: clif.ow2.org