+ All Categories
Home > Technology > OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Date post: 25-Jun-2015
Category:
Upload: ow2-consortium
View: 153 times
Download: 3 times
Share this document with a friend
Description:
ProActive OW2 features management of heterogeneous private Clouds, with burst capacity on Data Center and Public clouds. Offering full accounting and security, ProActive handles multi-tenant Cloud, and a smooth path for application migration to the Cloud thanks to comprehensive interfaces (Web Graphical Studio, CLI, Java and REST, User and Admin Portals). This presentation demonstrates the ProActive Cloud Automation product, especially in the framework of Open Stack. With OW2 ProActive Cloud Automation you can automate the deployment of your complex multi-VMs applications. You simplify self-service deployment, as well as automate the delivery of in production services. You set and control application elasticity with automated scaling-up and down, horizontally and vertically. Once you define the service deployment, you are able to deploy anywhere with workflow reversibility. With unified cloud management, applications execute on multi-vendor private, public and hybrid clouds. Industrial use cases are reported and showcased. Unique characteristics of ProActive are the capacity to manage both Virtual and Physical machines, to orchestrate native and virtualized applications, together with Workflow automation. Second Speaker: Brian Amedro, ActiveEon, CTO, [email protected]
Popular Tags:
31
Transcript
Page 1: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration
Page 2: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Company

A leading edge Cloud editor since 2007

Page 3: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Company

➢ Created from INRIA in october 2007

➢ Distribution, Parallelism, HPC, Grids, Cloud

➢ Develop solutions for many application domains:

Engineering, Bio Technologies, Finance, IT

➢ Our labels : DGA (French Dept of Defense), Pacte PME,

Initiative Achats de l’État pour PME innovantes

➢ Growth in France and worldwide

Page 4: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Mission

➢ Distribution, Parallelism, HPC, Grids, Cloud

for DSI Infrastructure and Critical Business Applications

➢ Anticipate technological challenges ➢ Innovation as a service to our clients ➢ Provide strong expertise in key areas such as Distributed

Systems and Cloud Computing ➢ Always be at the forefront of innovation through big

investment in R&D

Page 5: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

History

1999 2003 2007 2010 2012 2014

Page 6: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Customers Technologies de

l'Information Bio

Technologies Finance

Ingénierie Aéronautique Energie Espace

Medias Distribution

Page 7: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Cloud & Grid IaaS

Scheduling & Orchestration

HPC Workflow & Parallelization

Innovative Technology

Page 8: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Products

Page 9: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration
Page 10: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

ProActive Cloud Automation

Ø Automatic Deployment of Many Vms Applications Ø Synchronization of Composite Services Ø Monitoring (Physical, Virtual, Functional) Ø Auto-Scaling Ø Multi-Cloud Management with Bursting

Ø Reversibility (e.g. Vmware ó OpenStack)

Page 11: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration
Page 12: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Cloud Automation

Page 13: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Cloud Automation Services

Elasticity

Fault Management

Reversibility

Brokering

Scalable

Updates

Life Cycle Management

BackUp

Control and Monitoring

Deployment

Page 14: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

From Top to Bottom

Page 15: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Cloud Automation

Catalogue

Supervision" Orchestration" Gestion de ressources"Construction"Catalogue"

Service Catalogue ‣  Software ‣  Platform ‣  Infrastructure

Management Console ‣  LifeCycle ‣  Supervision ‣  (Re) configuration

Added Value Services: •  Elasticity •  Fault-Tolerance •  Reversibility •  Contextualization of

generic VMs

Page 16: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Workflows & Scheduling

Workflow builder

Easily build New workflows ‣  Web applications ‣  Java SDK ‣  XML files

Create any type of task ‣  Scripts ‣  Executables ‣  Java

Advanced workflows ‣  Loops ‣  Conditions ‣  Variables ‣  Execution control

Page 17: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Workflows Orchstration

Workflows orchestration

Generate reports ‣  Users ‣  Groups ‣  Usage

Plan your actions ‣  Unique ‣  Recurrent

Manage workflows execution ‣  Logs ‣  History ‣  Priority ‣  Pause, stop, etc.

Page 18: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Resource Management

Resource Management

All your resources in one view ‣  Physical machines ‣  Virtual machines ‣  Multi-OS ‣  Private clouds ‣  Public clouds

Secure your resources ‣  User rights ‣  Group rights

Page 19: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Monitoring

Monitoring

Monitor all your resources ‣  Physical machines ‣  Virtual machines ‣  Storage ‣  Network ‣  Applications

Expose your own metrics ‣  JMX ‣  API REST ‣  Flat file

Page 20: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

So looping back … from Bottom to Top

Page 21: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Live Demonstration

Page 22: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Live Demonstration

1.  Deployment of a Composite Service

2.  Update of the Application

3.  Applying a Security Patch

4.  Life Cycle Managment

Page 23: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Thanks for your attention!

Page 24: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Dedicated resources

Clusters

Static Policy

Amazon EC2

EC2, Azure, HP Cloud, …

Dynamic Workload Policy

Desktops

Desktops

Timing Policy 12/24

Integration: Scilab, Matlab & R Applications

Page 25: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

With High Availability

❏ Availability ❏ Recovery ❏ Performance ❏ Backup

Page 26: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

High Availability

What if?

❏  A node is lost ❏  Failure is detected and the task running (if any) is restarted on

another free node

❏  A crash happens while task are running ❏  Using the database, running tasks are recovered from the database

The unit of work is the task

Page 27: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

High Availability

On node side, failure is expected and failure management built in

❏  How to maintain computational capacity? ❏  The node can reconnect to the Scheduler automatically

❏  The Scheduler can redeploy new nodes ❏  Restart Down Nodes policy

Page 28: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

High Availability

On the server side, state is stored in:

❏  Database ❏  Real time replication

❏  MySQL Master-Master replication ❏  MySQL+DRBD Failover

❏  File system ❏  Real time replication

❏  DRBD ❏  SAN

Page 29: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

High Availability

FS/DB

ProActive Scheduler

Node

Node

Node

FS/DB

ProActive Scheduler

Node

Node

Node

Failover installation

Primary installation

Via Active-Passive architecture

Page 30: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Tools involved

Linux only

❏  Failover ❏  Corosync to communicate between primary/failover site

❏  Pacemaker to coordinate service states ❏  Also does IP failover via virtual IP

❏  Stonith to avoid brain split issues

❏  SSH Infrastructure & Restart Down Nodes policy for nodes deployment

❏  State Redundancy

❏  DRBD ❏  MySQL

Page 31: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration

Disaster Recovery

❏  To Backup

❏  Database ❏  Task/Job queue (running, pending, finished)

❏  File system ❏  Task logs

❏  Monitoring history

❏  Recovery Point Objective ❏  all running tasks are lost and will be restarted from scratch

❏  all active user sessions are lost ❏  Recovery Time Objective

❏  time to start ProActive Scheduler


Recommended