Open Source for Open CloudNov 24~25, 2010Paris, France

A Cloud Platform for Delivering Instant Development Service with

Service Oriented ApproachesHailong Sun

sunhl@act.buaa.edu.cnBeihang University (BUAA), Beijing, China

Nov. 24, 2010

2

Agenda

Service oriented software developmentService cloud platformSummary

3

Service–oriented software design & developmentBasic approach

Improve the productivity of software development through reusing of loosely-coupled services over Internet

Applications

ComponentServices

Infrastructure

Key issuesService management Service compositionRuntime management

Service oriented software development

4

Quality and Security M

anagement

Infrastructural platform

Middleware supporting platform

Service resources

Web service CORBA EJB Other components

Operatingsystem DB

Networkservice

Service & management

toolkits Service schedule

Software production platform

Toolkits for registry

and deploy

Require.Specification

toolkits for Software

Developing

Our vision FutureWare

5

From WebSASE to XServices

XML Doc Security

XML InformationProcess

XKMS Service

SAML Service

XACL Service

WebSASE

SOAP Protocol

UDDI Protocol

Web Service Object Container& Runtime Server

Manage Console

XServices1.0

Web Console

Web ServicePortal & WSRPWeb ServiceWorkflow & ToolWeb ServiceTransactionWeb ServiceRuntime 1.5

XServices2.0

Web ServiceApplication server- XService

XLinker -Light Weight WSRWeb ServiceWorkflow 2.0Web ServiceReliable Message

Web Console 2.0

XServices3.0

AJAX UI

WSRF

Web Service QoS

SOA/ESB

Web ServiceWorkflow 3.0

Semantic UDDI

……

19991999

2000-2002

2000-2002

2002 &2003

2002 &2003

2004-2006

2004-2006

2007-2008

2007-2008

XServices4.0

WSRuntime

BPELEngine

BPMNEngine

UDDI、SWSR

WSDT

WSManager

……

2009-2010

2009-2010

BPELDesigner

BPMNDeveloper

863 programHGJ program

6

Success stories: applicationsApplication domains: e-Government, Satellites, Remote Sensing, Health, Geology, ITS7 applications:

SOA based telecontrol and telemetering system of satellitesRemote sensing data public service platformManagement and service system of large scale spatial dataCollaborative visualization system of 3D geological dataCollaborative analysis system of medical dataRemote control services of microscopeTraffic information publishing system

12 Collaborating organizationsNonprofit Orgs: OW2 Opensource Consortium, Internet Open Standards Lab(ISOL)Research Institutes：Chinese Standards Institute of Electronic Technology, 27th Institute of Chinese Electronic Technology Inc. ,Chinese Academic of Spatial Technology, Peking UniversityCompanies：French Thales Inc., CVICSE, InterVision, China Center for Resource Satellite Data & Application(CRESDA), Jandar, PetrochinaDaqing Oilfield, Sinopec Shengli Oilfield

7

Trustie project & SOARWare

Trustie project: a key 863 project from MOST2007-2010

Highly-trustworthy software production tools and environments

For us: Beihang UniversityFocusing on service–oriented software design & development, and the trustworthy characteristics of software qualitySOARWare : Service oriented software production and running environment

Service resource managementDesign and developmentRuntime support

8

SOARBase Active service collecting

Service mining

Service info. collecting

Service development

tool

Business process

modeling tool

Service choreography

tool

Service test & verification

tool

Service deployment

toolOther tools

Software

modeling and

development

Service Reg./Discovery

deploy

SaaS-oriented Software Service Provisioning and Consuming Environment

Online modeling and development Service provisioningService access

Service Info. Mgmt.

MonitoringService

evolution mgmt. Service running

and evolution

Service Bus

Service Container

Composite service engine

Service Oriented SPL

Architecture of SOARWare

9

SOARBase: service management

Service resourcesAtomic servicesComposite services (business process)

FunctionalityCollecting: 17,000+Registration & searchMgmt of service attributes (non-functional)

AvailabilityResponse timeReputation

Service miningService recommendation

10

ServiceXchange

The released version of SOARBase

www.servicexchange.cnNot including business process management

A totally new look will be seen very soon

11

SOARBase Active service collecting

Service mining

Service info. collecting

Service development

tool

Business process

modeling tool

Service choreography

tool

Service test & verification

tool

Service deployment

toolOther tools

Software

modeling and

development

Service Reg./Discovery

deploy

SaaS-oriented Software Service Provisioning and Consuming Environment

Online modeling and development Service provisioningService access

Service Info. Mgmt.

MonitoringService

evolution mgmt. Service running

and evolution

Service Bus

Service Container

Composite service engine

Service Oriented SPL

Architecture of SOARWare

12

Service Oriented SPLService Oriented SPL

Developer

Intermediate assets

Business model

Web service Execution model

Composite service

Business requirement

Software product

Service oriented software production line

13

Service oriented SPL

SPL config & management toolConfigue software production processMgmt. of software production processAssign and Mgmt. of production tasksMgmt of intermediate assets

Various software production toolsBP modeling toolService choreographyService encapsulationTest and verification…

14

BPIDE-Business Process IDECollaboration between multi-roles

Domain expertsApp. analystsService developers

A suite of toolsModeling toolService encapsulationService orchestrationVerification toolTesting tools

15

SOARBase Active service collecting

Service mining

Service info. collecting

Service development

tool

Business process

modeling tool

Service choreography

tool

Service test & verification

tool

Service deployment

toolOther tools

Software

modeling and

development

Service Reg./Discovery

deploy

SaaS-oriented Software Service Provisioning and Consuming Environment

Online modeling and development Service provisioningService access

Service Info. Mgmt.

MonitoringService

evolution mgmt. Service running

and evolution

Service Bus

Service Container

Composite service engine

Service Oriented SPL

Architecture of SOARWare

16

Service running and evolution

Service busMessage exchangingQoS-aware service schedulingMonitoring of composite service engines and service instances

Service containerAxis2 poweredEasy service deploymentContainer management

Composite service engineDistributed processing of BPMN serviceDynamic service evolution

17

Source code statistics（~600K LOC）

604,71213,6293668Total

2476526287Web platform

384531040357Software Production Line

591981398494SOAR Base

840881165570SOAR Explorer

922424788SOAR Home

61535673255BPMN Engine

884323464Service Bus

31860692831753BPIDE

LOCSize of source files（

KB）Source filesModules

18

Successful applications

Funded by 863 programDigital China

Government tax service

Wonders InformationE-government applications

19

Agenda

Service oriented software developmentService cloud platformSummary

20

Reflections- many development supporting software involved

ToolsBusiness process modelerService composition toolVerification and test toolService deployment toolMonitoring tool

MiddlewareService containerComposite service execution engine (workflow engine)Service bus

21

ProblemsThe extra work for developers

Install and configure various development toolsInstall and configure runtime supporting middlewareObtain and maintain underlying resources

MachinesNetworks

However they should focus on “development”.

Dev.→Service!

22

The crux of cloud computing

ServiceIaaS: Infrastructure as a ServicePaaS: Platform as a ServiceSaaS: Software as a Service

Can we make use of cloud computing to save developers from the extra work?

An online development environmentA hosting platformAn on-demand infrastructure service

23

Our goal

Building a cloud platform for service oriented software development

Instant development without installing toolsInstant deployment without installing middlewareInstant running without knowing the underlying resources

24

Moving towards a cloud platform

Online application developmentBrowser-based IDEBusiness process centric developmentOnline sharing of software services

Transparent deployment and runningSimilar to Google AppEngine, etc.

25

Service compositionService composition

AS APIAS API

Infrastructure resources (compute, storage, network…)Infrastructure resources (compute, storage, network…)

Software Appliance: Service Container、BPMNEngine、App ServerSoftware Appliance: Service Container、BPMNEngine、App Server

SA org. and mgmt.SA org. and mgmt.

CS APICS API RM APIRM API

Scheduling, running& monitoring

Scheduling, running& monitoring

Service deploymentService deployment

AppEngine(PaaS)

IaaS

Trustworthiness

Trustworthiness

Service Mgm

t.Service M

gmt.

Online development

ServiceXchange MyCloudMyCloudSaaS

AppStoreAppStore

SCP: Service Cloud Platform

26

IaaS: software appliance provisioning

Software appliance=VM/PM+ middlewareDynamic provisioningManageability

FunctionsDynamic deployment/un-deployment of SAsLifecycle managementMonitoringLogging

Service ContainerService Container

BPMNEngineBPMNEngine

App ServerApp ServerAgent

VM/PM

SA ManagerSA Manager

27

AppEngine and SaaS tools

Atomic Service APIAtomic Service API Composite Service APIComposite Service API Runtime APIRuntime API

AppEngine(PaaS)

Online development

ServiceXchange MyCloudMyCloud AppStoreAppStore

SaaS

Online App Access

… API… API

28

App Engine: hosting environment

KernelKernel

Lightweight service bus

Lightweight service bus

AS deploymentAS deployment

AS invocationAS invocation

CS deploymentCS deployment

CS invocationCS invocation

CS monitoringCS monitoring

Load balancingLoad balancing

Data managementData managementSoftware appliancemanagement

Software appliancemanagement

…

SA ManagerSA Manager

29

MyCloud

Personalized development environmentService subscriptionApp development tools

Instant development tools: BPIDELite- a light-weight BPMN editor and service composition tool suite.Instant deployment interface

Instant running-Virtual runtime environmentMyServiceContainerMyBPMNEngineOnline monitoring tool

30

BPIDELiteFlex-based development toolset

BPMN-based business process modelingService orchestrationInstant deployment

31

MyServiceContainerVirtual service container

Service deployment/un-deploymentWSDL file browsingService invocation

32

MyBPMNEngineVirtual composite service execution engine

BPMN compliantCS deployment BPMN model browsingService invocation

33

Online monitoring

Flex-based composite service monitoringInstance stateIntermediate state (similar to debugging)

34

App Store

Application managementApp publishingApp categorizingApp search

35

Agenda

Service oriented software develomentService cloud platformSummary

36

Summary: Past, Present and Future

The pastWe have a lot of work in service oriented softwareFrom WebSASE to XService and SOARWare

The presentWe are building a cloud platform for service oriented software development so as to provide instant service for developers

Instant developmentInstant deploymentInstant running

The futureRicher online development toolsBetter multi-tenant support

Load balancingSeparationDependability

Dynamic resource provisioning: incorporate existing IaaStechnologies

37

Service Cloud Platform

Currency ExchangeCa <->Cb

Currency ExchangeCa <->Cb

RMB → ISK?S: Ca→USD→Cb

RMB → ISK?S: Ca→USD→Cb

S’:    Ca→Cb？Yes: Ca→CbNo:  Ca→USD→Cb

S’:    Ca→Cb？Yes: Ca→CbNo:  Ca→USD→Cb

operator

Mary

EUR‐>USD；USD‐>EUR；ISK‐>USD；USD‐>ISK；GBP‐>USD；USD‐>GBPRMB‐>USD；USD‐>RMBRMB‐>EUR; EUR‐>RMB

searchsearch convert convert paymentpayment

John

Each conversion will need some cost!

A short demo of SCP

Anyproblem?

Improvement

38

Thank you & Merci!

Q&A

39

Service oriented software solution stacks

体系结构：

Service Portal

E-Gov. & E-Com. ITS ……

External Interfaces and Specifications of System

Services Workflow Engine

Services Runtime

Services

Development

Messaging

Naming

Events

Safety

monitor

System Services

System Management Tools

Etc.Telecom

Services Information Portal

directory

Security and Quality

Service-Oriented Applications on Internet

Video Meeting

Deployment

Services

40

Monitor tool

Service requester

WSClient

Develop toolDevelopment tool

WSWF

Transa ,WSRFRliable

HTTP 1.1

XService

XLinkerWS WS WSWS

WS XLinker

UDDI

WS Portal

Service developer

WSDesigner

monitor

WSMTModeling tool

developer

WSWD

Service provider

WS XService

bind

find

publish

monitordevelopment

findbind

bind

mon

itor

developmentfind