Intelligent workflow resource planning on the Network Service

Interface (NSI)

Zhiming Zhao, Cosmin Dumitru,Arie Taal, Adianto Wibisono, Paola Grosso, Cees de Laat

Data intensive applications on programmable infrastructure

NEwork aware Workflow QoS Planner

Main functionality

Abstract workflow of

DIA

Resource discovery

Network selection/

reservation/ provisioning

Application execution

NEWQoS-Planner

1. Zhao, Z., et al., (2012). Planning data intensive workflows on inter-domain resources using the Network Service Interface (NSI), WORKS in SC12 Salt Lake City.2. Zhao, Z., et al., (2011). An agent based network resource planner for workflow applications. International journal of Multiagent and Grid Systems, 7(6), 187-202.

We will demonstrate:• How the NEtwork aware Workflow Planner (NEWQoSPlanner)

supports these issues:• How to describe an abstract workflow?• How to select optimal resources and network paths for a

workflow?• How to reserve/provision network paths using the

Network Service Interface (NSI)?

How to start the NEWQoSPlannerSoftware structure

As XMLRpcAs FIPA agentsAs standalone application

Dependent packagesJavaSWIProlog

Support NSIStart the software

$NEWQoSP_HOME/bin/script/startServer.sh

How does it work?

GUI Planning engine

Abstract workflow

Resource candidates and execution control

Abstract workflow descriptionDescribing an abstract application using the

QoS aware abstract workflow (QoSAWF) schema

RequestProcessPre/Execution/Post conditionsDataQoS

QosAWF_Thing

Reliability

CodecQualityResolution

Precision

Throughput

Security_LevelTimeliness

ArchiveData

PlaybackData

Quality_Attribute

Request

DataCondition

Process

CompressionRateFramerate

Or_Condition

And_Condition

Media Scientific_Data

Video

Audio

Sensor_Data

Simulation_Results

Is-a

Is-a

Is-a

Is-aIs-a

Is-a Is-a

Is-a

Is-a

Is-a

Is-a Is-a

Is-a

Is-aIs-a

Is-a

Is-a

Is-a

Is-a

Is-a

Is-aIs-a

Is-aIs-a

require_Functionality

contain_Condition

create_Datarequire_Data

require_Quality

execution_Condition

post_Condition

pre_Condition

MoveData

Is-a

Demo 1: semantic resource search: - keywords

- Resolution - etc.

Demo 2: Search a movie about Bridge to display, using the network path selection/ reservation/ provision function of NSI.

Performance characteristics

Performance characteristics

Demo test bed (uvalight-sc12.owl)

Summary• NEWQoSPlanner

• Searching, planning• Challenges

• Multi viewpoint in GUI• Automatic • Cross domain

• Future work• NSI+Openflow• With existing workflow

applications

Acknowledgement

NEWQoSPlanner: Zhiming ZhaoInformation PreProcessing: Arie TaalGUI developer: Adianto Wibisono, Cosmin

DumitruTest bed VM and NSI installation: Ralph

Koning, Jeroen van Ham.Portal interface

http://newqosplanner-demo.appspot.com/main/Project page

http://staff.science.uva.nl/~zhiming