07/06/11

New Features of WS-PGRADE (and gUSE)

2010 Q3 - 2011 Q2

Miklós Kozlovszky (m.kozlovszky@sztaki.hu)

MTA SZTAKILPDS

07/06/11 2

Outline•External features (WS-PGRADE)

– GridsphereLiferay 6.x based (JSR 168 GS JSR 286 Liferay)

– gUSE remote access specification + implementation

– New portlets• Public key (support of remote resources)• Internal Services Portlet group (visual feedback about the internal services)• Resources (management of the available resources)• gLite Explorer – It gives a chart to the users for configured gLite VOs

– Security enhancement (XSS extinguished)

•Internal features (gUSE)– Statistics & logging

– Submitters• ARC• UNICORE

– Authentication• SAML (Security Assertion Markup Language)

– LFS support

– PBS support

– Computing as a Service” new upcoming technologies as: Google Application Engine new supported middleware

– Optimization of submitter status updates (concurrency API)

•Additional elements

DCI Bridge

Metabroker

Translator service

07/06/11

New portlets

• Internal Services Portlet– group visual feedback

about the internal services

• Resources Portlet– management of the

available resources• gLite Explorer Portlet

– It gives a chart to the users for configured gLite VOs

• Public key Portlet– Support of remote

resources which need dedicated user accounts and SSH level identification.

07/06/11

gUSE remote access

gUSE

WS-PGRADE

ASM

MOSGRID/x Remote client (CLI)

Remote access

API

Programming Environment (JAVA API)

Remote access module(JAVA API)

Chemaxon’s JChem JAVA API

SHIWA

Client side

Server side

ASM

07/06/11

ASM - Basic idea

• A new module called “Application Specific Module” has been developed for gUSE that ease the creation of Application Specified Portlets – The module provides programming API to control applications

developed using gUSE– The module provides programming API to access inner gUSE

services

• Any kind of Graphical interface can be developed on top of this module – GUI written in JSP, JSTL (Java Servlet Tag Library ) and Java– GUI can be customized for the grid application– GUI can be customized for end users

07/06/11

ASM Concept

WS-PGRADE

Internal components

submitter

Desktop or Service grids / cloud / ClustersDCIs

gUSE

Web browserClient

Liferay + Tomcat

07/06/11

ASM Concept contd.

WS-PGRADE

Internal components

submitter

Desktop or Service grids / cloud / ClustersDCIs

gUSE

Web browserClient

Developed web-interface

Liferay + Tomcat

07/06/11

ASM Concept in details

Web browserClient

Developed web-

interface

Web pages (JSP, JSF or other)

JAVA event handler, and inner classes

Application Specific Module API

Configuration files (wsdd)

You develop it

You develop it

07/06/11

Statistics & logging

ObjectiveGeneric method for measuring workflow, job and

resource performance

Solution:Integrate a new service into the WS-PGRADE

Grid Portal Data CollectionMetric CalculationMetric Visualization

07/06/11

Aggregate Job Example

Aggregate Job for

LongRunner

Aggregate Job for

LongRunner

Aggregate Job for Random

Aggregate Job for Random

Inserted IntoInserted Into

Aggregate Job for

LongRunner

Aggregate Job for

LongRunner

Inserted Into

SEEGRID GILDASEEGRID

07/06/11

Workflow InstanceStatus =

Done

Workflow InstanceStatus =

Done

07/06/11

Data Aggregation

Job Status Entries toJob Instance Entries

Job Instance toAggregate Job Entries

07/06/11

Demo

07/06/11

07/06/11

07/06/11

07/06/11

Case studies…-CancerGrid was covered (skipping)

07/06/11

ProSim workflow in g-USE

• UK project for Protein Molecule Simulation on the Grid

• a combination of GEMLCA and standard g-USE jobs

• Executed on 5 different sites of the UK NGS

• Parameter sweeps in phases 3 and 4

• Status: actively used in production

Phase 1Phase 2

07/06/11

MosGrid Science Gateway for Molecular Simulations

• Requirement: Workflow enabled grid portal for UNICORE based on Liferay

• Solution:– Adaptation of WS-PGRADE

from GridSphere to Liferay– Development of UNICORE

Submitter– Support for SAML– Development of ASM support

• See details:– Previous presentation by Sandra

Gesing: A Science Gateway for Molecular Simulations

07/06/11

Advanced simulation event visualization and result analysisSimulations write result files:

vector results: a sequence of (time, value) pairs recorded during simulation

example: queue lengths during simulation; end-to-end delays of arrived packets

typical visualization: line chart

scalar results: values of variables, typically recorded at the end of simulation

example: total number of packets dropped; average throughputtypical visualization: bar chart, x-y plot (scatter plot)

File format: line-oriented text fileyou can use OMNeT++'s tools to process and visualize themor you can use 3rd party tools (R, Matlab, Excel, etc) or write your own

ones for specialized computations

07/06/11

Two types of OMNET portalsOMNET user portal

• User accounts exist for 1 week

• Can handle NED files that use INET and Queuing module sets from OMNET

• No binary come from end user– Portal does grid operations with

one fixed certificate

OMNET developer portal

• Permanent user accounts

• Can handle custom OMNET modules and NED files that handle such modules

• Binaries come from end users– Users are authenticated based

on their personal certificates

07/06/11

OMNeT++ user portalAccount request

07/06/11

OMNeT++ user portalAccount request

07/06/11

OMNeT++ user portal“Account created” email

07/06/11

OMNeT++ user portalPersonal settings

07/06/11

OMNeT++ user portalInput definition window

07/06/11

OMNeT++ user portalSimulation execution window

07/06/11

OMNeT++ user portalSimulation execution window

07/06/11

OMNeT++ user portalSimulation execution window

07/06/11

OMNeT++ user portalResult download window

07/06/11

Thank you for your attention

Questions?

m.kozlovszky@sztaki.hu

www.lpds.sztaki.hu