+ All Categories
Home > Documents > Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2)...

Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2)...

Date post: 19-Jan-2016
Category:
Upload: roberta-dickerson
View: 218 times
Download: 1 times
Share this document with a friend
Popular Tags:
46
Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) [email protected] 1) Poznan Supercomputing and Networking Center 2) Czestochowa University of Technology Piotr Kopta (2) [email protected]
Transcript
Page 1: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Hiding Grid Complexity Behind

SSH Session Server framework

Tomasz Kuczyński (1,2)

[email protected]

1) Poznan Supercomputing and Networking Center2) Czestochowa University of Technology

Piotr Kopta (2)

[email protected]

Page 2: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Outline

SSH Session Server framework

CLI Model Example

Framework Architecture

Application Managers

Interactions between the components

Demo

Page 3: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

SSH Session Server framework

What exactly is SSH Session Server framework ?

Why SSH ?Installed on each resource

No modifications of existing applications needed

Why PTYs ?utilization of standard SSH client

How does framework work with SSH session ?CLI interaction model

Application descriptors

Page 4: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

SSH Session Server framework (cont.)

Main goal of the framework is to gain high level of business logic – presentation layer separationSSH Session Server - continuation of WebCI portal solutions

Features:Adding user-defined interfaces at portal run-time

Easy adaptation of existing applications

Seamless installation

XML-based application interface description

VRML, X3D, SVG, Charts (jpeg, png) support

Page 5: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

CLI Model Example

Page 6: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Framework Architecture

Page 7: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Application Managers

Simple applications that have CLIApplication manager using the grid resource management system such as GRMS may submit many parallel jobs (reduce apps run-time) and control all the computing on user’s behalfOverall system performance is increasedUser interaction is limited to required minimum

run a jobview resultsdo not worry about resourcesApps manager will adjust number of jobs running in parallel to the number of resources available

Page 8: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Interaction between the components

Portal <-> Application Manager <-> Grid Infrastructure

User sets up the input parameters and orders to start an application

Portal passes input data to Application Manager (APPMGR)

Application manager uses the GRMS GAT adaptor to run an application

Resource and job description generated by APPMGR is sent to

GRMS

GRMS finds appropriate resources and runs a job

GRMS, using replica management system or GRMS’s own file

movement mechanisms, stages the files

GRMS starts a job and returns job handler to the APPMGR

Page 9: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Interactions (cont.)

APPMGR collects all the results and presents them to the portal

User decides about the next stepsChooses the visualization style

HTML, XML, VRML, X3D, SVG, JFreeChart

Plays with the results and decides about further application runs

Views the history of the application runs

Sets up the notification mechanisms (email, sms, other...)

All user activities are asynchronous and non-blockingA user can for example start a job and then, while waiting for the results, logout, go for a coffee and then return to the application

Page 10: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Today’s demo

We will show an interactive Heat Transfer application run using GridLab and ClusterIX tools (Portal, GAT, GRMS, GAS, Mobiles Service, other) and SSH Session Server frameworkApplication user perspective

Grid hidden behind the portalNo job description interface

Why should user struggle with it? This is too complex...

No data transfer interfaceNo less complex than job description interface, so why bother user about it?

No resource discovery interfaceWhy should user know anything about the resources he might run the job at?

Page 11: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 12: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 13: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 14: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 15: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 16: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 17: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 18: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 19: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 20: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 21: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 22: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 23: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 24: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 25: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 26: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 27: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 28: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 29: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 30: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 31: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 32: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 33: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 34: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 35: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 36: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 37: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 38: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 39: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 40: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 41: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 42: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 43: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 44: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 45: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.
Page 46: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center.

Questions

For more information visit:

GridSphere http://www.gridsphere.org

GridLab http://www.gridlab.org

Open Grid Portals http://www.opengridportals.com

ClusterIX http://www.clusterix.pl

Thank you


Recommended