Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure

BalticGrid-II ProjectBalticGrid-II Project

The BalticGrid-II Final Review, Brussels, 26thMay, 2010 1

Joint Research Activity

Enhanced Application Services on Sustainable e-Infrastructure

Joint Research Activity

Enhanced Application Services on Sustainable e-Infrastructure

Bartek PalakBartek [email protected]

Poznan Supercomputing and Networking CenterPoznan Supercomputing and Networking Center


OutlineOutline

JRA activity of BalticGrid-IJRA activity of BalticGrid-I

Recommendation from BG-I final reviewRecommendation from BG-I final review

JRA activity descriptionJRA activity description

ObjectivesObjectives

Description of tasksDescription of tasks

Summary of work doneSummary of work done

Plans for the next periodPlans for the next period

ConclusionsConclusions


JRA activity of BalticGrid-IJRA activity of BalticGrid-I

Account Service Level Agreement Markets Account Service Level Agreement Markets and Dynamic Account Managementand Dynamic Account Management

Partners: Partners: EENetEENet, , IMCS ULIMCS UL, , KTHKTH, , PSNCPSNC, , VUVU

ObjectivesObjectives InvestigateInvestigate, , prototype mechanisms for prototype mechanisms for SLA security and enforcementSLA security and enforcement DesignDesign and and develop develop account management systemaccount management system Development of products:Development of products:

– VUS – Virtual User SystemVUS – Virtual User System– DGAS - DGAS - Distributed Grid Accounting SystemDistributed Grid Accounting System – Tycoon – approach for better Service Level Agreement (SLA)Tycoon – approach for better Service Level Agreement (SLA)

OutcomeOutcome VUS and DGASVUS and DGAS proved its qualityproved its quality by running on production sites. by running on production sites. Several insurmountable issues have been found with the Tycoon systemSeveral insurmountable issues have been found with the Tycoon system

– Unreliable tool, HP changed the policy, no open source any moreUnreliable tool, HP changed the policy, no open source any more– The decision of BG is not to The decision of BG is not to ususee this system due to this issues this system due to this issues


Recommendations from BG-I final review Recommendations from BG-I final review

Recommendations:Recommendations: the consortium will need to the consortium will need to provide end-users with the necessary provide end-users with the necessary

capabilities to use the grid infrastructure effectivelycapabilities to use the grid infrastructure effectively […] […] following on from the above point, JRA1 and related work are going following on from the above point, JRA1 and related work are going

to become increasingly important and the reviewers recommend that to become increasingly important and the reviewers recommend that the the consortium should continue work in this areaconsortium should continue work in this area in future in future projects;projects;

Recommendations implementation:Recommendations implementation:Activity focuseActivity focusess on providing services on providing services enabling efficient and intuitive enabling efficient and intuitive usage of Grid resourcesusage of Grid resources


JRA ActivityJRA Activity

Person-months Distribution

NA14%

NA29% NA3

14%

NA44%

SA133%

SA210%

SA319%

JRA7%7% of 7% of project project resourcesresources

31,5 PMs31,5 PMs

PartnersPartners Vilnius University Vilnius University Vilnius Gediminas Technical Vilnius Gediminas Technical UniveristyUniveristy University Poznan Supercomputing and University Poznan Supercomputing and

Networking Center (Networking Center (coordinationcoordination))


ObjectivesObjectives

Extending the e-Infrastructure with Extending the e-Infrastructure with advanced servicesadvanced services necessary from the user, application and administrator point necessary from the user, application and administrator point of view - the GUI level of view - the GUI level

Enhancements of existing services Enhancements of existing services enabling user-friendly enabling user-friendly and intuitive accessand intuitive access to Grid environment to Grid environment

Providing Providing support forsupport for the new research communitiesthe new research communities well well defined in NA3 (Application Identification and Collaboration) defined in NA3 (Application Identification and Collaboration) and supported by SA3 (Application Integration and Support)and supported by SA3 (Application Integration and Support)

The BalticGrid-II Final Review, Brussels, 26thMay, 2010

Description of tasksDescription of tasks

Providing uProviding user-level support for Grid advanced data management ser-level support for Grid advanced data management

Adaptation of Adaptation of task flow task flow definition and management mechanisms definition and management mechanisms

Providing visualization tools for scientific computing in GridProviding visualization tools for scientific computing in Grid

Development of a user-friendly environment used for cooperation of Development of a user-friendly environment used for cooperation of user groups and applicationsuser groups and applications

AA clear vision of clear vision of componentscomponents development: development:

Migrating Desktop Migrating Desktop advanced grid interfaceadvanced grid interface

Visualisation of specific computing resultsVisualisation of specific computing results

Gridcom groupwareGridcom groupware


MJRA1.1 Design phase closed (1)MJRA1.1 Design phase closed (1)

Design phase closed (MJRA1.1)Design phase closed (MJRA1.1)

Definition of works planned within activity Definition of works planned within activity Establishing co-operation rulesEstablishing co-operation rules Definition of Definition of relations to other activities relations to other activities Design of development directionsDesign of development directions

Performance analysis of visualization tools in GRIDPerformance analysis of visualization tools in GRID environmentenvironment Deployment of existing Deployment of existing data visualization tools data visualization tools

– Visualization toolkit VTK 5.0.3 Visualization toolkit VTK 5.0.3

– Turnkey package ParaView 3.2.1 (based on VTK)Turnkey package ParaView 3.2.1 (based on VTK)

– Visualization system LitVizGVisualization system LitVizG

– gVid/i2gLogin software (and VTK version 4.4.2) gVid/i2gLogin software (and VTK version 4.4.2) Visualisation tools performance tests Visualisation tools performance tests


Design phase closed (MJRA1.1) – continuedDesign phase closed (MJRA1.1) – continued

Milestone Milestone reached on timereached on time (PM04) (PM04)

Milestone summarized in two reports:Milestone summarized in two reports: DJRA1.1DJRA1.1 ““Performance analysis of sequential and parallel Performance analysis of sequential and parallel

visualization in GRID environment” (visualization in GRID environment” (PM03PM03)) DJRA1.2DJRA1.2 “Design phase, interoperability and definition of “Design phase, interoperability and definition of

cooperation with other activities: SA1, NA3, SA3 and plan for cooperation with other activities: SA1, NA3, SA3 and plan for education trainings in co-operation with NA2” (education trainings in co-operation with NA2” (PM04PM04))

MJRA1.1 Design phase closed (2)MJRA1.1 Design phase closed (2)


First prototype readyFirst prototype ready (MJRA 1.2) (MJRA 1.2)

Enhancement of BalticGridEnhancement of BalticGrid-I -I NA3 project components to be compatible NA3 project components to be compatible with Grid standards with Grid standards

Providing support for advanced data managementProviding support for advanced data management File manager (File manager (GridGrid CommanderCommander) deployed) deployed

as an independent network applicationas an independent network application Restructuring of The Migrating Desktop Restructuring of The Migrating Desktop Mechanism for easy integration of various file systemsMechanism for easy integration of various file systems Changes in implementation of existing file systemsChanges in implementation of existing file systems Support for Support for Grid Grid data access mechanismsdata access mechanisms

Gridcom groupware developmentGridcom groupware development The first deployable releaseThe first deployable release Gridcom recovering after system restartGridcom recovering after system restart AAdministrative commands dministrative commands for for system system configurationconfiguration Error handling improvementsError handling improvements Security enhancementsSecurity enhancements

MJRA1.2 First prototype ready (1)MJRA1.2 First prototype ready (1)


First prototype readyFirst prototype ready (MJRA 1.2) - continued (MJRA 1.2) - continuedDeployment of the software in BG-II testbed for visualizationDeployment of the software in BG-II testbed for visualizationVVisualization tools deployedisualization tools deployed considering outcome of performance analysis. All tools are considering outcome of performance analysis. All tools are based on based on VTK to minimize development effortsVTK to minimize development efforts with with gLite gLite compatible architecturecompatible architecture.. ParaView 3.4.0ParaView 3.4.0 – – an open-source software suitable for parallel visualization and parallel an open-source software suitable for parallel visualization and parallel

rendering of large datasets.rendering of large datasets. Visualization e-serviceVisualization e-service VizLitGVizLitG isis designed for convenient access and visualization of designed for convenient access and visualization of

remote data files located in grid.remote data files located in grid. VTK 5.2.1 applicationsVTK 5.2.1 applications interactively run on grid by means ofinteractively run on grid by means of GVidGVid software. BG-II users software. BG-II users

can can employ full power of huge toolkit functionality and flexible interactivityemploy full power of huge toolkit functionality and flexible interactivity.


The The first first prototype details described in report:prototype details described in report: DJRA1.3 - DJRA1.3 - “Fi“Firrst prototypest prototype […]” […]” ((PM09PM09))

MJRA1.2 First prototype ready (2) MJRA1.2 First prototype ready (2)


Migrating DesktopMigrating DesktopHandling gLite parametric jobsHandling gLite parametric jobs

Changes Changes ofof job description structures job description structures

SSupport for parametric jobs in submission mechanismsupport for parametric jobs in submission mechanisms

Job monitoring mechanisms Job monitoring mechanisms - - improvementsimprovements

Providing support for list of parametersProviding support for list of parameters

MJRA 1.3 - Second prototype ready (1)MJRA 1.3 - Second prototype ready (1)


Migrating DesktopMigrating Desktop

MMD - D - VizLitG VizLitG iintegrationntegration VizLitG integrated as MD file viewer (HDF5)VizLitG integrated as MD file viewer (HDF5)

DDefinition and management of task flow efinition and management of task flow EEvaluation of existing toolsvaluation of existing tools

Adoption of Adoption of the Kepler workflow orchestration the Kepler workflow orchestration systemsystem

Publishing Kepler for BalticGrid-II usersPublishing Kepler for BalticGrid-II users

Preparation of tPreparation of training materialsraining materials Recorded demosRecorded demos

TutorialsTutorials

User guides User guides




Visualization ToolsVisualization ToolsAdaptation of e-Service Adaptation of e-Service VizLitGVizLitG to BG-II user needs:to BG-II user needs: Enhanced interactivity including VTK widgets,Enhanced interactivity including VTK widgets, ImprovedImproved security (security (Message Authentication over SSLMessage Authentication over SSL).).

Open-source package Open-source package ParaViewParaView v3.6.1: v3.6.1: Developed unstructured HDF5 file reader for decomposed data files of pilot Developed unstructured HDF5 file reader for decomposed data files of pilot

applications, applications, Distributed GPU rendering employed on grid.Distributed GPU rendering employed on grid.

Advanced functionality of Advanced functionality of VisPartDEMVisPartDEM:: Parallel visualization of large particle systems,Parallel visualization of large particle systems, Visualization of initial defects and propagating cracks,Visualization of initial defects and propagating cracks, Visualization of safety margin forces.Visualization of safety margin forces.


GridcomGridcomNew: New: User User AAccess ccess CControontroll Owner and many Owner and many

read-only usersread-only users User management UIUser management UI Handy for adminsHandy for admins

and colleaguesand colleagues

New: New: DocumentationDocumentationBrochure, article and movieBrochure, article and movie

New: New: Official Gridcom Web SiteOfficial Gridcom Web Sitehttp://sig.balticgrid.org/gridcom


Danila: Rewrite this page pls, to make it more descriptive. E.g. „User management UI” –

creation? Enhancement? Design?

Danila: Rewrite this page pls, to make it more descriptive. E.g. „User management UI” –

creation? Enhancement? Design?



The secondThe second prototype details described in raport:prototype details described in raport: DJRA1.4 - DJRA1.4 - ““SecondSecond prototype prototype […]” […]” ((PM18PM18))



MJRA 1.4 - Final version of services (1)MJRA 1.4 - Final version of services (1)

MJRA1.4 Final version of services (PM24MJRA1.4 Final version of services (PM24))

Preparation of final release of componentsPreparation of final release of componentsUser support – publishing of user guides, tutorialsUser support – publishing of user guides, tutorialsSurvey of services for user-level support Survey of services for user-level support ofof Grid data Grid data management management

Migrating DesktopMigrating Desktop Evaluation of Evaluation of Migrating Desktop FrameworkMigrating Desktop Framework Optimization of developed mechanismsOptimization of developed mechanisms User support – publishing of user guides, tutorialsUser support – publishing of user guides, tutorials

GridcomGridcom DocumentationDocumentation


MJRA 1.5 - Final version of services (2)MJRA 1.5 - Final version of services (2)

MJRA1.4 Final version of services (PM24MJRA1.4 Final version of services (PM24))Assessment of performance and flexibility of Assessment of performance and flexibility of visualization visualization

toolstools Open-source package Open-source package ParaViewParaView:: Analysis of special purpose OpenGL shaders, Analysis of special purpose OpenGL shaders, PerformaPerformannce tests (Done)ce tests (Done) Applications (Planned 3, Done Applications (Planned 3, Done 33))

Grid Visualization e-Service Grid Visualization e-Service VizLitGVizLitG:: PerformaPerformannce tests (Done)ce tests (Done) Applications (Planned 3, Done 3)Applications (Planned 3, Done 3)

Visualization toool Visualization toool VisPartDEMVisPartDEM:: Light version of tool and GUI,Light version of tool and GUI, PerformaPerformannce tests,ce tests, Applications (Planned 3, Done Applications (Planned 3, Done 22).).

Arnas: UpdateArnas: Update


Summary of work done - usageSummary of work done - usage

All JRA tools are designed to be generalAll JRA tools are designed to be generalMost components could be used with no integrationMost components could be used with no integrationExamples of current and planned usage:Examples of current and planned usage: ParaView :

– Hopper discharge problem (Particle Technology, Engineering Modelling Tasks) /Integrated/,– Dam break problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Integrated/,– Oil filter problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Planned/.

VizLitG:– Tri-axial compaction problem (Particle Technology, Engineering Modelling Tasks) /Integrated/,– Dam break problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Integrated/,– Convective transport problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Planned/,

VisPartDEM:– Tri-axial compaction problem (Particle Technology, Engineering Modelling Tasks) /Integrated/,– Hopper discharge problem (Particle Technology, Engineering Modelling Tasks) / Integrated /,– Crack propagation problem (Particle Technology, Engineering Modelling Tasks) /Planned/.

Gridcom– MDS (Multidimensional scaling with city-block distances) HIROMB (operational hydrodynamic model for

Lithuanian Baltic Sea coastal area) SHYFEM/AQUABC (Hydrodinamic-ecological model parameter sensitivity analysis)… /Integrated/

– GAUSSIAN NWCHEM SBIO NEURO PAR VIBRO /Planned/ Migrating Desktop

– GAMESS, SYNTSPEC (stellar spectra modelling), SemTi-Kamols (natural language processing), CoPS (Complex Comparision of Protein Structures), ANSYS /Integrated/

– GAUSSIAN, deMon, PADEEA /Planned/

Arnas, Danila – update your partsArnas, Danila – update your parts


Presentations & Publications (1)Presentations & Publications (1)

EGEE’0EGEE’088 conference conference (Istanbul, Turkey) (Istanbul, Turkey) LiveLive demo demo "Using the BalticGrid-II infrastructure: "Using the BalticGrid-II infrastructure:

SemtiKamols - a linguistic analyser of Latvian language„SemtiKamols - a linguistic analyser of Latvian language„

EGEEEGEE UF UF’09 conference’09 conference (Catania, (Catania, ItalyItaly)) Demo Demo “CoPS - The Complex Comparison of Protein “CoPS - The Complex Comparison of Protein

Structures supported by grid”Structures supported by grid” Talk ‘The Migrating Desktop as a framework for grid Talk ‘The Migrating Desktop as a framework for grid

applications”applications”

NDTCS-2009 (Vilnius, Lithuania):NDTCS-2009 (Vilnius, Lithuania): Presentation “Grid visualization e-service VizLitG”Presentation “Grid visualization e-service VizLitG”

1st International Conference on Parallel, Distributed 1st International Conference on Parallel, Distributed and Grid Computing for Engineering, and Grid Computing for Engineering, ((Pécs, HungaryPécs, Hungary)) Presentation “Computation and Visualization of Poly-Presentation “Computation and Visualization of Poly-

Dispersed Particle Systems on gLite Grid”Dispersed Particle Systems on gLite Grid”



XVIIth seminar of Lithuanian Association of XVIIth seminar of Lithuanian Association of Computational Mechanics,Computational Mechanics, (Lithuania) (Lithuania) Invited presentation “Invited presentation “Scientific computations, Scientific computations,

graphical environments and visualization in grid graphical environments and visualization in grid environment“environment“

BalticGrid-II Summer SchoolBalticGrid-II Summer School (Moletai, Lithuania) (Moletai, Lithuania) Lecture Lecture ““Enhanced Application Services on Enhanced Application Services on

Sustainable eInfrastructureSustainable eInfrastructure““

EU DORII Summer SchoolEU DORII Summer School (Linz, Austria) (Linz, Austria) TTutorial utorial “Migrating Desktop - intuitive graphical “Migrating Desktop - intuitive graphical

interface to Grid resources”interface to Grid resources”

EGEE’09 conferenceEGEE’09 conference (Barcelona, Spain) (Barcelona, Spain) Live demo - Live demo - "Migrating Desktop - Intuitive Interface "Migrating Desktop - Intuitive Interface

to Grid Resources"to Grid Resources" Live demo "Visualization e-services and tools for grid Live demo "Visualization e-services and tools for grid

build by gLite"build by gLite"



Publications:Publications: R. Kačianauskas, A. Maknickas, A. Kačeniauskas, D. Markauskas, R. Balevičius. R. Kačianauskas, A. Maknickas, A. Kačeniauskas, D. Markauskas, R. Balevičius.

Parallel discrete element simulation of poly-dispersed granular material.Parallel discrete element simulation of poly-dispersed granular material. Advances in Engineering Software, 41(1), 2010, 52–63Advances in Engineering Software, 41(1), 2010, 52–63 . .

A. KaA. Kaččeniauskas, R. Kaeniauskas, R. Kaččianauskas, A. Maknickas and D. Markauskas. ianauskas, A. Maknickas and D. Markauskas. Computation and Visualization of Poly-Dispersed Particle Systems on gLite GridComputation and Visualization of Poly-Dispersed Particle Systems on gLite Grid Civil-Comp Proceedings, vol. 90, ISSN 1759-3433, Proc. of 1st International Conference on Parallel, Distributed and Grid Civil-Comp Proceedings, vol. 90, ISSN 1759-3433, Proc. of 1st International Conference on Parallel, Distributed and Grid Computing for Engineering (Eds. B.H.V. Topping and P. Iványi), ISBN 978-1-905088-28-7, Civil-Comp Press, Computing for Engineering (Eds. B.H.V. Topping and P. Iványi), ISBN 978-1-905088-28-7, Civil-Comp Press, Stirlingshire, United Kingdom, 2009, p. 1-18. [ISI Proceedings]Stirlingshire, United Kingdom, 2009, p. 1-18. [ISI Proceedings]

A Kačeniauskas, R. Pacevič, T. Katkevičius, A. Bugajev.A Kačeniauskas, R. Pacevič, T. Katkevičius, A. Bugajev. Grid visualization e-service VizLitG.Grid visualization e-service VizLitG. CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer Simulations (Eds. Simulations (Eds. A. Melker, V. Nelayev, J. TamulieneA. Melker, V. Nelayev, J. Tamuliene), Vilnius, Vol. 13, 2009, 92-98.), Vilnius, Vol. 13, 2009, 92-98.

A Kačeniauskas, R. Pacevič, T. Katkevičius.A Kačeniauskas, R. Pacevič, T. Katkevičius. Dam break flow simulation on gridDam break flow simulation on grid. CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer Simulations (Eds. Simulations (Eds. A. Melker, V. Nelayev, J. TamulieneA. Melker, V. Nelayev, J. Tamuliene), Vilnius, Vol. 13, 2009, 85-91.), Vilnius, Vol. 13, 2009, 85-91.

A. Kačeniauskas.A. Kačeniauskas. Mass conservation issues of moving interface flows modelled by the interface capturing Mass conservation issues of moving interface flows modelled by the interface capturing approach.approach. Mechanika, ISSN 1392-1207, 2008, 69(1), p. 35-41. Mechanika, ISSN 1392-1207, 2008, 69(1), p. 35-41.



Disseminative materialsDisseminative materials:: JRA technical brochureJRA technical brochure::

Enhanced Application Services Enhanced Application Services oon Sustainable e-Infrastructuren Sustainable e-Infrastructure

Technical brochureTechnical brochure::

““Grid visualization tool VisPartDEM”Grid visualization tool VisPartDEM”

Technical brochureTechnical brochure:: ““Grid visualization e-service VizLitG” Grid visualization e-service VizLitG”

The posterThe poster::

““Grid Visualization e-Service VizLitG”Grid Visualization e-Service VizLitG” Technical brochureTechnical brochure::

““ParaView on BalticGridParaView on BalticGrid-II-II””

The posterThe poster:: ““ParaView on BalticGrid-II”ParaView on BalticGrid-II”

Arnas: Paste here one/two brochures, pls

Danila: Any diss materials?

Arnas: Paste here one/two brochures, pls

Danila: Any diss materials?

The BalticGrid-II Final Review, Brussels, 26thMay, 2010

Beyond the BalticGrid-IIBeyond the BalticGrid-II

User support for JRA productsUser support for JRA products

Further development:Further development:– Migrating Desktop – PL-Grid (NGI), Euforia (EU)Migrating Desktop – PL-Grid (NGI), Euforia (EU)– Gridcom - (Gridcom - (– visualization tools – LitGrid (NGI), …(?)visualization tools – LitGrid (NGI), …(?)

Add plans of development/support of Gridcom, viz tools, pls

Add plans of development/support of Gridcom, viz tools, pls


ConclusionsConclusions

The works are The works are proceeding smoothlyproceeding smoothly as planned as planned GGood cooperationood cooperation withwithinin activity activity All All planned activityplanned activity objectives fullfilled objectives fullfilled The all The all milestones achieved on timemilestones achieved on time The The deliverables deliverables completed on timecompleted on time

Prototypes deliveredPrototypes delivered Services prepared and deployedServices prepared and deployed Prototype evaluated by SA3Prototype evaluated by SA3

Effective cooperationEffective cooperation with other project activities with other project activities NA2 – support for educational and disseminative activitiesNA2 – support for educational and disseminative activities NA3, SA3 – support for the usersNA3, SA3 – support for the users

No technical problemsNo technical problems that affect that affecteded objectives objectives

PlansPlans


Thank you for your attention!Thank you for your attention!

Date post:	12-Jan-2016
Category:	Documents
Upload:	lulu
View:	15 times
Download:	0 times

Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure

Documents