Software for Science Gateways: Open Grid Computing

EnvironmentsMarlon Pierce, Suresh Marru

Pervasive Technology InstituteIndiana University

www.collab-ogce.org

http://www.collab-ogce.org/ogce/index.php/Tutorials

Link to demonstration movies.

Software DescriptionOGCE Gadget Container

Google Gadget/Open Social compatible software for building Web-based user interfaces.

XBaya A visual user interface for composing, launching and monitoring workflows

GFAC An application factory service for wrapping command-line tools as Web services

XRegistry; Registry Gadget

A service and workflow registry and its user interface

Experiment Builder User interface for creating online experiments with registered workflows

Compute ResourcesCompute Resources

Resource Middleware

Resource Middleware Cloud Interfaces Grid Middleware SSH & Resource

Managers

Computational Clouds

Computational Grids

Gateway ServicesGateway Services

User Interfaces

User Interfaces

Web/Gadget

Container

Web Enabled Desktop

Applications

User Managemen

t

Auditing & Reporting

Fault Tolerance

Application Abstractions

Workflow System

Information Services

ApplicationMonitoring

Registry Security

Provenance & Metadata Managemen

t

Local Resources

Web/Gadget

Interfaces

Gateway Abstraction Interfaces

Science Gateways Layer Cake

Color Coding

Dependent resource provider components

Complimentary Gateway Components

OGCE Gateway Components

GFac Current & Future Features

Input Handlers

Input Handlers

Scheduling Interface

Scheduling Interface

AuditingAuditing

Monitoring Interface

Monitoring Interface

Data Management Abstraction

Data Management Abstraction

Job ManagementAbstraction

Job ManagementAbstraction

Fault Toleranc

e

Fault Toleranc

e

Output HandlersOutput

Handlers

Registry InterfaceRegistry Interface

Checkpoint Support

Checkpoint Support

GlobusGlobus

Campus ResourcesCampus

Resources

UnicoreUnicore

CondorCondor

Amazon Eucalyptus

Amazon Eucalyptus

Color Coding

Planned/Requested Features

Existing Features

OGCE Layered Workflow Architecture:Derived from LEAD Workflow System

Workflow Execution &

Control Engines

Workflow Execution &

Control Engines

Apache ODE

Workflow Specification

Workflow Specification

Workflow Interfaces (Design

& Definition)

Workflow Interfaces (Design

& Definition)

PythonBPEL 2.0

BPEL 1.0 Java Code Pegasus DAG

Scufl

XBaya GUI (Composition,

Deploying, Steering & Monitoring) Gadget Interface for

Input Binding

Condor DAGMan

Taverna

Dynamic Enactor

Jython InterpreterGBPEL

Flex/Web Composition

Putting It All Together

Software Strategy

• Focus on gadget container and tools for running science applications on grids and clouds.

• Provide a tool set that can be used in whole or in part.– If you just want GFac, then you can use it without

buying an entire framework.

• Outsource security, information services, data and metadata, etc to other providers.– MyProxy, TG IIS, Globus, Condor, XMC Cat, iRods, etc.

More Information• This is downloadable, packaged software.

– Apache Maven build system provides everything you need to to build the gadget container, gadgets, workflow composer, and backing services.

– Get code by anonymous SVN checkout.• Email: mpierce@cs.indiana.edu,

smarru@cs.indiana.edu, ogce-discuss@googlegroups.com

• OGCE Web Site: www.collab-ogce.org• Blog/News Feed: http://collab-

ogce.blogspot.com/

Acknowledgements and People

• Funding by TeraGrid GIG, RP and by OCI SDCI• IU: Marlon Pierce, Suresh Marru, Raminder

Singh, Archit Kulshrestha• TACC: Maytal Dahan, Rion Dooley• SDSC: Nancy Wilkins-Diehr• SDSU: Mary Thomas

Demos Next

The OGCE Application Registry gadget allows users to interactively register hosts and applications that are

dynamically wrapped as Web services.

The OGCE Gadget Container allows you to build portals out of public and private Google Open Social gadgets. Supports HTTPS.

Downloadable, packaged software.

The OGCE Experiment Builder gadget allows users to create projects and experiments out of previously

composed workflows.

The XBaya workflow composer allows you to build scientific workflows from services running across the TeraGrid. This is part of our workflow suite.

OGCE Tools for Science Workflows

What Is a Science Gateway?• Web and desktop user interfaces and user-centric Web

services for accessing Grid and Cloud resources.– Clusters, supercomputers, mass storage– Applications, databases– Workflows

• Example Science Gateways from the NSF TeraGrid– GridChem: computational chemistry– UltraScan: biophysics computational analysis – LEAD: Atmospheric science– BioDrugScreen: drug docking, scoring, and discovery.

• Many others: see https://www.teragrid.org/web/science-gateways/gateway_list

• This demo is about software that powers gateways.

Google Gadget-Based Science Gateways

LEAD

PolarGrid