The LEAD Portal: An OGCE based weather science gateway

transcript

Marcus Christie and Suresh MarruIndiana University

LEAD Project (www.leadproject.org)

The Weather Challenge (WxChallenge)

WxChallenge - LEAD Portal Beta Testers

… and others

So, what’s the value to the participants?

Outcome

•Total participants: 10•Total workflows: 279•Total data storage: 2.6 TB (including non weather challenge participants)

•Total SUs: 52925 (including non weather challenge participants)

•Workflow success rate: 78%/36%

The Architecture of Gateway ServicesThe Users Desktop.The Users Desktop.

Gateway Services

Grid Portal Server

Physical Resource Layer

Core Grid Services

Proxy CertificateServer / vault

Application EventsApplication EventsResource BrokerResource Broker

User MetadataCatalog

Replica MgmtReplica Mgmt

ApplicationWorkflow

App. Resourcecatalogs

ApplicationDeployment

ExecutionManagement

InformationServices

SelfManagement

DataServices

ResourceManagement

SecurityServicesSecurityServices

OGSA-like Layer

Info/History

•Staffing: 2 FTE + several graduate students•Fall 2004: Started work on the LEAD Portal (uPortal)

•Spring 2005: Selected GridSphere•Spring 2006: Integrated with BPEL workflow engine and updated metadata schema

•Summer 2006: First went “live” supporting Unidata Users’ Workshop

•Spring 2007: WxChallenge and Spring Forecast experiments

TeraGrid Resources

Big Red

Data CapacitorNCSA’s Tungsten andMercury

SPRUCE at UC

Security: Registering for an account

Security:Verifying Email Address

Security: Email address confirmed

Security: Administrator Approving

Security: User gets acceptance email

Security: User can now log in

Security: Verifying user account

A Tale of Two Authorization Systems

LEADLEAD

Portal

- authenticate with identity certificate-verify authorization

GSIGSI

TeraGrid

- community account- proxy certificate

ApplicationService

App Service

LEAD Architecture + Auditing

LEAD Portal

Notification Broker

GPEL Workflow Engine

App Service

App ServiceAuditingService

GRAM Gatekeeper

1. Portal registers workflow

2. Portal submits workflow

3. WF engine invokesapp services

4. Launch GRAM jobs

5. Audit notifs6. Queries for charge

Challenges, Lessons Learned

•Globus reliability issues– Become best friends with your RPs

•Gateway priorities– Make sure you know for what audience you are

building your gateway

•Security– It’s a lot harder as an afterthought

•Production deployment– You’ll want to be serious about separate

deployments; and it will cost you

Future Work

•Give user’s more control– Allow editing of model configurations– Allow users to burn their own allocations– Allow users to bring in their own software– Running ensembles

•Data-driven workflows•Fault tolerance/monitoring•Repackaging

Wrap Up

•Go to http://portal.leadproject.org to request an account

•For more information about OGCE– Tuesday, 4:30-5:00: Building a Grid Portal for

TeraGrid’s Big Red– Wednesday, 9:30-10:00: Grid Portlets and

Services from the Open Grid Computing Environments (OGCE) Collaboration (Software Provider Forum)

•Questions?

The LEAD Portal: An OGCE based weather science gateway

Technology