LEAD Portal: a TeraGrid LEAD Portal: a TeraGrid Gateway and Application Gateway and Application
Service ArchitectureService ArchitectureMarcus Christie and Suresh Marru
Indiana University
LEAD Project (http://lead.ou.edu)
Linked Environments for Atmospheric Discovery
OverviewOverview
• Introduce LEAD
• Enabling technologies– Capability based authorization framework– Application Service Model– BPEL based workflow system
• Current issues/Future Work
Linked Environments for Atmospheric Discovery
Linked Environments for Atmospheric Discovery
The LEAD GoalThe LEAD GoalProvide the IT necessary to allowProvide the IT necessary to allow
PeoplePeople (scientists, students, (scientists, students, operational practitioners) operational practitioners)
andand
TechnologiesTechnologies (models, sensors, data (models, sensors, data mining)mining)
TO INTERACT WITH WEATHERTO INTERACT WITH WEATHER
Linked Environments for Atmospheric Discovery
LEAD Empowers Users to…LEAD Empowers Users to…• Identify, locate, access, decode, mine, visualize, store and manage
observational data and model output independent of their format or physical location
• Create, monitor, analyze/mine and visualize simple to very sophisticated WRF (Weather Research and Forecasting model) analyses and forecasts including pre-scheduled and on-demand runs
• Change the configuration of an experiment automatically, during execution, based upon specified trigger conditions
• Add their own tools and observational data
By…
• Operating within a web browser portal that is highly intuitive and requires nominal local resources
• Using local and/or remote computing resources including those that are grid enabled
Linked Environments for Atmospheric Discovery
On-DemandGrid Computing
Example: “Optimal” Weather Example: “Optimal” Weather Prediction Using Dynamic AdaptivityPrediction Using Dynamic Adaptivity
StreamingObservations
Storms Forming
Forecast Model
Data Mining
Linked Environments for Atmospheric Discovery
LEAD ArchitectureLEAD Architecture
DistributedResources
ComputationSpecialized
ApplicationsSteerable
Instruments Storage
Data Bases
ResourceAccess Services GRAM
Grid FTP
SSH
Scheduler
LDM
OPenDAP GenericIngest Service
UserInterface
Desktop Applications• IDV• WRF Configuration GUI
LEAD Portal
PortletsVisualization Workflow Education
Monitor
Control
Ontology Query
Browse
Control
CrosscuttingServices
Authorization
Authentication
Monitoring
Notification
Con
figu
rati
on a
nd
E
xecu
tion
Ser
vice
s WorkflowMonitor
MyLEAD
WorkflowEngine/Factories
VO Catalog
THREDDS
Application ResourceBroker (Scheduler)
Host Environment
GPIR
Application Host
Execution Description
WRF, ADaM,IDV, ADAS
Application Description
Application & Configuration Services
Client Interface
Observations• Streams• Static• Archived
Dat
a S
ervi
ces
Wor
kfl
ow S
ervi
ces
Cat
alog
Ser
vice
s
RLSOGSA-
DAI
Geo-Reference GUI
ControlService
QueryService
StreamService
OntologyService
Decoder/ResolverService
Transcoder Service/ ESML
Linked Environments for Atmospheric Discovery
LEAD PortalLEAD Portal
Linked Environments for Atmospheric Discovery
Enabling TechnologiesEnabling Technologies
• Capability based authorization framework
• Application Service Model
• BPEL-like workflow system
Linked Environments for Atmospheric Discovery
CapabilitiesCapabilities
• A capability includes:– Policy Document
• Bindings of the provider’s distinguished name (DN), as well as the users’ DNs.
• Identifier of the Grid resource. – Optional: operations of a Web service instance
• Life time (notbefore, notafter)– The provider’s signature generated with his private key.
• Security Assertion Markup Language (SAML):• Each capability is a set of SAML assertions• AuthorizationDecisionStatement
• However the policy document and protection mechanism can be extensible: XACML, symmetric keys, …
Linked Environments for Atmospheric Discovery
Capabilities: Big PictureCapabilities: Big Picture
Proxy ManagerPortlet
WeatherServicePortlet
User Context
proxycertificate
proxycertificate
Grid Portal
WeatherService
capabilitytoken
User
Capability ManagerPortlet
capabilitytoken
capabilitytoken
capabilitytoken
capabilitytoken
Provider
Linked Environments for Atmospheric Discovery
Enabling TechnologiesEnabling Technologies
• Capability based authorization framework
• Application Service Model
• BPEL-like workflow system
Linked Environments for Atmospheric Discovery
The Portal Factory Service The Portal Factory Service GeneratorGenerator
• Start with– A Deployed Application
• A script to run it.• A list of all needed input files• A list of all generated output files.
• Write a AppService Document – Upload this to the portal Factory
generator in the portal.
• A new Factory is started for you. – A portal client interface to the factory
is also automatically generated. App Factory
Browser
Portal Server
https
Create andLaunch factory
UploadAppService Doc
Linked Environments for Atmospheric Discovery
Application ServicesApplication Services
Linked Environments for Atmospheric Discovery
Enabling TechnologiesEnabling Technologies
• Capability based authorization framework
• Application Service Model
• BPEL workflow system
Linked Environments for Atmospheric Discovery
Composing Workflow In the PortalComposing Workflow In the Portal• An interactive workflow
composer (WebStart)– Component database and
workflow compiler is provided by the grid service
• which also provides the interface tool.
– MVC pattern.– Composer allows
• Component selectionfrom library
• Drop and drag place-ment and connectionestablishment
• Save and load graphfunctions.
Linked Environments for Atmospheric Discovery
Running WorkflowRunning Workflow
• Submit workflow to workflow engine
• Portal supplies workflow engine with user’s capabilities
• Workflow engine invokes services
• Notification messages are logged to the portal
• Workflow output is catalogued
Linked Environments for Atmospheric Discovery
Future WorkFuture Work
• Accounting
• Transparent certificate/capability management for users
• Integrating with the BPEL engine
• Community grid account usage and policy
