20
A PPARC funded project AstroGrid approach to the Virtual Observatory Architecture ADASS XIV Pasadena Oct-2004 Tony Linde Andrew Lawrence Keith Noddle
| Date post: | 30-Dec-2015 |
| Category: |
Documents |
| Upload: | willa-banks |
| View: | 218 times |
| Download: | 2 times |
A PPARC funded project
AstroGrid approach to theVirtual Observatory Architecture
ADASS XIVPasadenaOct-2004
Tony LindeAndrew
LawrenceKeith Noddle
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 2
GoalDevelop software infrastructure to enable Virtual ObservatoryDeploy that infrastructure in the UK
Virtual Observatory“The VO vision can be summed up as the desire to make all archives speak the same language − all searchable and analysable by the same tools, all data sources accessible through a common interface, all data held in distributed databases that appear as one.”Andy Lawrence, 09/2003
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 3
Overview of AstroGrid/-2Duration: Sept 2001 – Dec 2007Funding: £7.7M (PPARC)Personnel: ~26 (23.4 FTE)Goal: Develop VObs Infrastructure
Deploy UK VObsScope: Astrophysics, Solar, STP, …
Optical, X-Ray, Radio, …AG1 Phase A: Sept 2001 – Dec 2002
Analysis, R&D, ArchitectureAG1 Phase B: Jan 2003 – Dec 2004
Build, test & deliverAstroGrid-2: Jan 2005 – Dec 2007Structure tbd
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 4
AstroGrid consortiumEdinburghLeicesterCambridgeMSSLJBORALQUB
From 2005, AstroGrid-2 + Bristol Exeter Leeds Portsmouth
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 5
Lead PersonnelProject Lead Andy Lawrence (Edinburgh)
Project Scientist Nic Walton (Cambridge)
Project Manager Tony Linde (Leicester)
Technical Lead Keith Noddle (Leicester)
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 6
Links to other ventures
EU FP5: AVO, FP6: Euro-VO (UK rep) Stop Press: €3.3M for VOTech
US-NVO Interoperable registries (done) Interoperable applications (goal – Jan’05)
IVOA Standards workgroups
GGF, Globus, OGSA-DAIOther e-Science projects in UK GridPP, EGSO, myGrid, …
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 7
Links (URLs)Virtual observatory ventures: AVO/Euro-VO: http://euro-vo.org/ VOTech: http://eurovotech.org US-VO: http://www.us-vo.org/ IVOA: http://ivoa.net/
Mailing lists, Wiki EGSO: http://www.egso.org/
e-Science/Grid ventures NeSC: http://www.nesc.ac.uk/ GGF: http://www.gridforum.org/ Globus: http://globus.org/
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 8
Project ApproachAgile: iterative & incremental development
Open project: Wiki
http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome Forum http://forum.astrogrid.org/index.php
News http://news.astrogrid.org/index.php
Jabber via jabber.astrogrid.org
Open Source code Academic Free License
http://www.opensource.org/licenses/academic.php AstroGrid releases
http://www.astrogrid.org/maven/build/index.html
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 9
Development ApproachIterative full cycle each iteration 3 month(-ish) iterations
Incremental add functionality each iteration refactor wherever necessary
Use-case driven from ‘key 10’ science cases http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems
Architecture led http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 10
AstroGrid-2Aspects Extension
Infrastructure Grid (GT4+) integration Intelligent resource discovery (semantic grid) Full security: AA(A)
Shibboleth integration?
Additional components Data exploration & Visualization Client-based access: VO Workbench
Technical Scope http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 11
AstroGrid-2 Layer Diagram
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 12
More info: Newshttp://news.astrogrid.org/
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 13
More info: Forumhttp://forum.astrogrid.org/
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 14
More info: Wikihttp://wiki.astrogrid.org/
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 15
AstroGrid Posters at ADASSPortal and WorkflowAstroGrid and the Registry: Enabling Resource DiscoveryAccess Control in AstroGrid softwareThe AstroGrid Common Execution Architecture The Publisher's AstroGrid Library
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 16
Portal and WorkflowSupports workflow paradigm (from the simple to the complex)Queries and workflows are designed using the portalWork is run remotely and asynchronously Archives searched and results manipulatedResults are stored in a virtual file system Queries and workflows can be re-used and shared
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 17
Enabling Resource DiscoveryTypes of Registries:– Full, Publish, SpecialRegistry is the main focal point for all Astrogrid componentsAgreed Standards with IVOA
Search and harvest interface OAI standard for harvest interface
Adheres to the Astrogrid CEA standardTypes of resource
Generic services, web services, applications, … Data collections AstroGrid-specific resources (e.g. MySpace servers)
Use of XQuery language with eXist XML database.Harvesting
US NVO VizieR
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 18
Access ControlAstroGrid has taken the lead in AAA because our system is based on writable storageImplement single-sign-on (SSO) authentication
Using a community service (so, account can be used with a number of portals or other UIs)
Programme-to-programme authentication based on message security with SOAP headers and WS-SecurityFacade API to hide details from implementations
Underneath, use JAX-RPC/Axis handlers to secure messages.
Little authorization support in 2004, more in 2005 groups, quotas, community authorization, file sharing
Currently specific to AstroGrid Working with IVOA to design and adopt
a common standard
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 19
Common Execution ArchitectureUniform interface for running applications in VObsSet of WSDL and schema
Define the interactions in language independent way
Adapters (ExecutionControllers) implemented Using Java Web services To run legacy command-line applications To run legacy HTTP GET/POST apps within the framework
ExecutionControllers Allow asynchronous operation of the applications Callback and polling mechanisms for delivery of results
Tightly integrated with JES (Job Execution System) Allows programmable workflows
26-Oct-2004 AstroGrid approach to Virtual Observatory architecture 20
Publisher's AstroGrid LibraryTask: What's involved in publishing data to the VO?Library of components
Make a data owners life a (relatively) straight-forward transition to a data owner/publisher
Variety of ‘plugins’ Cope with different collections of data (modes of
storage) To make life easier for installers and test how they might be presented to the VO
Ready-made web UI Suitable for astronomers to use, Includes useful configuration & monitoring features
VO-compatible interfaces for tools to access the dataFeatures to communicate with other VO services
E.g. Registries
