Date post: | 27-Mar-2015 |
Category: |
Documents |
Upload: | jesus-daly |
View: | 216 times |
Download: | 0 times |
© 2007Open Grid Forum
OGF22, 25th February 2008
OGSA Data Architecture
Mario Antonioletti
© 2007 Open Grid Forum 2
OGF IPR Policies Apply
• “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.”• Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the
OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to:
• the OGF plenary session, • any OGF working group or portion thereof, • the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, • the ADCOM, or any member thereof on behalf of the ADCOM, • any OGF mailing list, including any group list, or any other list functioning under OGF auspices, • the OGF Editor or the document authoring and review process
• Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions.
• Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.”
• OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.
© 2007 Open Grid Forum 3
Contents
• Background• Brief Overview• Current Status• Issues, Future Work, Impacts• Where to Next?
© 2007 Open Grid Forum
Background
• Group established in September 2005• Aim:
• Substantiate how data is handled in OGSA
• Means:• Informational document
• Achieved:• Published OGSA-Data Architecture• GFD.121, 7th December 2007• http://www.ogf.org/documents/GFD.121.pdf
4
© 2007 Open Grid Forum 5
Overview: OGSA Data Scope
• Places a stake in the ground• Covers:
• Files and databases (& storage)
• No stream management, session management, …
• Identify services and interfaces:• Storage, Access, Transfer
• Replication, Caching, Federation, Metadata catalogues
• Cross-cutting themes:• Security, Policies, …
• Part of/Consistent with the bigger OGSA picture:• E.g. Naming, Workflow, Transactions, Scheduling, Provisioning, …
© 2007 Open Grid Forum 6
Overview: Architecture Document
• Services• Data Transfer• Data Access• Storage Resource
Management• Data Cache• Data Replication• Data Federation• Metadata Catalogues
• Appendices• Specifications
referenced• Mappings to
specifications• DAIS
• ByteIO• SRM
• DMI
• …
• Glossary
© 2007 Open Grid Forum 7
Sink/ Source
Sink/ Source
Overview: Basic Structure
Access Description AccessDescriptionStorage
Managed Storage
Stored Data Resources
Other Data Resources
Serviceinterface
Resourceinterface
Client APIs (non-OGSA) / Other services
Data Service
Data ServiceStorage Managemen
t
© 2007 Open Grid Forum 8
Sink/ Source
Transfer
Overview: Transfer and Replication
Access Sink/ Source
Description AccessDescription
Replication Transfer
Data Resources
Data Resources
Serviceinterface
Resourceinterface
Transfer ProtocolsTransfer Protocols
Client APIs (non-OGSA) / Other services
Data Service
Data Service
Replication
© 2007 Open Grid Forum 9
Sink/ SourceAccess
Access
Overview: Composite Entities
Sink/ Source
Description Description
Serviceinterface
Resourceinterface
Data Service
Data Service
Access Sink/ Source
Description
Federation
Sink/ Source AccessDescription
Cache
© 2007 Open Grid Forum 10
Status: Two Informational Documents
• OGSA Data Architecture• 79 pages
• Describes services and their interfaces
• OGSA Data Scenarios• 50+ pages
• Explores service compositions to address scenarios (exercise the architecture)
• Stalled (since OGF19)• Some scenarios still need work• Integration with execution management services
© 2007 Open Grid Forum
Status: Where are we?
• Group has completed its charter• Would be nice to complete Scenarios doc• Identified gaps that need resolving:
• Memo to data area chairs • Top of the doc root of OGSA-D-WG in Grid Forge
• https://forge.gridforum.org/sf/go/doc15052?nav=1
11
© 2007 Open Grid Forum
Issues: Architectural Gaps
• Standardized tokens with fixed semantics• Identify query languages, data formats,
transport protocols, …• Needed in DAIS, DMI, ByteIO, …
• Data catalogs & Registries• Discovery an important part of Grids
• Replication/Cache Services/Federation• Need to be standardized
12
© 2007 Open Grid Forum
Future: for the next spec version?
• Sessions• Understanding how these impact the data
architecture
• Streams• Architecture only deals with stored data• What needs to change to encompass streams?
• Notification• Need to be incorporated into the architecture
13
© 2007 Open Grid Forum
Future: More …
• Provisioning• Architecture deals with existing data• How are new data sources added/removed?
• Workflow• What is the impact of these on the data architecture?
14
© 2007 Open Grid Forum
Architectural Impacts
• Adoption of Uniform Naming Scheme• OGSA Naming doing this
• WS-Naming and Resource Namespace Service (RNS)
• OGF GFS• Defined RNS for human readable and hierarchical
names• Need to take this into account in the Architecture
• Not universally adopted• WS-DAI & SRM do not use the scheme
• Need to find out if there are issues
15
© 2007 Open Grid Forum
Architectural Impacts: More …
• OGF Info-D• Information dissemination and eventing• Not taken into account in the current architecture document
• OGF DFDL• Describe data formats• Impact on the Data Architecture
• Storage Network Industry Association (SNIA)• Standards in the area of networked storage• Generally low level but moving to higher levels• Need to collaborate for consistency
16
© 2007 Open Grid Forum
Even More … !!• Policies and Agreements
• Necessary for :• Specifying policies• Negotiating agreements
• Evolve Architecture when these are better defined
• Security• !!!
• Privacy• Increasingly becoming a requirement for data
• Grid Interoperation Now! (GIN)• Need feedback about the Architecture• Evolve accordingly
17
© 2007 Open Grid Forum
Where to next: How?
• Step 1: need new chairs.• Current chairs resigned (too busy):
• Dave Berry, NeSC
• Allen Luniewski, IBM
• Step 2: establish a new work plan. • Could:
• Resolve currently identified issues
• Finish the Scenarios document
• Produce a new iteration of the Architecture
• Take the group in new directions
18
© 2007 Open Grid Forum
If not …
• Group:• Closes/Disbands• Hibernates
• Would be nice to carry on the work• NEED NEW BLOOD
• Will require re-chartering• Questions/Discussion …
19
© 2007 Open Grid Forum 20
Full Copyright Notice
Copyright (C) Open Grid Forum 2008. All Rights Reserved.
This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works.
The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees.