33
LAND & WATER Linked Open Data: reflections from experience on the hardest challenges Nicholas Car | Senior Experimental Scientist 22 October 2015 Rodin’s The Thinker
LAND & WATER
Linked Open Data: reflections from experience on the hardest challenges
Nicholas Car | Senior Experimental Scientist
22 October 2015
Rodin’s The Thinker
LAND & WATER
Linked Open Data: reflections from experience on the hardest challenges
Nicholas Car | Senior Experimental Scientist
22 October 2015
The Thinker, in its original context – the gates of Hell!
Agenda
• What is LOD• Generally
• In the Australian data context
• LOD Challenges• What literature says
• What I thought initially
• My perception now
• What we’re doing
• What might happen in 2016
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car3 |
What is LOD – Generally• Open Data
• Linked Open Data
• Open Data that is Linked Data - me
• Linked Data
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car4 |
“The Web enables us to link related documents. Similarly it enables us to link related data. The term Linked Data refers to a set of best practices for publishing and connecting structured data on the Web. Key technologies that support Linked Data are URIs, HTTP, and RDF.”
Bizer, C., Heath, T., & Berners-Lee, T. (2009). Linked Data - The Story So Far. International Journal on Semantic Web and Information Systems (IJSWIS), 5(3), 1-22. doi:10.4018/jswis.2009081901
“Open data is the idea that some data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.”
Auer, S. R.; Bizer, C.; Kobilarov, G.; Lehmann, J.; Cyganiak, R.; Ives, Z. (2007). "DBpedia: A Nucleus for a Web of Open Data". The Semantic Web. Lecture Notes in Computer Science 4825. p. 722. doi:10.1007/978-3-540-76298-0_52
What is LOD – Generally• Linked Data – assessment criteria
★ On the web – on the Web, whatever format, under an open license
★★ Machine-readable – structured data, e.g. Excel instead of image scan of a table
★★★ Non-proprietary formats – e.g., CSV instead of Excel
★★★★ RDF standards – RDF & SPARQL using HTTP URIs
★★★★★ Linked RDF – link your data to other data to provide context
Berners-Lee, T (2006) Linked Data. Web Page. W3C, online at http://www.w3.org/DesignIssues/LinkedData.html. Accessed 2015-10-20
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car5 |
What is LOD – Generally
• Current state
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car6 |
Linking Open Data cloud diagram 2014, by Max Schmachtenberg, Christian Bizer, Anja Jentzsch and Richard Cyganiak. http://lod-cloud.net/
What is LOD – Generally
• Current state – data by theme
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car7 |
Anja Jentzsch, Richard Cyganiak & Christian Bizer (2011) Linked Data by domain. Web page section. http://lod-cloud.net/. Accessed 2015-10-20.
Triples by domain Links by domain
What is LOD – Generally
• Current state
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car8 |
Anja Jentzsch, Richard Cyganiak & Christian Bizer (2011) Used terms from widely deployed vocabularies. Web page section. http://lod-cloud.net/. Accessed 2015-10-20.
Most widely used vocabs
What is LOD – in the Australian data context
• Examples• Catalog metadata
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car9 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car10 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car11 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car12 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car13 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car14 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car15 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car16 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car17 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
• Bioregional Assessments
– People: http://data.bioregionalassessments.gov.au/id/person/car587
– Datasets: https://data.bioregionalassessments.gov.au/dataset/0115c2ba-73c6-4c98-b539-9f67594980cf
– Licences: http://data.bioregionalassessments.gov.au/id/licence/559d18ab898c0a477b44f7cc
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car18 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
• Bioregional Assessments
– People: http://data.bioregionalassessments.gov.au/id/person/car587
– Datasets: https://data.bioregionalassessments.gov.au/dataset/0115c2ba-73c6-4c98-b539-9f67594980cf
– Licences: http://data.bioregionalassessments.gov.au/id/licence/559d18ab898c0a477b44f7cc
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car19 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
• Bioregional Assessments
– People: http://data.bioregionalassessments.gov.au/id/person/car587
– Datasets: https://data.bioregionalassessments.gov.au/dataset/0115c2ba-73c6-4c98-b539-9f67594980cf
– Licences: http://data.bioregionalassessments.gov.au/id/licence/559d18ab898c0a477b44f7cc
• PROMS provenance data
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car20 |
What is LOD – in the Australian data context
• Examples• Catalog metadata
– Data.gov.au: “Water Quality Zones”, http://data.gov.au/dataset/water-quality-zones.rdf
• Catalog data
– ?
• Geofabric
– http://environment.data.gov.au/water/id/catchment/104792
• Bioregional Assessments
– People: http://data.bioregionalassessments.gov.au/id/person/car587
– Datasets: https://data.bioregionalassessments.gov.au/dataset/0115c2ba-73c6-4c98-b539-9f67594980cf
– Licences: http://data.bioregionalassessments.gov.au/id/licence/559d18ab898c0a477b44f7cc
• PROMS provenance data
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car21 |
LOD – my experiences
• Projects• Bioregional Assessments, eReefs, L&W Reporting, PROMS, ANZSoilML
• Initiatives• PROMS across agencies
• OzNome
• Working Groups• W3C “Shapes” WG
• Aust. Govt. LD WG
• AU Prov IG
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car22 |
LOD ChallengesWhat literature says
• Persistence of URIs
• ‘solved’ by system-independence and domain ownership
• Conversion of data to RDF
• Efficient graph database engines
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car23 |
LOD ChallengesWhat literature says
• Persistence of URIs
• ‘solved’ by system-independence and domain ownership
• Conversion of data to RDF
• Efficient graph database engines
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car24 |
W. Heath Robinson
LOD ChallengesWhat I though initially
• Scaling
• Turning rasters into triples
• Authoritative
• Where was Units of Measure?
• Complexity
• Modelling
• Tools – use of, lack of
• Latest Fad tag
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car25 |
Rube Goldberg
LOD ChallengesMy perceptions now
• Validation
• Needed for real data
• W3C Shapes approaches• Query-based
• Template-based
• Persistence
– More difficult than TB-L supposed• Jurisdictional issues
• Shared ownership
• Authority
• Semantic-like APIs
• Easy to use but semantically poor WSes get in the way
• Exemplars
– Show me best practice
… now do it with real data
… now authoritative data
• Scaling
– Not a matter of “a billion triple triplestore”
– a billion useful triples that I can actually reasonably use
• Integration
– I want to use LD in Excel
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car26 |
What we are doing
• Validation• W3C Shapes
• RuleSet work – about to be published!
• Persistence• environment.data.gov.au
• PID Service tooling
• Identity backbones at institutions
• Semantic-like APIs• Dialogue
• CSIRO’s IM&T
• Working with Collective Access
• Exemplars• BoM WDTF Named Persons
• Gov Org
• CSIRO People
• Scaling• V-of-v tests
• NCI provenance
• Integration• RVA’s widget
• KWA’s widget
• govCMS integration
• Upskilling developers
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car27 |
What might happen in 2016
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car28 |
…in RDF!My hope for a core task of the Aust. Govt. Linked Data Working Group
What might happen
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car29 |
What might happen
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car30 |
“Not sure if this is going to solve the
problem, but I found a staircase that leads
exactly where you want it to go”
Agenda - review
• What is LOD• Generally
• In the Australian data context
• LOD Challenges• What literature says
• What I thought initially
• My perception now
• What we’re doing
• What might happen in 2016
Linked Open Data: reflections from experience on the hardest challenges | Nicholas Car31 |
Nicholas CarSenior Experimental Scientistp: 07 3833 6500e: [email protected]: http://people.csiro.au/Nicholas-Car
LAND & WATER
Thank you
Presentation title | Presenter name33 |
All the world is a stage graph and men and women (nodes, subclasses of foaf:Person) are merely
Players (an org:Role subclass) - a Semantic web reading of “As you like it”
