Linked Data + Drupal for Oceanographic data management

Post on 25-Jun-2015

258 views 0 download

Tags:

description

For ocean science researchers, the success of data discovery revolves around the capability to ask complex questions of data centers like BCO-DMO. Our ability to accurately respond depends on our system's capability to understand the question, interpret its relevancy to what we know, and return those results in a way a human can digest. As the needs for responding to the grand challenges of science become more interdisciplinary, data discovery will become more dependent on information from a variety of sources to enable researchers to reliably access the data they need. To do this effectively, all data and their metadata require context, cooperation and semantic interoperability. This talk explores the current landscape of data discovery, the questions researchers ask of our software, how bad our software is at responding, and how Linked Data is a viable solution for improving those responses. Watch this presentation at: https://www.youtube.com/watch?v=wEllMpcNQFg https://austin2014.drupal.org/session/linked-data-drupal-oceanographic-data-management http://www.bco-dmo.org http://lod.bco-dmo.org/sparql

transcript

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

ADAM SHEPHERD & STÉPHANE CORLOSQUET

CASE STUDIES

WEDNESDAY 2:15PM JUNE 4TH

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

ADAM SHEPHERD & STÉPHANE CORLOSQUET

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

➢ WELCOME TO THE JUNGLE (WE’VE GOT FUN N’ GAMES)

➢ HOW & WHY LINKED DATA HELPS

➢ USING LINKED DATA IN DRUPAL

http://4.bp.blogspot.com/-gQWSBV6EnBo/TiRcN9unwbI/AAAAAAAAPXs/tydq754TRoI/s1600/vgdvd3.jpg

It’s 1984 ...

http://i.telegraph.co.uk/multimedia/archive/01594/corey-haim_1594267c.jpg

Friday night

http://img2.timeinc.net/people/i/2006/celebdatabase/patrickdempsey/patrick_dempsey5_180_240.jpghttp://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg

MISSION: PIZZA

“What’s their address?”

“1428 Elm St.”

“Be there in 30 mins or less...or it’s free.”

http://media-cache-ak0.pinimg.com/736x/07/57/b1/0757b14109002ff196eefbbe8e39bb6c.jpg

http://swhomevid.site40.net/vhs_anh1.jpg

MISSION: MOVIE

“GET THE ONE WITH…”

➢ Righteous girl + bodacious dude

➢ Light beams flying everywhere

➢ The one with the “Force”

The search begins...

https://deadlymovies.files.wordpress.com/2012/01/photo-2.jpg

http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg

MOVIE: FOUND!

✓ Righteous girl + bodacious dude

✓ light beams flying everywhere

✓ The one with the “Force”

BACK AT THE HOUSE…

http://static.guim.co.uk/sys-images/Film/Pix/pictures/2010/2/24/1267010697702/Winona-Ryder-Kim-Walker-L-001.jpg

A Tale of Two Elm Streets

Which ‘Elm St’ was that?

http://i.huffpost.com/gen/1594554/thumbs/o-PIZZA-facebook.jpghttp://themaindamie.files.wordpress.com/2013/10/a-nightmare-on-elm-street-2010-horror-movies-11384409-720-297.jpghttp://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg

ELM ST. near Austin, TX

http://brooklynsteez.com/products/square/81690.pnghttp://tinyurl.com/mtmlbpx

#1

#2

http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg

At least, you haveMEGAFORCE

✓ Righteous girl + bodacious dude

✓ light beams flying everywhere

✓ The one with the “Force”

http://images.sodahead.com/slideshows/000000228/betamax-11979413784_xlarge.jpeghttp://upload.wikimedia.org/wikipedia/commons/thumb/3/3c/Betavhs2.jpg/220px-Betavhs2.jpg

Betamax vs. VHS

WHAT HAPPENED, DUDE?

PIZZA bad or no results = ambiguous query

MEGA FORCE got results, not what was expected

BETAMAX results weren’t useful

WHAT HAPPENED, DUDE?

It’s A Hard Knock Life

http://2.bp.blogspot.com/_9ROOpn4epE0/SwHye-JfXYI/AAAAAAAADQo/mjKOBuVL3EU/s1600/02.jpg

Livin’ on a Prayer➢ “Grand Challenges” require data

➢ Right data has been hard to find

http://4.bp.blogspot.com/-ymbRRrq5G-4/Uy99LJEuPTI/AAAAAAAAIzA/GbuMaLcLd1c/s1600/the-life-aquatic-with-steve-zissou-1024x435.png

Zooplankton abundance

http://fallmeeting.agu.org/2012/eposters/eposter/in43b-1506/

PEOPLE & ORGANIZATIONS

http://www.thelifeaquatic.org/images/walking.jpg

CRUISES & LOCATIONS

http://www.whoi.edu/main/ships/knorrhttp://www.whoi.edu/cruiseplanning/files/1355434346284_5722_Cruise_track_121312.jpg

R/V KNORR

INSTRUMENTS & MEASUREMENTS

http://globec.whoi.edu/globec-dir/reports/al9906/Image29.gif http://www.whoi.edu/cms/images/instruments/2004/8/vpr_advanced_1383.gif

FUNDING

http://thewartburgwatch.com/wp/wp-content/uploads/2012/05/fan-of-dollars1.jpg

BCO-DMO on Drupal

http://www.bco-dmo.org

AHA #1: Data needs CONTEXT

http://www.oocities.org/sunsetstrip/4426/visual/faces.gif

What is it:

2 faces

- or -

1 candlestick

CONTEXTinfluences the understanding of a subject

by adding surrounding information.

CONTEXTinfluences the understanding of a subject

by adding surrounding information.

CONTEXT: Related Links

http://www.whoi.edu/oceanus/feature/deep-western-boundary-current

http://www.whoi.edu/oceanus/feature/deep-western-boundary-current

CONTEXT: Related Links

http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpghttp://compartmaps.com/images/415_World_Oceanflat.jpg

Geospatial CONTEXT

http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpghttp://compartmaps.com/images/415_World_Oceanflat.jpg

Geospatial CONTEXT

VISUALIZING the CONTENT

VISUALIZING the CONTENT

VISUALIZING the CONTENT,

“STILL HAVEN’T FOUND WHAT I’M LOOKING FOR…”

http://4.bp.blogspot.com/-mTbIH1IeLpw/Uxvh-es_ifI/AAAAAAAAFEg/BtRDO0w9U6w/s1600/I-wonder-if-it-remembers-me.-life-aquatic-with-steve-zissou-2004.gif

Addressing the “Grand Challenges” requires interoperable systems

to aid in the discovery &

exchange of information.

AHA #2: Cooperative Data

Somewhere out there… where dreams come true.

Express Yourself

What does it mean to be “friends”?

What does “connected” mean?

➢ Family are “friends”➢ Co-workers are “friends”➢ High-school acquaintances are “friends”

Example: Walking on the Moon

http://astrobob.areavoices.com/files/2011/08/Moon-May-3-AS-Del1-1024x776.jpg

Copernicus plotted

http://stko.geog.ucsb.edu/location_linked_data

Is that the moon?

“One small step for man...” in South Sudan

APOLLO 11

http://dbpedia.oobian.com/#/OobianMaps/VPIN/dbp%253aCopernicus_(lunar_crater)

http://www.leftcoastgrassfed.com/

Example: Grass-fed beef supplier

SEARCH: “COASTAL BEEF”

http://www.leftcoastgrassfed.com/

IS “COASTAL BEEF” DEADLY?

http://tinyurl.com/laawqgvhttp://i343.photobucket.com/albums/o465/MattLeader/Biggie-ReadyToDie-CD.jpg

AHA #3: Reliable data exchange needs semantic interoperability

AHA #3: Reliable data exchange needs semantic interoperability

➢ Sender knows Ready To Die is a “MusicalWork”

AHA #3: Reliable data exchange needs semantic interoperability

➢ Sender knows Ready To Die is a “MusicalWork”

➢ Receiver should interpret Ready To Die as a “MusicalWork”

Semantic interoperability

means shared UNDERSTANDING

throughout content exchange.

If your content is worthy of a website,then it deserves to be understood.

http://drupal.org/files/druplicon.small_.pnghttp://www.mouthymag.com/wp-content/uploads/2013/11/tumblr_inline_mjwd8k0Zjs1qz4rgp.jpghttp://deployment.googleapps.com/_/rsrc/1326052805286/Home/user-resources/google-icons-and-logos/google_logo_3D_online_medium.png http://www.wildsoundmovies.com/images/terminator_logo.jpg

HUMANS MEDIATORS MACHINES

SCREENCAST

LINKED DATA in ACTION

https://www.youtube.com/watch?v=_bn4muKqXv0

MapServer

OpenSearch

Linked Data

Drupal

What’s the Stack, Yo?

http://mapserver.org/http://www.opensearch.org/http://www.w3.org/standards/semanticweb/datahttps://drupal.org/

LINKED DATA

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png

What’s the big deal?

➢ Some facets are built from 3rd party

❏ Instruments by Type❏ Parameters by Type

Linked Data: The Deal

➢ repository of oceanographic terms

➢ vetted by oceanographers(pan-European project)

➢ exposed as Linked Data by BODC

SeaDataNet @ BODC

http://vocab.nerc.ac.uk/http://www.seadatanet.org/extension/seadatanet2/design/skin-seadatanet2/images/Logo_SeaDataNet_fond_transparent.png

One consumer was across the ‘pond’ - 3,000 miles away

It was assumed that SeaDataNet terms would be useful to others

1. Context through RDF vocabularies

2. Cooperation via common framework (RDF)

3. Cooperation without coordination

4. Semantic Interoperability through HTTP URIs for naming things

LINKED DATA

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png

LINKED DATA + DRUPAL

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.pnghttp://fc03.deviantart.net/fs71/i/2011/179/c/d/vector_tree_by_axelintu-d3kedq3.pnghttp://drupal.org/files/druplicon.small_.png

RDF (core)➢ Entities have globally unique URIs

➢ Content Types = RDF Vocabulary Classes

➢ Fields = RDF Vocabulary Class Properties

http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpg

CONTEXT

RDFx (contrib)➢ Serializes content in RDF data model

(“structured data”)

○ 1 model = many formats■ HTML■ JSON■ XML■ TEXT

○ RestWSsupport

http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpghttp://www.contestheat.com/wp-content/uploads/2013/03/lays-flavor-walgreens-giveaway.png

COOPERATION

RDF UI (rdfx)

https://drupal.org/files/issues/835350-8-rdf-ui-form-fields.jpg

TimBL: Linked Data is a Bag of Chips

https://www.youtube.com/watch?v=ga1aSJXCFe0

Vocabularies @ BCO-DMO

Ocean Data Ontology cruises, ships, instrumentation, measurements, funding

Dublin Core generic metadata

DCAT dataset catalog

FOAF people & organizations

VoID linking data

GeoSPARQL geospatial features

PROV-O provenance (revisions & activity)

For info on creating your own vocabulary, try this presentation: http://www.slideshare.net/OpenDataSupport/model-your-data-metadata

Enable rdf and rdfx modules for immediate semantic interoperability

POWER-UP #1

http://images.clipartlogo.com/files/images/32/325521/mushroom-vector-power_f.pnghttp://37.media.tumblr.com/08e90c026242fbee0c7704b078219359/tumblr_mu1gb4NKee1sw8d3mo6_400.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.png

QUERYING LINKED DATA

http://www.cedar-project.nl/wp-content/uploads/alibobo_w3cSPARQL-logo.png

OpenSearch

Linked Data

rdf_indexer (contrib)➢ Index data in triple store

➢ Uses Search API

➢ SPARQL endpoint

rdf_indexer (contrib)➢ Uses Search API

rdf_indexer (contrib)➢ SPARQL endpoint

rdf_indexer (contrib)

➢ Extensible for support of external RDF stores

○ BCO-DMO uses Virtuoso RDF store

○ submitted Virtuoso extension as a patch (https://drupal.org/node/2029717)

■ BCO-DMO SPARQL endpoint:

http://lod.bco-dmo.org/sparql

Enable rdf_indexer to make your data queryable.

POWER-UP #2

http://img2.wikia.nocookie.net/__cb20131129222600/mario/images/5/5d/Fireflower3dworld.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.pnghttp://img3.wikia.nocookie.net/__cb20120718023604/fantendo/images/thumb/c/c7/NSMB2_Fire_Mario.png/1024px-NSMB2_Fire_Mario.png

LINKED DATA: External Links

LINKED DATA: External Links

LINKED DATA: External Links

LINKED DATA: External Links

Generate value by creating links from your data to others.

POWER-UP #3

http://newsupermariobros2.nintendo.com/mobile/_ui/img/power-ups/carousel/super-star.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.pnghttp://www.mariowiki.com/images/thumb/8/85/Nsmb2_starman_mario.png/220px-Nsmb2_starman_mario.png

http://dbpedia.org

https://www.freebase.com

http://www.wikidata.org

DATA is out there...

http://datavisualization.ch/wp-content/uploads/2011/01/lod-wikipedia.png

New York Times: Innovation Report

“...there are substantial costs to waiting.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

New York Times: Innovation Report

RECIPES aren’t properly tagged

by ingredients and cooking time

“We can do it now,

but only after spending a huge sum

to retroactively structure the data.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

New York Times: Innovation Report

“The lack of structured data helps explain why we are...“

1. unable to automate the sale of our photos

2. continually struggle to attain higher rankings on search engines.

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

New York Times: Innovation Report

“We need to reclaim our industry-leading position,

but right now our needs are far more basic.

We must expand the structured data we create.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

“I like a good story, well told.” -Mark Twain

CONTEXT with CONTENT

REFERENCES

Linked Data by David Wood (Manning)

Learning SPARQL by Bob DuCharme (O’Reilly)

Definitive Guide to Drupal 7 Chapter 28 by Stéphane Corlosquet (Apress)

http://www.manning.com/dwood/http://www.learningsparql.com/http://definitivedrupal.org/

BoF: LINKED DATA & RDF IN DRUPAL

Time: Thursday · 11:45-01:00

Room: 10B - Blink Reaction | 3rd floor

QUESTIONS? Twitter: @ashep_15drupal.org: ashepherd

Twitter: @scorlosquetdrupal.org: scor

WHAT DID YOU THINK?

EVALUATE THIS SESSION: AUSTIN2014.DRUPAL.ORG/SCHEDULE

Thank you!

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT