BBC Programmes and Music on the Linking Open Data Cloud

transcript

BBC Programmes and Music on the Linking

Open Data Cloud

Nicholas Humfrey and Patrick SinclairSoftware Engineers, BBC Audio and Music Interactive

OverviewBBC Programmes and Music on the Linking Open Data Cloud

backgroundprogrammesmusiclinking open datafuture direction

Background

until recently, the BBC web site was mostly composed of static pages

it was all about the left hand nav

Background

things are changing...it’s all about the resource

Background

Web 2.0 principles are:

“it’s the data, stupid” * (formally “data is the Intel Inside”)

small pieces loosely joined*

persistent IDs

if you can’t point to it it’s not a web 2.0 citizen

“the age of point-at-things” **

*Tim O’Reilly** Tom Coates

Background

One page (URL) for every programmeProgrammes

Resources - Embedded Media PlayerProgrammes

Resources - bbc.co.uk/programmes/:id/creditsProgrammes

Resources - bbc.co.uk/programmes/:id/broadcastsProgrammes

Lots of useful aggregationsProgrammes

Formats - MobileProgrammes

Formats - for computers tooProgrammes

<?xml version="1.0"?><broadcasts> <broadcast is_blanked="0" is_repeat="0"> <duration>7200</duration> <end>2008-12-04T02:00:00Z</end> <programme type="episode"> <display_titles> <subtitle>04/12/2008</subtitle> <title>DJ Edu</title> </display_titles> <media format="audio"> <availability>6 days left to listen</availability> <expires>2008-12-11T02:02:00Z</expires> </media> <pid>b00fscyv</pid> <position/> <programme type="brand"> <ownership> <service key="1xtra" type="radio"> <title>BBC 1Xtra</title> </service> </ownership> <pid>b007215q</pid> <title>DJ Edu</title> </programme> <short_synopsis>DJ Edu with the hottest African sounds out of Africa.</short_synopsis> <title>04/12/2008</title> </programme> <service key="1xtra" type="radio"> <title>BBC 1Xtra</title> </service> <start>2008-12-04T00:00:00Z</start> </broadcast> <broadcast is_blanked="0" is_repeat="0"> <duration>1200</duration> <end>2008-12-04T19:50:00Z</end> <programme type="episode"> <display_titles> <subtitle>The Postmaster, by Alexander Pushkin</subtitle> <title>Twenty Minutes</title> </display_titles> <pid>b00fsxfs</pid> <position/> <programme type="brand"> <ownership> <service key="radio3" type="radio"> <title>BBC Radio 3</title> </service> </ownership> <pid>b006ts4r</pid> <title>Twenty Minutes</title> </programme> <short_synopsis>Pushkin's short story about a postmaster's daughter who elopes with a hussar.</short_synopsis> <title>The Postmaster, by Alexander Pushkin</title> </programme> <service key="radio3" type="radio"> <title>BBC Radio 3</title> </service> <start>2008-12-04T19:30:00Z</start> </broadcast> <broadcast is_blanked="0" is_repeat="0"> <duration>7200</duration> <end>2008-12-04T22:00:00Z</end> <programme type="episode"> <display_titles> <subtitle>04/12/2008</subtitle> <title>Hindi/Urdu Programme</title> </display_titles> <pid>b00fr082</pid> <position/> <programme type="brand"> <ownership> <service key="asiannetwork" type="radio"> <title>BBC Asian Network</title> </service> </ownership> <pid>b0073232</pid> <title>Hindi/Urdu Programme</title> </programme> <short_synopsis>News, current affairs and music in Hindi and Urdu with Sanjay Sharma.</short_synopsis> <title>04/12/2008</title> </programme> <service key="asiannetwork" type="radio"> <title>BBC Asian Network</title> </service> <start>2008-12-04T20:00:00Z</start> </broadcast> <broadcast is_blanked="0" is_repeat="0"> <duration>6300</duration> <end>2008-12-05T01:00:00Z</end> <programme type="episode"> <display_titles> <subtitle>Verity Sharp</subtitle> <title>Late Junction</title> </display_titles> <pid>b00fs4ss</pid> <position/> <programme type="brand"> <ownership> <service key="radio3" type="radio"> <title>BBC Radio 3</title> </service> </ownership> <pid>b006tp52</pid> <title>Late Junction</title> </programme> <short_synopsis>Verity Sharp presents Japanese Geza music and a Theme and Variations by Moondog.</short_synopsis> <title>Verity Sharp</title> </programme> <service key="radio3" type="radio"> <title>BBC Radio 3</title> </service> <start>2008-12-04T23:15:00Z</start> </broadcast> <broadcast is_blanked="0" is_repeat="0"> <duration>7200</duration> <end>2008-12-05T02:00:00Z</end> <programme type="episode"> <display_titles> <subtitle>05/12/2008</subtitle> <title>Benji B</title> </display_titles> <pid>b00fsdn3</pid> <position/> <programme type="brand"> <ownership> <service key="1xtra" type="radio"> <title>BBC 1Xtra</title> </service> </ownership> <pid>b0071st2</pid> <title>Benji B</title> </programme> <short_synopsis>Jazz, funk, hip hop, house and broken beats, with a soulful twist in and out of the mix.</short_synopsis> <title>05/12/2008</title> </programme> <service key="1xtra" type="radio"> <title>BBC 1Xtra</title> </service> <start>2008-12-05T00:00:00Z</start> </broadcast></broadcasts>

But it’s not a portal... it’s a service...Programmes

URL DesignProgrammes

bbc.co.uk/programmes/:idbbc.co.uk/programmes/b00b257s

bbc.co.uk{/:service}/programmes/genres/:genrebbc.co.uk/bbcone/programmes/genres/music

The Programmes OntologyProgrammes

bbc.co.uk/ontologies/programmes

Brands

Series

Episodes

Programme

ServiceContent

The Programmes Ontology - BrandProgrammes

The Programmes Ontology - SeriesProgrammes

The Programmes Ontology - Sub seriesProgrammes

The Programmes Ontology - EpisodeProgrammes

The Programmes OntologyProgrammes

Service

Version

Event Broadcast

Publishing

KT Tunstall sessions

MusicBrainz - music metadata and GUIDsMusic

artist/49018fd2-95ef-4f7e-92bb-813159909314

BBC Music Beta - bbc.co.uk/music/betaMusic

Artists - bbc.co.uk/music/artistsMusic

Artist profile - bbc.co.uk/music/artists/:guidMusic

Artist profile - data from MusicBrainzMusic

Artist profile - biography extract from WikipediaMusic

Artist profile - content from the BBC Music

Artist profile and news storiesMusic

http://www.madonna.com/

Artist profile and news storiesMusic

artist/79239441-bfd5-4981-a70c-55c3f15c1287

http://www.madonna.com/

Artist profile - content from the BBC Music

Reviews - bbc.co.uk/music/reviews/:url_keyMusic

Reviews Gateway - bbc.co.uk/music/reviewsMusic

422,792 artists7,337,549 tracks636,155 releases26,689 labels

Using the web as our CMS

Dynamic clickable tracklists (coming soon?)

there’s no music or video on artist pages!yet?

Issues and challenges

recommendationssimilar artists and albumsprogrammes and artistsuser based recommendations

Issues and challenges

Linking Open Data

Putting our data on the cloud

RDF Resource DesignLinking Open Data

bbc.co.uk/programmes/:iddefault representation, content negotiated (soon...)

bbc.co.uk/programmes/:id.htmlspecifically request html

bbc.co.uk/programmes/:id.rdfrdf resource for the document describing a programme

bbc.co.uk/programmes/:id#programmerdf resource for the programme itself

@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .@prefix foaf: <http://xmlns.com/foaf/0.1/> .@prefix po: <http://purl.org/ontology/po/> .@prefix time: <http://www.w3.org/2006/time#> .@prefix dc: <http://purl.org/dc/elements/1.1/> .@prefix dcterms: <http://purl.org/dc/terms/> .@prefix timeline: <http://purl.org/NET/c4dm/timeline.owl#> .@prefix event: <http://purl.org/NET/c4dm/event.owl#> .

<http://www.bbc.co.uk/programmes/b006wkx3.rdf> dcterms:created "2007-09-22T08:46:39+01:00"^^<http://www.w3.org/2001/XMLSchema#dateTime> ; dcterms:modified "2008-06-19T15:53:32+01:00"^^<http://www.w3.org/2001/XMLSchema#dateTime> ; rdfs:label "Description of the brand Colin Murray" ; foaf:primaryTopic <http://www.bbc.co.uk/programmes/b006wkx3#programme> .

<http://www.bbc.co.uk/programmes/b006wkx3#programme> dc:title "Colin Murray" ; po:episode <http://www.bbc.co.uk/programmes/b007yrkn#programme>, <http://www.bbc.co.uk/programmes/b007yrr7#programme>, <http://www.bbc.co.uk/programmes/b007yrvv#programme>; po:medium_synopsis "Colin Murray takes you through the night with new music and alternative classics" ; po:short_synopsis "New music and alternative classics" ; a po:Brand .

Programmes RDFLinking Open Data

@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .@prefix owl: <http://www.w3.org/2002/07/owl#> .@prefix dc: <http://purl.org/dc/elements/1.1/> .@prefix foaf: <http://xmlns.com/foaf/0.1/> .@prefix rel: <http://www.perceive.net/schemas/relationship/> .@prefix mo: <http://purl.org/ontology/mo/> .@prefix rev: <http://purl.org/stuff/rev#> .

<http://www.bbc.co.uk/music/artists/79239441-bfd5-4981-a70c-55c3f15c1287.rdf> rdfs:label "Description of the artist Madonna" ; foaf:primaryTopic <http://www.bbc.co.uk/music/artists/79239441-bfd5-4981-a70c-55c3f15c1287#artist> .

<http://www.bbc.co.uk/music/artists/79239441-bfd5-4981-a70c-55c3f15c1287#artist> mo:fanpage <http://www.absolutemadonna.com/>, <http://www.allaboutmadonna.com/>, <http://www.mad-eyes.net>, <http://www.madonnalicious.com/> ; mo:homepage <http://www.madonna.com/> ; mo:image <http://www.bbc.co.uk/music/images/artists/7col_in/79239441-bfd5-4981-a70c-55c3f15c1287.jpg> ; mo:imdb <http://www.imdb.com/name/nm0000187/> ; mo:musicbrainz <http://musicbrainz.org/artist/79239441-bfd5-4981-a70c-55c3f15c1287.html> ; mo:myspace <http://www.myspace.com/madonna> ; mo:wikipedia <http://en.wikipedia.org/wiki/Madonna_(singer)> ; rel:spouseOf <http://www.bbc.co.uk/music/artists/96b8233a-c035-4df5-98e4-faa886389783#artist> ; a mo:SoloMusicArtist ; owl:sameAs <http://dbpedia.org/resource/Madonna_(singer)> ; foaf:maker [ dc:title "Hard Candy" ; mo:musicbrainz <http://musicbrainz.org/release/cd2c4216-f748-4199-b675-cf7f977abcd4.html> ; rev:hasReview <http://www.bbc.co.uk/music/reviews/ff4h#review> ; a mo:Record ], [ dc:title "The Confessions Tour" ; mo:musicbrainz <http://musicbrainz.org/release/bd0c4382-fda4-461e-998e-f3702b0e82ca.html> ; rev:hasReview <http://www.bbc.co.uk/music/reviews/wjn8#review> ; a mo:Record ], [ dc:title "Confessions on a Dance Floor" ; mo:musicbrainz <http://musicbrainz.org/release/d7929b28-5812-4b8f-a99f-1800983c71fb.html> ; rev:hasReview <http://www.bbc.co.uk/music/reviews/g64h#review> ; a mo:Record ; owl:sameAs <http://dbpedia.org/resource/Confessions_on_a_Dance_Floor> ] ; foaf:name "Madonna" ; foaf:page <http://www.bbc.co.uk/music/artists/79239441-bfd5-4981-a70c-55c3f15c1287.html> .

Music RDFLinking Open Data

Pinwheel

Models

Controllers

Database

Linking Open Data

Model View Controller Framework

Pinwheel

Models

Controllers

Database

Linking Open Data

databasemysqlrelational datafed from different sources

Pinwheel

Models

Controllers

Database

Linking Open Data

modelsperlbusiness logic

Pinwheel

Models

Controllers

Database

Linking Open Data

controllersfor a given request, responsible for fetching and preparing the data to be displayed

Pinwheel

Models

Controllers

Database

Linking Open Data

viewstemplates for html, mobile xhtml, ical, rss, json, rdf

Linking Open Data

Content negotiation and caching

bbc.co.uk

load balancer

pinwheel pinwheel

cache cache

pinwheel

cache...

we have to consider scale and reliabilitydata replicationbecause we shouldn’t serve sparql off the main database

hard to keep things drydon’t repeat yourself - maintain SPARQL mapping and templates

just crawl rdf?

Linking Open Data

To SPARQL or not to SPARQL?

Artists A-Z - bbc.co.uk/music/artists/a-zMusic

<?xml version="1.0" encoding="utf-8"?><rdf:RDF xmlns:rdf = "http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:rdfs = "http://www.w3.org/2000/01/rdf-schema#" xmlns:owl = "http://www.w3.org/2002/07/owl#"><rdf:Description rdf:about="/music/artists/a-z/by/a.rdf"> <rdfs:seeAlso rdf:resource="/music/artists/73577e86-4da8-4d76-949d-34c757e053be.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/7364dea6-ca9a-48e3-be01-b44ad0d19897.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/dfd8ee47-6169-403a-be9e-31c75293280e.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/21fd8769-5573-4eb0-9528-e8162c24024d.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/d87e52c5-bb8d-4da8-b941-9f4928627dc8.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/87199477-b0df-4ead-84ee-9b54b4abfc3d.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/80c75300-9cf2-4daf-bb23-5fe15964e671.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/4644d754-bdef-4323-9854-9e82acbdaa79.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/370bd5a3-4abf-4356-8576-3a8fc0c11d65.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/4efb6fb6-eb60-4eb5-b01c-2a15cfa38562.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/32c7dc12-c72a-4d75-9880-99cadb57c250.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/ce5da88f-a483-4dfd-b82d-4d94bf594985.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/66c662b6-6e2f-4930-8610-912e24c63ed1.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/49f03c14-8aa9-426c-a7f4-8e36409451a0.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/b42a9ece-2a18-4660-9c26-94dc01127962.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/4105fc3c-3e29-4a93-a0a2-32ab405235e1.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/c80f38a6-9980-485d-997c-5c1a9cbd0d64.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/cc2c9c3c-b7bc-4b8b-84d8-4fbd8779e493.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/3d2b98e5-556f-4451-a3ff-c50ea18d57cb.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/aba64937-3334-4c65-90a1-4e6b9d4d7ada.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/2f0baf2a-bfa7-4116-8c75-8240aed74553.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/a66ebddc-ff04-46b8-820a-15c63e80dba1.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/b202beb7-99bd-47e7-8b72-195c8d72ebdd.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/19672b19-3fdf-473c-b690-c7adf354665c.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/cb67438a-7f50-4f2b-a6f1-2bb2729fd538.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/c8fb45c8-b3da-422d-a6db-73ac2ee56f77.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/315856f7-2f28-4fb7-b2ac-cc019749da1d.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/1138a764-2212-4d0a-b02d-0dc14df91e08.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/0f11d99e-88ba-48d2-b652-4ebe04c52d11.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/0459517d-082f-4983-b7eb-5680d3913cb4.rdf" /> <rdfs:seeAlso rdf:resource="/music/artists/f98711e5-06f7-43ed-8239-da0f61a9c460.rdf" />

rdfs:seeAlso rdf:resource "/music/artists/7d7a5fdd-0d04-4c36-8bee-906feeae239c.rdf" />

The BBC POLYGON of DATA : SEMANTIC WEB

Concept & Information Design : Michael SmethurstGraphic Design : Pete Warren Towards a coherent bbc.co.uk

DBPEDIAEQUIVALENCY

ENGINE

facets subjects

people

places

TOPICS

SKOS,FOAF

OpenID?,FOAF,XFN

FOAF,XFN,SIOC

reviews

fanships

programme_bookings

ratings

consumptions pops_drops comments

taggingsusers

memberships friendships

groups

EVENTS

EventsOntology

artists

tracks

releases release_events

labels

MUSIC Music Brainz

Music Ontology,FOAF,

Review Vocabularyblog_posts

news_items

reviews

review_recommendations

ondemands

versions

episodes

series

brands

formats genres

programmes

contributors

segments

broadcasts

music_segments

services

PROGRAMMES

ProgrammesOntology,

seasons

Tom ScottMichael SmethurstYves RaimondBBC Music Discovery teamhttp://www.bbc.co.uk/music/developers/are

BBC Programmes teamhttp://www.bbc.co.uk/programmes/developers/are

patrick.sinclair@bbc.co.uknicholas.humfrey@bbc.co.uk

BBC Programmes and Music on the Linking Open Data Cloud

Thank you

BBC Programmes and Music on the Linking Open Data Cloud

Technology