Date post: | 19-Nov-2014 |
Category: |
Technology |
Upload: | rogargon |
View: | 1,285 times |
Download: | 1 times |
Linked Data: the Entry Point for Worldwide Media Fragments Re-use and Copyright
Management?
Roberto GarcíaUniversitat de Lleida, Spain
SemTechBizNYC’13 - October 2-3, 2013, New York City
08.04.2023 Slide 2 of 26
MediaMixerCommunity set-up and networking for the reMIXing of online MEDIA fragments
• FP7 Coordination Action– Started November 2012 – Facilitate a Web-wide market for media
fragments re-purposing and re-sellingA history of G8 violence (© Reuters) http://slideshare.net/troncy/a-semantic-multimedia-web-create-annotate-present-and-share-your-media
08.04.2023 Slide 3 of 26
Introduction
• MediaMixer promotes the use of semantic technologies for media mixing
• Apply them in real use cases and demos– Fragmenting media assets– Annotating them using semantic descriptions– Exposing descriptions for fragment level
search– Representing, integrating and reasoning about
rights information
08.04.2023 Slide 4 of 26
Use Case
• User Generated Content
08.04.2023 Slide 5 of 26
Use Case
• UGC from reused media
08.04.2023 Slide 6 of 26
Use Case – ContentID
ContentID ©
©ContentID
match
match
match
08.04.2023 Slide 7 of 26
Use Case
©Block
Choices:
Track
Monetize
“Gangnam Style”, plus +33,000 videos using it, more than $870,000 ad revenue - New York Times, Dec 7th 2012
08.04.2023 Slide 8 of 26
Use Case - Disputes
• What if more than one ownership claim?
• If disputed, no one can monetize
©©
08.04.2023 Slide 9 of 26
Use Case - Claim?
• Are we sure we can claim?• Do we own that particular copy?• In that territory?• Also in relation with streaming and
YouTube?• Does the artist like being on
YouTube?• …
08.04.2023 Slide 10 of 26
Use Case - Claim?
Thousands of pieces of registered content…Thousands of videos on YouTube…
• Decision Support System (DSS)– You can claim on content-id X– You can’t really claim on content-id Y– Trade X for Y with C (who owns Y and
wrongly claims X)
08.04.2023 Slide 11 of 26
Use Case - Claim?
• Rights DSS requirements:– Fine grained– Scalable (largely automatized)– Takes into account:
• Contracts“…all rights on the live version but studio version just in the US.”
• Policies“…artist does not want his music together with violent images”.
• Rights Expression LanguagesDDEX metadata: <UseType>OnDemandStream</UseType>
<TerritoryCode>Worldwide</TerritoryCode>
08.04.2023 Slide 12 of 26
MediaMixer TechnologiesProposed Architecture
08.04.2023 Slide 13 of 26
Media Fragments
13
• Goal: transform whole videos to sets of meaningful, indexable and re-usable video fragments
Person, Snow, Trees, Building, Ski, …
Baseball, Throwing, Sports, Plant, Running, …
Kitchen, Indoor, Cake, …
…
Concept and Event Detection
Semantic Media
Annotation
08.04.2023 Slide 14 of 26
Linked Data
• Globally unambiguous identifiers for any concept needed– Ideally more information
about the concept itself is available via the identifier
– Use of Web URIs → Linked Data concept space
– Would allow for inference of concept type and relationship to other concepts
Semantic Media
Annotation
08.04.2023 Slide 15 of 26
http://rhizomik.net/mediamixer/rightsbuilderui/
Assisted Policy and Agreement Modelling User Interface
Rights Builder User Interface
08.04.2023 Slide 16 of 26
Semantic Data Exploration
http://rhizomik.net/mediamixer/
Rhizomer Media Explorer
08.04.2023 Slide 17 of 26
DDEX Sample-08.04.xml<Deal>
<DealTerms><ValidityPeriod><StartDate>2013-01-01</StartDate></ValidityPeriod><Usage><UseType>OnDemandStream</UseType><DistributionChannelType>Internet</DistributionChannelType></Usage><TerritoryCode>ES</TerritoryCode><TerritoryCode>US</TerritoryCode></DealTerms>
</Deal>
Copyright Ontology Model<http://media.com/agreement#1> owl:Class;
co:start "2013-01-01" ;owl:intersectionOf (ddex:OnDemandStream [ a owl:Restriction ;
owl:onProperty co:medium ;owl:someValuesFrom ddex:Internet ][ a owl:Restriction ;owl:onProperty co:location ;owl:someValuesFrom [ a owl:Class ;owl:oneOf (territory:ES territory:US) ][ a owl:Restriction ;owl:onProperty co:theme ;owl:hasValue<http://my.tv/video.ogv#t=60,100> ]
]) .
DDEX XML to Semantic Web
Technologies
Rights Language Mapping
08.04.2023 Slide 18 of 26
ODRL to Semantic Web
Technologies
@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> . @prefix odrlv: <http://w3.org/ns/odrl/vocab#> . @prefix owl: <http://www.w3.org/2002/07/owl#> .
<http://example.com/policy> a co:Agree ; co:agent <http://example.com/billie>, <http://example.com/sony> ; co:theme [ a owl:Class ; co:end "2012-12-31" ; co:start "0001-01-01" ; owl:intersectionOf (
[ owl:intersectionOf (odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ]
[ a owl:Restriction ;owl:hasValue <http://example.com/billie> ;owl:onProperty co:agent ]
[ a owl:Restriction ;owl:hasValue <http://example.com/music> ;owl:onProperty co:theme ] ) ] .
<http://example.com/sony:10> a schema:Organization.<http://example.com/music> a co:Creation.<http://example.com/billie> a schema:Person.
Copyright Ontology license to text: “Sony and billie Agree that billie play and not mobile ringtone music”.
Rights Language Mapping
08.04.2023 Slide 19 of 26
Creative Commons BY-SA to
Semantic Web Technologies
Rights Language Mapping
08.04.2023 Slide 20 of 26
Copyright Ontology
Lifecycle, Actions, Rights,…
RDF Store & Reasoner
08.04.2023 Slide 21 of 26
• Ontology provides building blocks to model and reason about contracts, policies, rights expression languages…
No, because it is matched to pattern
which prohibits it:“Artists does not want her music with violent images”
Can we claim asset X
Agree
Disagre
e
Copyright Ontology
Reasoning
RDF Store & Reasoner
08.04.2023 Slide 22 of 26
• Following Linked Data principles, starting from just content ID (URI)…
Use Case-focused solution…but Web-wide applicability
Content
URI
URI a ma:Image dct:title “EBU HQ” dct:copyright URI … H
TT
P G
ET
text/n3
HTTP GETimage/jpeg
08.04.2023 Slide 23 of 26
Linked Data for Worldwide Copyright Management?
Content
URI
URI a ebucore:Image dct:title “EBU HQ” dct:copyright URI …
HT
TP
GE
T
Agreement
URI
URI a co:Agreement co:agent URI co:theme … …
HT
TP
GE
T
Person
URI
URI a foaf:Person foaf:name “…” vcard:address … vcard:country URI
HT
TP
GE
T
08.04.2023 Slide 24 of 26
Semantic Technologies for Rights Data Integration & Intelligence
MediaMixer Technologies
(media fragments, semantic data,
annotation, ontologies, reasoning,…)
Policy 1: The licensor disagrees the licensee adaptsmedia fragments containing…
<xml><right> <play/></right><content id=“frg1”/></xml>
Semantic Media
Annotation
Rights Builder User Interface
Rights Language Mapping
08.04.2023 Slide 25 of 26
Interested? Get involved• Join MediaMixer community to know more
(http://community.mediamixer.eu):– discussions, use cases, demonstrators,
tutorials, presentations, software,…
More details:http://community.mediamixer.eu@project_mmixer
Roberto García (@rogargon)Universitat de Lleida, Spain
http://rhizomik.net/~roberto
Thank you for your attention
Annex A
Copyright Reasoning ExplainedMore details: http://rhizomik.net/copyrightonto/
08.04.2023 Slide 28 of 26
Copyright ReasonerReasoning Explained
• Vocabularies and ontologies provide the building blocks:– Classes– Properties– Instances– Restrictions– …
Copyright Ontology Schema.org
Media Ontology
08.04.2023 Slide 29 of 26
Copyright ReasonerReasoning Explained
• These blocks can be combined to model facts like:– A person is the creator of an asset– An asset is part of a compilation– …or an employee wants to reuse a
piece of content.
Copyright Ontology Schema.org Media Ontology
Event 1: A XYZ Media employee
Adapt Video result
Creation…
Uses:
08.04.2023 Slide 30 of 26
Copyright ReasonerReasoning Explained
• Blocks can also model patterns to be matched by facts:– For instance a rights expression
authorising to reuse a mediafragment…
Copyright Ontology Schema.org Media Ontology
<odrl><resource>…</resource> <adapt>…
<content id></odrl>
ODRL file:
08.04.2023 Slide 31 of 26
Copyright ReasonerReasoning Explained
• Blocks can also model patterns to be matched by facts:– …or prohibitions, like a policy
forbidding to reuse violent media for educational content
Copyright Ontology RRM Ontology Media Ontology
Policy 1: Disagree
Adapt Creation
has subject Violence…
Policy:
08.04.2023 Slide 32 of 26
Copyright ReasonerReasoning Explained
• All these models are then placed into a reasoner– A tool based on semantic technologies capable of mixing
them taking into account ontologies (constraints, functions, rules,…)
08.04.2023 Slide 33 of 26
Copyright ReasonerReasoning Explained
• Ontologies teach the reasoner how to: – Detect when some facts match a pattern
08.04.2023 Slide 34 of 26
Copyright ReasonerReasoning Explained
• Ontologies teach the reasoner how to: – Give precedence to patterns so others cannot
match
08.04.2023 Slide 35 of 26
Copyright ReasonerReasoning Explained
• Ontologies teach the reasoner how to: – …and interpret some patterns as allowed and
others as prohibited
Agree
Disagre
e
AllowedProhibited
08.04.2023 Slide 36 of 26
Copyright ReasonerReasoning Explained
• So they can respond to queries based on all this:No, because it is matched
to pattern
which prohibits it.
Can we reuse asset A
Agree
Disagre
e