Presenting Knowledgeon the Semantic Web

Lynda Hardman Semantic Media Interfaces

http://media.cwi.nl

Long-term goal• Develop knowledge-intensive models and document

processing technologies that are able to:

generate coherent multimedia presentations tailored to an individual user

taking into account their preferences, abilities, device capabilities and environment.

Goals of research

•Understand how to – incorporate design and discourse

knowledge into multimedia presentations

– represent this knowledge in Web and Semantic Web technologies

•Semantic Web provides– source content for inclusion in presentations

– a means of expressing knowledge needed

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Space/time trade-offs

Space/time trade-offs

• Media repository from Rijksmuseum• Quantitative constraints insufficient

using pixel-based positioning• Qualitative constraints also used

specification of constraints at higher level A not-overlap B, B after C

• If insoluble then backtrack to other solutions using Prolog

• Joost GeurtsMMM 2001, WWW 2001

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Inferring document structure

•First name•Surname•Other name•Synonym•Year of birth•Year of death

Artist

•Title•Short title•Material•Style period•Creation year•Picture

Artefact

ArtTheme

part of

•ID•Type•Keyword text

Keyword

•ID•Type•Text

Presentation

•Sequence no.•Title•Description

Presentation part

Place andTime interval

contained in

description

description

creator

includes

includes

points to

subClassOf

Rijksmuseum domain model

Topia project

Inferring document structure•Topia•Rijksmuseum ARIA database -> RDF•Clustering on results of query•Presentation showing “table of

contents” and current focus

• Lloyd RutledgeACM Hypertext 2003

Semantic graph to presentation

Semantic graph to presentation• DISC• Rijksmuseum repository of media items• Semantic graph is not enoughRembrandt married-to Saskia also need discourse structuresfor deriving grouping, ordering and priorities

• Biography template createdpainter is-a profession

• Stefano Bocconi, Joost GeurtsISWC 2003

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Semantic Web browsing

•Noadster•Generalised semantic web browsing•Integrating global and local browsing

• Lloyd Rutledge,WWW 2005

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Noadster

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Eculture

MultimediaN Eculture

•Collection of vocabularies in RDF:– AAT, ULAN, TGN

•Artchive images•Interface for searching and browsing

http://eculture.multimedian.nl

• Partners:– Guus Schreiber, VU; Bob Wielinga & Jan Wielemaker, UvA

Eculture advanced search

Eculture search result

Eculture single artefact

Scientific challenges

• Making (multimedia) discourse and design knowledge explicit

• Expressing re-usable semantics of media assets

• Designing architectures for multimedia presentation generation

Conclusions & Future Work• From projects described we have learned much:

– distinguish stages in process– make discourse knowledge explicit– mappings between domain and discourse knowledge

• Explicit user model being worked on:– CHIP user interaction, partner Rijksmuseum

Passepartout media installation, partner V2_

• Investigating use of timeline:– to display artefacts to a user, MultimediaN Eculture

• Semantic Web Best Practices and Deployment Group, Multimedia Task Force– http://www.w3.org/2001/sw/BestPractices/MM/

• SWUIG Semantic Web User Interface Group

• NWO I2RPIntelligent Information Retrieval and Presentation

• NWO NASHNetworked Adaptive Structured Hypermedia

• Telematica Instituut Topia

• ICES KIS MultimediaN Eculture

• Images courtesy of Rijksmuseum, Amsterdam

• Acknowledgements:

– Jacco van Ossenbruggen, Frank Nack,Stefano Bocconi, Joost Geurts, Lloyd Rutledge,Alia Amin, Michiel Hildebrand, Zhisheng Huang

This research is supported by