Final Showcase PrestoPRIMEFP7-ICT-2007-3 231161

Crowdsourcing video annotationMichiel Hildebrand, VU University Amsterdam

and Lora Aroyo, Riste Gligorov, Jacco van Ossenbruggen, Guus Schreiber

and Maarten Brinkerink, Lotte Baltussen, Johan Oomen, Erwin Verbruggen

FP7-ICT-2007-3 231161 PrestoPRIME 2Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Enrichment

Video Quality assessment

Fingerprint content tracking

Rights Ontology and RightsDraw

Crowdsourcing video annotation; Waisda

Planning/Checking-in/Ingest

Preservation Planning Metadata Mapping and

Validating Storage and Master

Levels

Access

Multivalent

framework

Access for

Master level

materials

Monitoring and Running Preservation

Managing Archive Services

Policy based Long- term Data Management

PRODUCER

CONSUMER

Knowledge and Services: PrestoCentre

Integration Platforms: Rosetta – P4

FP7-ICT-2007-3 231161 PrestoPRIME 3Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Motivation

Goal 1: Collect time-based video annotations

Goal 2: Improve access to video fragments

Goal 3: Connect with the public

FP7-ICT-2007-3 231161 PrestoPRIME 4Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

FP7-ICT-2007-3 231161 PrestoPRIME 5Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results

2010 EuroITV Winner Grand Challenge

2010 ArchivesNext Best Archives on the Web Award

2009 TIMAF European Best Practices Award

2012 Nominated for Dutch Game Award

FP7-ICT-2007-3 231161 PrestoPRIME 6Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 1 : annotationNumber of tags collected in 4 months by semi-professionals from NCRV and Waisda users

FP7-ICT-2007-3 231161 PrestoPRIME 7Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 1 : annotationPercentage of tags found in GTAA (Professional), WordNet (Dutch Dictionary), Google

FP7-ICT-2007-3 231161 PrestoPRIME 8Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 1 : annotationPanofsky-Shatford matrix for 1,313 Waisda tags from 1st Waisda pilot

Abstract General Specific Total

Who 10 166 177 31%

What 73 563 12 57%

Where 0 68 8 7%

When 4 31 6 5%

Total 7% 74% 9%

FP7-ICT-2007-3 231161 PrestoPRIME 9Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 2 : search

FP7-ICT-2007-3 231161 PrestoPRIME 10Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 2 : searchMean Average Precision of fragment retrieval using 50 queries and 198 videos

FP7-ICT-2007-3 231161 PrestoPRIME 11Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results Goal 3: user engagmentNumber of users 2nd pilot Waisda

735registered

1000sanonymous

FP7-ICT-2007-3 231161 PrestoPRIME 12Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Results goal 3: user engagmentUser visits for Waisda 1st pilot

FP7-ICT-2007-3 231161 PrestoPRIME 13Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Lessons learned

Use short video fragments Expect tags:

in a user vocabulary mainly general descriptions of What and Who

Time-based annotations enable: within-video search high recall fragment retrieval

Large number of contributors provide additional motivation (short term goal)

FP7-ICT-2007-3 231161 PrestoPRIME 14Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Outcomes

http://github.com/beeldengeluid/waisda

Waisda white label available under GPL open source license

FP7-ICT-2007-3 231161 PrestoPRIME 15Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Outcomes : student projectsDetecting emotions in Waisda tags (Master project Wouter Meys)

FP7-ICT-2007-3 231161 PrestoPRIME 16Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Outcomes : student projectsShort term goals within Waisda through missions (master project Olga Beza)

FP7-ICT-2007-3 231161 PrestoPRIME 17Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Outcomes : student projectsWaisda for fictional movies (PhD research Liliana Melgar)

FP7-ICT-2007-3 231161 PrestoPRIME 18Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Outcomes : new collections

Film institute Netherlands

Dutch broadcaster

Europeana V2

FP7-ICT-2007-3 231161 PrestoPRIME 19Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Install your own Waisda?

1. git clone https://github.com/beeldengeluid/waisda.git

2. setup MySQL database

3. add videos identifier title duration URL video source URL key frame

4. style user interface Logo color scheme static pages

5. deploy in Jetty or Tomcat

FP7-ICT-2007-3 231161 PrestoPRIME 20Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Integration : Waisda API

videos• submit• update

tags• export• sync

FP7-ICT-2007-3 231161 PrestoPRIME 21Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Integration : Tag Gardening

videos

tags

annotations

FP7-ICT-2007-3 231161 PrestoPRIME 22Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

Integration : Tag Gardening

FP7-ICT-2007-3 231161 PrestoPRIME 23Michiel Hildebrand (VUA)

FINALSHOWCASE

21.- 22.11.2012VIENNA

challenges

Maintain Waisda? white label

Improve quality of tags Waisda: collect specific types of tags Processing: filter tags to improve precision