1WIS

Web  InformationSystems

TUD-­MMC  at  MediaEval 2016Predicting  Media  Interestingness  Task

Cynthia  C.  S.  LiemMultimedia  Computing  GroupDelft  University  of  Technology

2WIS

Web  InformationSystems

Why  I  was  interested  in  this  task• Narrative  arcs  in  stories  [Liem  et  al.,  IJMIR,  2013]

• Arcs  of  intensity  in  concerts  [in  preparation]

3WIS

Web  InformationSystems

Oops.• I  did  not  manage  joining  preparation  L

• The  acquired  labels  did  not  take  temporal  dynamics  into  account  L

• As  a  human,  I  did  not  understand  the  ground  truth  rankings  L

4WIS

Web  InformationSystems

Swapping  ground  truth• Are  criteria  for  the  image  &  video  tasks  consistent?

• Image  task  ≠ video  task

5WIS

Web  InformationSystems

Some  heuristic  considerations• Labels  acquired  through  comparison  of  within-­trailer pairs  à no  between-­trailer data

• VoD scenario:  excerpts  should  be  reasonably  representative

• Multiple  shots  may  belong  to  single  scene  or  setting

• Binary  relevance  added  afterwards:  focus  on  ranking

6WIS

Web  InformationSystems

Two  basic  features• Faces:  if  people  are  clearly  framed,  the  audience  should  probably  emphatize

[Marin-­Jimenez  et  al.,  IJCV,  2014]

7WIS

Web  InformationSystems

Two  basic  features• HSV  histograms:  rough  but  straightforward

8WIS

Web  InformationSystems

Results