The MPEG-7 Video Signature Tools for Content Recognition

Introduction

What is MPEG-7? • "Multimedia Content Description Interface“• ISO/IEC standard by MPEG (Moving Picture Experts Group)• Providing meta-data for multimedia• MPEG-1, -2, -4: make content available;

MPEG-7: makes content accessible, retrievable, filterable, manageable (via device / computer).• Multi-degrees of interpretation of information’s meaning• Support as broad a range of applications as possible.• A compatible (with existing tech) and extensible standard.

Why The MPEG-7 Video Signature Tools ?

• Handling billions of videos.• Efficiently search for a copy of a specific

piece of video content.• Duplicate video clip detection in large

databases.• Finding out edited or modified version

and embedded in a longer piece of video content.

Application’s domains (incomplete)

• Broadcast media selection (e.g., radio channel, TV channel).• Digital libraries (e.g., film, video, audio and radio archives).• E-Commerce (e.g., personalized advertising).• Education (e.g., repositories of multimedia courses, multimedia

search for support material).• Home Entertainment (e.g., management of personal multimedia

collections, including manipulation of content, e.g. karaoke).• Journalism (e.g. searching speeches of a certain politician using his

name, his voice or his face).• Multimedia directory services (e.g. yellow pages, G.I.S).• Surveillance and remote sensing.• Database management and deduplication

Requirements of the proposed technology

1) Uniqueness2) Robustness to editing operations

3) Independence

4) Fast matching

5) Fast extraction

6) Compactness

7) Non alteration of the content

8) Self-containment of the signatures

9) Coding independence

10)Partial matching

11)Accurate temporal localization of duplicated and

12)embedded content

Scope

There are four parts to the standard in video signature:

1) The descriptor extraction and decoding, along with its descriptor definition language

2) A reference software implementation and source code for the video signature tools

3) The conditions and dataset for ensuring conformance to the standard

4) An exemplary pair wise matching and localization scheme, as used during the MPEG-7 evaluation process

Main benefits to the different systems

1) Follows a systematic peer-reviewed evaluation process, leading to the adoption of the best technologies from various proposals

2) the video signature tools enable interoperability, i.e., they allow different users and systems to talk to each other in terms of descriptors.

Video Signature Extraction and Compression

The video signature comprises two parts:

1) Fine signatures

2) Coarse signatures

3) Video Signature Organization

Video Signature Matching and Localization

• The matching between two video signatures v1 and v2 is carried out in three stages

.

1) Coarse Signature Matching

2) Temporal Parameter Estimation

3) Localization and Verification

Hardware Specification

Minimum Required Configuration: • Intel Pentium or equivalent

processor • 128 MB RAM• TEN GB HDD• Keyboard (104 keys/…), Mouse(2/3

buttons)• Svga color/black & white

Conclusion

• Achieves high levels of robustness to common video editing operations

• Accurately detect and localize a piece of video content embedded in a longer piece of unrelated video content

Bibliography1) Stavros Paschalakis, Kota Iwamoto, Paul Brasnett, Nikola Sprljan, Ryoma Oami,

Toshiyuki Nomura, Akio Yamada, Miroslaw Bober, “The MPEG-7 Video Signature Tools for Content Identification”, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 7, JULY 2012.

2) A. Hampapur, K. Hyun, and R. Bolle, “Comparison of sequence matching techniques for video copy detection,” in Proc. Conf. Storage Retrieval Media Databases, 2002, pp. 194–201.

3) J. Law-To, L. Chen, A. Joly, I. Laptev, O. Buisson, V. Gouet-Brunet, N. Boujemaa, and F. Stentiford, “Video copy detection: A comparative study,” in Proc. 6th ACM Int. Conf. Image Video Retrieval, Jul. 2007, pp. 371–378.

4) H. T. Shen, X. Zhou, Z. Huang, J. Shao, and X. Zhou, “UQLIPS: A real-time near-duplicate video clip detection system,” in Proc. 33rd Int. Conf. Very Large Data Bases, Sep. 2007, pp. 1374–1377.

5) S. Paisitktiangkrai, T. Mei, J. Zhang, and X.-S. Hua, “Scalable clip-based near-duplicate video detection with ordinal measure,” in Proc. ACM Int. Conf. Image Video Retrieval, Jul. 2010, pp. 121–128.

…

THANK YOU