MetricSPlat - A platform for quick development, testing and visualization of content-based retrieval techniques

Jose Fernando Rodrigues Junior – junio@ufscar.br

Zaina, L. A. M. – lzaina@ufscar.br Romani, L. A. S. – luciana@cnptia.embrapa.br

Ciferri, R. R. - ricardo@dc.ufscar.br

Universidade Federal de São Carlos – Campus SorocabaBrasil

Fortaleza - October/2009

http://www.icmc.usp.br/~junio/PublishedPapers/RodriguesSBBD09-MetricSPlat.pdf

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Challenge:Challenge:

to ease the to ease the prototyping prototyping

and tuning of and tuning of CBIRCBIR

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Metric spaces

Metric spaces: solution for non-orderable domains Images Videos Text Sound

It the case of imagesMetric spaces Content-based Image Retrieval (CBIR)

It demands three things: Features extraction A metric data structure (ideally) A distance function

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Features Extraction

Metric spaces

Metric Structure Distance Function

Features Extraction

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Features Extraction

Metric spaces

Metric Structure Distance Function

Features Extraction

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Metric spaces

Putting together the three components of a metric space is a cumbersome task

The integration of these factors is systematic

However, it has been done ad hoc

Time is lost in re-sculpting the wheel

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Contribution:Contribution:

a platform for a platform for

quick development quick development

and and

experimentation of experimentation of

CBIRCBIR

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

What does MetricSPlat do?

It eases the process of raising CBIR metric spaces: It is modular (dlls) It uses a well-defined interface (arboretum) It provides a prototyping subproject for quick

development of new functionalitiesBesides, MetriSPlat is aided with

visualization techniques to:Monitor the datasetMonitor the result of similarity queries

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Metric StructuresMetric Structures

and and

Distance Distance FunctionsFunctions

in MetricSPlatin MetricSPlat

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Metrics Structures andDistance Functions

New distance functions and metric structures can be accomplished with a prototyping subproject

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Metrics Structures andDistance Functions

New distance functions and metric structures can be accomplished with a prototyping subproject

L2=Euclidiana

r

L0=LInfinity=Chebychev

L1=Manhatan

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Features vectors as parallel coordinates

Demo

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

FeaturesFeatures

ExtractionExtraction

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Features extraction

Currently: no support for features extraction

But there is support for extracted features!

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Features extraction

Support for extracted featuresA simple way of loading data

Embedded database driver: OpenOffice, MSAccess

File: Features.mdb, placed at the application’s directory

Required fields:NAtributos: the number of attributes to considerCOD: uniquely identifies the records

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Visualization SupportVisualization Support

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

To doTo do

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

To do

Modularize features extraction

Modularize media reproduction

Aid support for relevance feedback

Aid support for CBIR evaluation: Automatic Precision Recall Ranking function

- XXIV Simpósio Brasileiro de Banco de Dados 2009 -

Thank youThank youhttp://www.icmc.usp.br/~junio

Link “MetricSPlat”

junio@ufscar.br