A method for comparing content based image retrieval methods

Kobus Barnard, Nikhil V. Shirahatti

Research output: Contribution to journalConference articlepeer-review

7 Scopus citations


We assume that the goal of content based image retrieval is to find images which are both semantically and visually relevant to users based on image descriptors. These descriptors are often provided by an example image - the query by example paradigm. In this work we develop a very simple method for evaluating such systems based on large collections of images with associated text. Examples of such collections include the Corel image collection, annotated museum collections, news photos with captions, and web images with associated text based on heuristic reasoning on the structure of typical web pages (such as used by Google(tm)). The advantage of using such data is that it is plentiful, and the method we propose can be automatically applied to hundreds of thousands of queries. However, it is critical that such a method be verified against human usage, and to do this we evaluate over 6000 query/result pairs. Our results strongly suggest that at least in the case of the Corel image collection, the automated measure is a good proxy for human evaluation. Importantly, our human evaluation data can be reused for the evaluation of any content based image retrieval system and/or the verification of additional proxy measures.

Original languageEnglish (US)
Pages (from-to)1-8
Number of pages8
JournalProceedings of SPIE - The International Society for Optical Engineering
StatePublished - 2003
EventInternet Imaging IV - Santa Clara, CA, United States
Duration: Jan 21 2003Jan 22 2003


  • Benchathlon
  • Benchmarking
  • Content based image retrieval
  • Image semantics
  • Performance

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'A method for comparing content based image retrieval methods'. Together they form a unique fingerprint.

Cite this