Blog
About

130
views
0
recommends
+1 Recommend
1 collections
    4
    shares
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      The Perceived Similarity of Photos - A Test-Collection Based Evaluation Framework for the Content-Based Image Retrieval Algorithms 1

      , ,

      MIRA '99 (MIRA)

      MIRA '99

      14th - 16th April 1999

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Content-based image retrieval (CBIR) algorithms have been seen as a promising access method for digital photo collections, sooner or later replacing the traditional text-based methods. Unfortunately, we have very little evidence of the usefulness of these algorithms in real user needs and contexts. One problem is that appropriately designed test collections are not available even for the basic performance testing of the CBIR algorithms.

          This paper proposes a task-oriented evaluation framework and an efficient procedure for constructing test collections for CBIR algorithms. First, the paper defines a plausible function for these algorithms in general purpose photo retrieval systems. We believe that the CBIR algorithms could be applied effectively in conjunction with text-based photo retrieval. Text-based methods are powerful in retrieving topically related items but do not support browsing. The CBIR algorithms could help in identifying visually similar photos within (often large) result sets of textual queries.

          The proposed evaluation framework is based on the concept of perceived similarity and emphasises the role of expertise and realistic illustration tasks as a premise of similarity assessments. A major innovation of the proposed test collection is that it consists of an array of small test sets each built up of a tiny database, a query photo, and respective similarity assessments. The approach supports testing of prototype CBIR algorithms in short development cycles.

          The empirical part of the paper reports how journalists were judging the similarity of photos while searching in the course of simulated, but realistic illustration tasks. The goal of the study was to exercise the construction process of the test collection. The results show that the task-oriented evaluation framework and the proposed procedures for constructing the test collection can be successfully applied. The lessons learned from the simulated illustration tasks, collection of similarity assessments and construction of the test collection are discussed.

          Related collections

          Most cited references 8

          • Record: found
          • Abstract: not found
          • Article: not found

          Visual information retrieval

            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Analysis of user need in image archives

              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              PROGRESS IN DOCUMENTATION PICTORIAL INFORMATION RETRIEVAL

               P.G.B. ENSER (1995)
                Bookmark

                Author and article information

                Conference
                April 1999
                April 1999
                : 1-13
                Affiliations
                Department of Information Studies, University of Tampere

                Tampere, Finland
                Article
                10.14236/ewic/MIRA1999.8
                © Eero Sormunen et al. Published by BCS Learning and Development Ltd. MIRA '99

                This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

                MIRA '99
                MIRA
                Glasgow, Scotland
                14th - 16th April 1999
                Electronic Workshops in Computing (eWiC)
                MIRA '99
                Product
                Product Information: 1477-9358BCS Learning & Development
                Self URI (journal page): https://ewic.bcs.org/
                Categories
                Electronic Workshops in Computing

                Comments

                Comment on this article