Evaluation of a trademark image retrieval system

This paper describes the evaluation of ARTISAN, a system designed to provide automatic retrieval of abstract trademark images by shape feature. The system depends for its operation on analyzing each image to characterize key shape components, grouping image regions into families which potentially mirror human image perception, and then deriving characteristic indexing features from these families. A variety of run-time search options is provided, allowing the user to select alternative sets of shape features and similarity matching paradigms. The system’s retrieval effectiveness has been evaluated by measuring its retrieval effectiveness using a set of 12 real queries with known results put to a collection of over 10 000 abstract geometric shapes from the UK Trade Marks Registry. Normalized recall and precision scores averaged 0.93 and 0.65 respectively. The results suggest strongly that the basic ARTISAN approach is valid, though the present version has significant limitations, particularly when handling badly-scanned images or images with implied shape features. Possible ways of overcoming these limitations are discussed.