COPE: Interactive Image Retrieval Using Conversational Recommendation

Abstract

Most multimedia retrieval services e.g. YouTube, Flickr, Google etc. rely on users searching using textual queries or examples. However, this solution is inadequate when there is no text, very little text, the text is in a foreign language or the user cannot form textual a query. In order to overcome these shortcomings we have developed an image retrieval system called COPE (COnversational Picture Exploration) that can use a number of different preference feedback mechanisms, inspired by conversational recommendation paradigms, for image retrieval. In COPE users are presented with a small number of search results and simply have to express whether these results match their information need. We examine the suitability of a number of feedback approaches for semi-automatic and interactive image retrieval. For interactive retrieval we compared our preference based approaches to text based search (where we consider text to be an upper bound), our results indicate that users prefer preference based search to text based search and in some cases our approaches can outperform text based search.

Contributors

Bartoz Balcer

Martin Halvey

Stephen A. Brewster

Joemon M. Jose

Conference

Publication date: September 2012

Publication date (Print): September 2012

Pages: 1-10

Affiliations

University of Glasgow

Glasgow G12 8QQ

Glasgow Caledonian University

Glasgow G4 0BA

Article

DOI: 10.14236/ewic/HCI2012.5

Copyright statement: © Bartoz Balcer et al. Published by BCS Learning and Development Ltd. The 26th BCS Conference on Human Computer Interaction, Birmingham, UK

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: The 26th BCS Conference on Human Computer Interaction

Conference acronym: HCI

Conference number: 26

Conference location: Birmingham, UK

Conference date: 12 - 14 September 2012

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2012.5

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing