Process and outcome: On the evaluation of IR systems in the age of interaction, GUIs and multimedia

Abstract

The question I want to address in this talk has to do with the relation between traditional ideas of retrieval system evaluation and the present concern with highly interactive systems, maybe involving other media as well as or instead of text. For reasons that I hope to make clear, my major concern is with interaction rather than with the media themselves. Particularly, I want to consider the questions: Why has the notion of relevance been such a powerful device in the traditional model of evaluation? And: Why is it not so useful in the evaluation of interactive systems?

Contributors

Stephen Robertson

Conference

Publication date: April 1999

Publication date (Print): April 1999

Pages: 1-4

Affiliations

Microsoft Research Ltd

St George House, 1 Guildhall Street, Cambridge CB2 3NH, U.K.

Also City University London

Article

DOI: 10.14236/ewic/MIRA1999.7

Copyright statement: © Stephen Robertson. Published by BCS Learning and Development Ltd. MIRA '99

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: MIRA '99

Conference acronym: MIRA

Conference number:

Conference location: Glasgow, Scotland

Conference date: 14th - 16th April 1999

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: MIRA '99

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/MIRA1999.7

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing