A Model-based Heuristic Evaluation Method of Exploratory Search

A shortcoming of current evaluation methods of exploratory search engines is that they cannot be used to determine whether users' behaviours and exploratory search tasks are usefully supported. One main reason is that these methods rely on a loosely defined model of the exploratory search process. The aim of this paper is to propose a new model-based heuristic evaluation method of these systems. We present the approach used to design the heuristics of exploratory search and a checklist form for using them. The evaluation of the heuristics and its procedure demonstrates that they significantly help the users achieve an exploratory search system assessment.

Content

Author and article information

Contributors

Emilie Palagi

Fabien Gandon

Alain Giboin

Raphaël Troncy

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

[0001]Inria, Université Côté d’Azur

Sophia Antipolis, France

[0002]EURECOM

Sophia Antipolis, France

Article

DOI: 10.14236/ewic/HCI2018.108

SO-VID: 27e00875-ce3e-4c88-868e-0d44081393e4

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.108

Self URI (journal page): https://ewic.bcs.org/

References

J. M. C. Bastien, & D. L. Scapin (1993). Ergonomic criteria for the evaluation of human-computer interfaces (No. RT-0156) (p. 79). Inria. Retrieved from http://hal.inria.fr/inria-00070012
A. Bozzon M. Brambilla S. Ceri, & D. Mazza (2013). Exploratory search framework for Web data sources The VLDB Journal 22(5), 641–663.
J. Nielsen (1994). Usability inspection methods In Conference companion on Human factors in computing systems (pp. 413–414). ACM.
E. Palagi F. Gandon A. Giboin, & R. Troncy (2017). A Survey of Definitions and Models of Exploratory Search In Proceedings of the 2017 ACM Workshop on Exploratory Search and Interactive Data Analytics (pp. 3–8). ACM.
R. W. White, & R. A. Roth (2009). Exploratory Search: Beyond the Query-Response Paradigm Synthesis Lectures on Information Concepts, Retrieval, and Services 1(1), 1–98.
M. L. Wilson, schraefel, m. ., & R. White (2009). Evaluating advanced search interfaces using established information-seeking models Journal of the American Society for Information Science and Technology 60(7), 1407–1422.

Comments

Comment on this article

[1] J. M. C. Bastien, & D. L. Scapin (1993). Ergonomic criteria for the evaluation of human-computer interfaces (No. RT-0156) (p. 79). Inria. Retrieved from http://hal.inria.fr/inria-00070012

[2] A. Bozzon M. Brambilla S. Ceri, & D. Mazza (2013). Exploratory search framework for Web data sources The VLDB Journal 22(5), 641–663.

[3] J. Nielsen (1994). Usability inspection methods In Conference companion on Human factors in computing systems (pp. 413–414). ACM.

[4] E. Palagi F. Gandon A. Giboin, & R. Troncy (2017). A Survey of Definitions and Models of Exploratory Search In Proceedings of the 2017 ACM Workshop on Exploratory Search and Interactive Data Analytics (pp. 3–8). ACM.

[5] R. W. White, & R. A. Roth (2009). Exploratory Search: Beyond the Query-Response Paradigm Synthesis Lectures on Information Concepts, Retrieval, and Services 1(1), 1–98.

[6] M. L. Wilson, schraefel, m. ., & R. White (2009). Evaluating advanced search interfaces using established information-seeking models Journal of the American Society for Information Science and Technology 60(7), 1407–1422.

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65