Heterogeneity in the Usability Evaluation Process

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

Content

Author and article information

Contributors

Martin Schmettow

Conference

Publication date: September 2008

Publication date (Print): September 2008

Pages: 89-98

Affiliations

[0001]University of Passau

Information Systems II

Innstr. 43

94032 Passau, Germany

Article

DOI: 10.14236/ewic/HCI2008.9

SO-VID: 91112f22-8339-4114-b61f-5fa4cdd7ecbc

Copyright statement: © Martin Schmettow. Published by BCS Learning and Development Ltd. People and Computers XXII Culture, Creativity, Interaction

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: People and Computers XXII Culture, Creativity, Interaction

Conference acronym: HCI

Conference number: 22

Conference location: Conference Liverpool John Moores University, UK.

Conference date: 1 - 5 September 2008

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Computers XXII Culture, Creativity, Interaction

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2008.9

Self URI (journal page): https://ewic.bcs.org/

Heterogeneity in the Usability Evaluation Process

Abstract