476
views
0
recommends
+1 Recommend
1 collections
    0
    shares
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      Heterogeneity in the Usability Evaluation Process

      proceedings-article

      People and Computers XXII Culture, Creativity, Interaction (HCI)

      Computers XXII Culture, Creativity, Interaction

      1 - 5 September 2008

      Usability Evaluation, Five Users Debate, Evaluation, Stochastic Models, Overdispersion, Process Prediction

      Bookmark

            Abstract

            Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

            Content

            Author and article information

            Contributors
            Conference
            September 2008
            September 2008
            : 89-98
            Affiliations
            [0001]University of Passau

            Information Systems II

            Innstr. 43

            94032 Passau, Germany
            Article
            10.14236/ewic/HCI2008.9
            91112f22-8339-4114-b61f-5fa4cdd7ecbc
            © Martin Schmettow. Published by BCS Learning and Development Ltd. People and Computers XXII Culture, Creativity, Interaction

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            People and Computers XXII Culture, Creativity, Interaction
            HCI
            22
            Conference Liverpool John Moores University, UK.
            1 - 5 September 2008
            Electronic Workshops in Computing (eWiC)
            Computers XXII Culture, Creativity, Interaction
            Product
            Product Information: 1477-9358BCS Learning & Development
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Electronic Workshops in Computing

            Comments

            Comment on this article