2,314
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65

      scite_
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      Heterogeneity in the Usability Evaluation Process

      proceedings-article
      People and Computers XXII Culture, Creativity, Interaction (HCI)
      Computers XXII Culture, Creativity, Interaction
      1 - 5 September 2008
      Usability Evaluation, Five Users Debate, Evaluation, Stochastic Models, Overdispersion, Process Prediction
      Bookmark

            Abstract

            Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

            Content

            Author and article information

            Contributors
            Conference
            September 2008
            September 2008
            : 89-98
            Affiliations
            [0001]University of Passau

            Information Systems II

            Innstr. 43

            94032 Passau, Germany
            Article
            10.14236/ewic/HCI2008.9
            91112f22-8339-4114-b61f-5fa4cdd7ecbc
            © Martin Schmettow. Published by BCS Learning and Development Ltd. People and Computers XXII Culture, Creativity, Interaction

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            People and Computers XXII Culture, Creativity, Interaction
            HCI
            22
            Conference Liverpool John Moores University, UK.
            1 - 5 September 2008
            Electronic Workshops in Computing (eWiC)
            Computers XXII Culture, Creativity, Interaction
            History
            Product

            1477-9358 BCS Learning & Development

            Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2008.9
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Electronic Workshops in Computing

            Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction
            Usability Evaluation,Five Users Debate,Evaluation,Stochastic Models,Overdispersion,Process Prediction

            Comments

            Comment on this article