Controlling the Usability Evaluation Process under Varying Defect Visibility

Abstract

In cases where usability is a mission critical system quality it is becoming essential to know whether an evaluation study has identified the majority of existing defects. Previous work has shown that procedures for estimating the progress of evaluation studies have to account for variation in defect visibility; otherwise, harmful bias will happen. Here, a statistical model is introduced for estimating the number of not-yet-identified defects in a study. This approach also supports exact confidence intervals and can easily be adapted to estimate the required number of sessions. The method is evaluated and shown to, in most cases, provide accurate measures. A running example illustrates how practitioners may track the progress of their studies and make quantitatively informed decisions on when to finish.

Contributors

Martin Schmettow

Conference

Publication date: September 2009

Publication date (Print): September 2009

Pages: 188-197

Affiliations

Passau University, Information Systems II

94032 Passau, Germany

Article

DOI: 10.14236/ewic/HCI2009.22

Copyright statement: © Martin Schmettow. Published by BCS Learning and Development Ltd. People and Computers XXIII Celebrating People and Technology, Churchill College Cambridge, UK

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: People and Computers XXIII Celebrating People and Technology

Conference acronym: HCI

Conference number:

Conference location: Churchill College Cambridge, UK

Conference date: 1 - 5 September 2009

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Computers XXIII Celebrating People and Technology

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2009.22

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing