1,062
views
0
recommends
+1 Recommend
1 collections
    0
    shares
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      A Quality Checklist for Technology-Centred Testing Studies

      proceedings-article
      , ,
      13th International Conference on Evaluation and Assessment in Software Engineering (EASE) (EASE)
      Evaluation and Assessment in Software Engineering (EASE)
      20 - 21 April 2009
      systematic literature review, primary study quality, quality checklists, technology-centred studies, testing
      Bookmark

            Abstract

            Background: One aspect of undertaking a systematic literature review is to perform a quality evaluation of primary studies. Most quality checklists adopted from medicine, psychology and social studies assume that the experimental unit in an experiment is a human being. However, in empirical studies in software engineering the experimental unit may be a technology, an application or an algorithm. Aim: This paper presents a checklist we are developing to evaluate the quality of empirical technology-centred testing studies. Discussion points: The checklist was developed by considering entities used in technology-centred testing studies and the validation problems associated with them. The planned validation process includes face validation, usability and reliability assessment and external validation. As yet the external validation has not been performed. Conclusions: The checklists appear to be usable and after some experience applying them they appear to give consistent results. However, their validation is as yet incomplete. The method of developing and evaluating the checklist may be of use to other researchers requiring a means of assessing the quality of technology-centred software engineering studies.

            Content

            Author and article information

            Contributors
            Conference
            April 2009
            April 2009
            : 1-4
            Affiliations
            [0001]School of Computing and Mathematics, Keele University, Keele, Staffordshire ST5 5BG, UK
            [0002]Department of Computer Science, Durham University, Durham, Science Laboratories

            South Road, Durham City, DH1 3LE, UK
            Article
            10.14236/ewic/EASE2009.15
            c58be44a-f637-4eca-89eb-c5cd98b2726b
            © Barbara A. Kitchenham et al. Published by BCS Learning and Development Ltd. 13th International Conference on Evaluation and Assessment in Software Engineering (EASE), Durham University, UK

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            13th International Conference on Evaluation and Assessment in Software Engineering (EASE)
            EASE
            13
            Durham University, UK
            20 - 21 April 2009
            Electronic Workshops in Computing (eWiC)
            Evaluation and Assessment in Software Engineering (EASE)
            Product
            Product Information: 1477-9358BCS Learning & Development
            Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/EASE2009.15
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Electronic Workshops in Computing

            Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction
            systematic literature review,technology-centred studies,primary study quality,testing,quality checklists

            Comments

            Comment on this article