0
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app’s architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed.

          Related collections

          Most cited references 29

          • Record: found
          • Abstract: found
          • Article: not found

          Coefficient alpha and the internal structure of tests

           Lee Cronbach (1951)
          Psychometrika, 16(3), 297-334
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            A power primer

             J. COHEN,  , Cohen,,  J Cohen (1992)
              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              A rasch model for partial credit scoring

               Geoff Masters (1982)
                Bookmark

                Author and article information

                Contributors
                Role: ConceptualizationRole: InvestigationRole: MethodologyRole: Project administrationRole: SoftwareRole: VisualizationRole: Writing – original draftRole: Writing – review & editing
                Role: InvestigationRole: MethodologyRole: Project administrationRole: SoftwareRole: VisualizationRole: Writing – original draftRole: Writing – review & editing
                Role: MethodologyRole: SoftwareRole: VisualizationRole: Writing – original draftRole: Writing – review & editing
                Role: MethodologyRole: SoftwareRole: Writing – original draftRole: Writing – review & editing
                Role: MethodologyRole: SoftwareRole: Writing – original draftRole: Writing – review & editing
                Role: MethodologyRole: SoftwareRole: Writing – original draftRole: Writing – review & editing
                Role: Editor
                Journal
                PLoS One
                PLoS One
                plos
                PLoS ONE
                Public Library of Science (San Francisco, CA USA )
                1932-6203
                11 October 2021
                2021
                : 16
                : 10
                Affiliations
                [1 ] Graduate School of Education, Nazarbayev University, Nur-Sultan, Kazakhstan
                [2 ] Department of Statistics, The University of Auckland, Auckland, New Zealand
                [3 ] School of Foreign Languages, Henan University, Henan, China
                [4 ] Faculty of Education and Social Work, The University of Auckland, Auckland, New Zealand
                [5 ] National School of Education, Australian Catholic University, Melbourne, Australia
                [6 ] Center for Pedagogical Measurements, Nazarbayev Intellectual Schools, Nur-Sultan, Kazakhstan
                University of Copenhagen, DENMARK
                Author notes

                Competing Interests: The authors have declared that no competing interests exist.

                Article
                PONE-D-21-05570
                10.1371/journal.pone.0257682
                8505029
                674a7cdb-545d-4677-946e-22d25b02183c
                © 2021 Courtney et al

                This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

                Page count
                Figures: 18, Tables: 1, Pages: 24
                Product
                Funding
                The authors received no specific funding for this work.
                Categories
                Research Article
                Biology and Life Sciences
                Psychology
                Psychometrics
                Social Sciences
                Psychology
                Psychometrics
                Computer and Information Sciences
                Software Engineering
                Computer Software
                Open Source Software
                Engineering and Technology
                Software Engineering
                Computer Software
                Open Source Software
                Science Policy
                Open Science
                Open Source Software
                Biology and Life Sciences
                Neuroscience
                Cognitive Science
                Cognitive Psychology
                Learning
                Human Learning
                Biology and Life Sciences
                Psychology
                Cognitive Psychology
                Learning
                Human Learning
                Social Sciences
                Psychology
                Cognitive Psychology
                Learning
                Human Learning
                Biology and Life Sciences
                Neuroscience
                Learning and Memory
                Learning
                Human Learning
                Social Sciences
                Sociology
                Education
                Schools
                Computer and Information Sciences
                Software Engineering
                Computer Software
                Engineering and Technology
                Software Engineering
                Computer Software
                People and Places
                Population Groupings
                Professions
                Teachers
                Research and Analysis Methods
                Research Assessment
                Research Quality Assessment
                Research and Analysis Methods
                Mathematical and Statistical Techniques
                Statistical Methods
                Analysis of Variance
                Physical Sciences
                Mathematics
                Statistics
                Statistical Methods
                Analysis of Variance
                Custom metadata
                All source code is available from Github: github.com/kcha193/AutoPsychShiny.

                Uncategorized

                Comments

                Comment on this article