2
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: not found

      Confidence Bounds and Power for the Reliability of Observational Measures on the Quality of a Social Setting.

      Read this article at

      ScienceOpenPublisherPubMed
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Social scientists are frequently interested in assessing the qualities of social settings such as classrooms, schools, neighborhoods, or day care centers. The most common procedure requires observers to rate social interactions within these settings on multiple items and then to combine the item responses to obtain a summary measure of setting quality. A key aspect of the quality of such a summary measure is its reliability. In this paper we derive a confidence interval for reliability, a test for the hypothesis that the reliability meets a minimum standard, and the power of this test against alternative hypotheses. Next, we consider the problem of using data from a preliminary field study of the measurement procedure to inform the design of a later study that will test substantive hypotheses about the correlates of setting quality. The preliminary study is typically called the "generalizability study" or "G study" while the later, substantive study is called the "decision study" or "D study." We show how to use data from the G study to estimate reliability, a confidence interval for the reliability, and the power of tests for the reliability of measurement produced under alternative designs for the D study. We conclude with a discussion of sample size requirements for G studies.

          Related collections

          Author and article information

          Journal
          Psychometrika
          Psychometrika
          Springer Nature America, Inc
          0033-3123
          0033-3123
          Jul 2012
          : 77
          : 3
          Affiliations
          [1 ] Department of Biostatistics, Virginia Commonwealth University, P.O. Box 980032, 830 East Main Street, Richmond, VA, 23298-0032, USA. yshin@vcu.edu.
          [2 ] Department of Sociology, University of Chicago, 1126 E. 59th Street, Chicago, IL, 60637, USA.
          Article
          10.1007/s11336-012-9266-4
          10.1007/s11336-012-9266-4
          27519780
          ed4ccce8-0a99-4859-88de-aefc1be4cad7
          History

          D study,G study,confidence interval,power,reliability,teaching quality

          Comments

          Comment on this article