102
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: not found

      The Other Half of the Story: Effect Size Analysis in Quantitative Research

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Effect size measures are a key complement to statistical significance testing when reporting quantitative research findings. The authors provide a rationale for use of effect size and specific tools and guidelines for interpretation of results.

          Abstract

          Statistical significance testing is the cornerstone of quantitative research, but studies that fail to report measures of effect size are potentially missing a robust part of the analysis. We provide a rationale for why effect size measures should be included in quantitative discipline-based education research. Examples from both biological and educational research demonstrate the utility of effect size for evaluating practical significance. We also provide details about some effect size indices that are paired with common statistical significance tests used in educational research and offer general suggestions for interpreting effect size measures. Finally, we discuss some inherent limitations of effect size measures and provide further recommendations about reporting confidence intervals.

          Related collections

          Most cited references32

          • Record: found
          • Abstract: found
          • Article: not found

          Effect size, confidence interval and statistical significance: a practical guide for biologists.

          Null hypothesis significance testing (NHST) is the dominant statistical approach in biology, although it has many, frequently unappreciated, problems. Most importantly, NHST does not provide us with two crucial pieces of information: (1) the magnitude of an effect of interest, and (2) the precision of the estimate of the magnitude of that effect. All biologists should be ultimately interested in biological importance, which may be assessed using the magnitude of an effect, but not its statistical significance. Therefore, we advocate presentation of measures of the magnitude of effects (i.e. effect size statistics) and their confidence intervals (CIs) in all biological journals. Combined use of an effect size and its CIs enables one to assess the relationships within data more effectively than the use of p values, regardless of statistical significance. In addition, routine presentation of effect sizes will encourage researchers to view their results in the context of previous research and facilitate the incorporation of results into future meta-analysis, which has been increasingly used as the standard method of quantitative review in biology. In this article, we extensively discuss two dimensionless (and thus standardised) classes of effect size statistics: d statistics (standardised mean difference) and r statistics (correlation coefficient), because these can be calculated from almost all study designs and also because their calculations are essential for meta-analysis. However, our focus on these standardised effect size statistics does not mean unstandardised effect size statistics (e.g. mean difference and regression coefficient) are less important. We provide potential solutions for four main technical problems researchers may encounter when calculating effect size and CIs: (1) when covariates exist, (2) when bias in estimating effect size is possible, (3) when data have non-normal error structure and/or variances, and (4) when data are non-independent. Although interpretations of effect sizes are often difficult, we provide some pointers to help researchers. This paper serves both as a beginner's instruction manual and a stimulus for changing statistical practice for the better in the biological sciences.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Eta-Squared and Partial Eta-Squared in Fixed Factor Anova Designs

            J J Cohen (1973)
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Null hypothesis significance testing: a review of an old and continuing controversy.

              Null hypothesis significance testing (NHST) is arguably the most widely used approach to hypothesis evaluation among behavioral and social scientists. It is also very controversial. A major concern expressed by critics is that such testing is misunderstood by many of those who use it. Several other objections to its use have also been raised. In this article the author reviews and comments on the claimed misunderstandings as well as on other criticisms of the approach, and he notes arguments that have been advanced in support of NHST. Alternatives and supplements to NHST are considered, as are several related recommendations regarding the interpretation of experimental data. The concluding opinion is that NHST is easily misunderstood and misused but that when applied with good judgment it can be an effective aid to the interpretation of experimental data.
                Bookmark

                Author and article information

                Journal
                CBE Life Sci Educ
                CBE-LSE
                CBE-LSE
                CBE-LSE
                CBE Life Sciences Education
                American Society for Cell Biology
                1931-7913
                1931-7913
                Fall 2013
                : 12
                : 3
                : 345-351
                Affiliations
                Department of Plant Biology, Michigan State University, East Lansing, MI 48824-1312
                Author notes
                Address correspondence to: Diane Ebert-May ( ebertmay@ 123456msu.edu ).
                Article
                CBE-13-04-0082
                10.1187/cbe.13-04-0082
                3763001
                24006382
                e639a224-08eb-4617-a10b-38fcbbe8bf44
                © 2013 J. Middlemis Maher et al. CBE—Life Sciences Education © 2013 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License ( http://creativecommons.org/licenses/by-nc-sa/3.0).

                “ASCB®” and “The American Society for Cell Biology®” are registered trademarks of The American Society of Cell Biology.

                History
                Categories
                Features
                Research Methods
                Custom metadata
                September 4, 2013

                Education
                Education

                Comments

                Comment on this article