20
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      The ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          A popular goal in psychological science is to understand human cognition and behavior in the ‘real-world.’ In contrast, researchers have typically conducted their research in experimental research settings, a.k.a. the ‘psychologist’s laboratory.’ Critics have often questioned whether psychology’s laboratory experiments permit generalizable results. This is known as the ‘real-world or the lab’-dilemma. To bridge the gap between lab and life, many researchers have called for experiments with more ‘ecological validity’ to ensure that experiments more closely resemble and generalize to the ‘real-world.’ However, researchers seldom explain what they mean with this term, nor how more ecological validity should be achieved. In our opinion, the popular concept of ecological validity is ill-formed, lacks specificity, and falls short of addressing the problem of generalizability. To move beyond the ‘real-world or the lab’-dilemma, we believe that researchers in psychological science should always specify the particular context of cognitive and behavioral functioning in which they are interested, instead of advocating that experiments should be more ‘ecologically valid’ in order to generalize to the ‘real-world.’ We believe this will be a more constructive way to uncover the context-specific and context-generic principles of cognition and behavior.

          Related collections

          Most cited references66

          • Record: found
          • Abstract: found
          • Article: not found

          Constraints on Generality (COG): A Proposed Addition to All Empirical Papers

          Psychological scientists draw inferences about populations based on samples-of people, situations, and stimuli-from those populations. Yet, few papers identify their target populations, and even fewer justify how or why the tested samples are representative of broader populations. A cumulative science depends on accurately characterizing the generality of findings, but current publishing standards do not require authors to constrain their inferences, leaving readers to assume the broadest possible generalizations. We propose that the discussion section of all primary research articles specify Constraints on Generality (i.e., a "COG" statement) that identify and justify target populations for the reported findings. Explicitly defining the target populations will help other researchers to sample from the same populations when conducting a direct replication, and it could encourage follow-up studies that test the boundary conditions of the original finding. Universal adoption of COG statements would change publishing incentives to favor a more cumulative science.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            In defense of external invalidity.

              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Factors relevant to the validity of experiments in social settings.

                Bookmark

                Author and article information

                Contributors
                Journal
                Front Psychol
                Front Psychol
                Front. Psychol.
                Frontiers in Psychology
                Frontiers Media S.A.
                1664-1078
                30 April 2020
                2020
                : 11
                : 721
                Affiliations
                [1] 1Department of Experimental Psychology, Helmholtz Institute, Utrecht University , Utrecht, Netherlands
                [2] 2Department of Developmental Psychology, Utrecht University , Utrecht, Netherlands
                [3] 3Brain Center, University Medical Center Utrecht , Utrecht, Netherlands
                Author notes

                Edited by: Matthias Gamer, Julius Maximilian University of Würzburg, Germany

                Reviewed by: Yoni Pertzov, The Hebrew University of Jerusalem, Israel; Nicola Jean Gregory, Bournemouth University, United Kingdom

                *Correspondence: Gijs A. Holleman, g.a.holleman@ 123456uu.nl

                This article was submitted to Cognitive Science, a section of the journal Frontiers in Psychology

                Article
                10.3389/fpsyg.2020.00721
                7204431
                32425850
                c4d6aeaa-2493-4e86-919c-c528bc0d4ef3
                Copyright © 2020 Holleman, Hooge, Kemner and Hessels.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

                History
                : 24 January 2020
                : 25 March 2020
                Page count
                Figures: 3, Tables: 0, Equations: 0, References: 107, Pages: 12, Words: 0
                Funding
                Funded by: Nederlandse Organisatie voor Wetenschappelijk Onderzoek 10.13039/501100003246
                Categories
                Psychology
                Conceptual Analysis

                Clinical Psychology & Psychiatry
                ecological validity,experiments,real-world approach,generalizability,definitions

                Comments

                Comment on this article