74
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      A Dual Role for Prediction Error in Associative Learning

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla–Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.

          Related collections

          Most cited references43

          • Record: found
          • Abstract: found
          • Article: not found

          Dynamic causal modelling.

          In this paper we present an approach to the identification of nonlinear input-state-output systems. By using a bilinear approximation to the dynamics of interactions among states, the parameters of the implicit causal model reduce to three sets. These comprise (1) parameters that mediate the influence of extrinsic inputs on the states, (2) parameters that mediate intrinsic coupling among the states, and (3) [bilinear] parameters that allow the inputs to modulate that coupling. Identification proceeds in a Bayesian framework given known, deterministic inputs and the observed responses of the system. We developed this approach for the analysis of effective connectivity using experimentally designed inputs and fMRI responses. In this context, the coupling parameters correspond to effective connectivity and the bilinear parameters reflect the changes in connectivity induced by inputs. The ensuing framework allows one to characterise fMRI experiments, conceptually, as an experimental manipulation of integration among brain regions (by contextual or trial-free inputs, like time or attentional set) that is revealed using evoked responses (to perturbations or trial-bound inputs, like stimuli). As with previous analyses of effective connectivity, the focus is on experimentally induced changes in coupling (cf., psychophysiologic interactions). However, unlike previous approaches in neuroimaging, the causal model ascribes responses to designed deterministic inputs, as opposed to treating inputs as unknown and stochastic.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            An internal model for sensorimotor integration.

            On the basis of computational studies it has been proposed that the central nervous system internally simulates the dynamic behavior of the motor system in planning, control, and learning; the existence and use of such an internal model is still under debate. A sensorimotor integration task was investigated in which participants estimated the location of one of their hands at the end of movements made in the dark and under externally imposed forces. The temporal propagation of errors in this task was analyzed within the theoretical framework of optimal state estimation. These results provide direct support for the existence of an internal model.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Central cancellation of self-produced tickle sensation.

              A self-produced tactile stimulus is perceived as less ticklish than the same stimulus generated externally. We used fMRI to examine neural responses when subjects experienced a tactile stimulus that was either self-produced or externally produced. More activity was found in somatosensory cortex when the stimulus was externally produced. In the cerebellum, less activity was associated with a movement that generated a tactile stimulus than with a movement that did not. This difference suggests that the cerebellum is involved in predicting the specific sensory consequences of movements, providing the signal that is used to cancel the sensory response to self-generated stimulation.
                Bookmark

                Author and article information

                Journal
                Cereb Cortex
                cercor
                cercor
                Cerebral Cortex (New York, NY)
                Oxford University Press
                1047-3211
                1460-2199
                May 2009
                26 September 2008
                26 September 2008
                : 19
                : 5
                : 1175-1185
                Affiliations
                [1 ]Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK
                [2 ]Department of Psychology, New York University, New York, NY 10003, USA
                [3 ]Rotman Research Institute of Baycrest Centre, University of Toronto, Toronto, Ontario, Canada M6A 2E1
                [4 ]Branco-Weiss-Laboratory, Institute for Empirical Research in Economics, University of Zürich, Switzerland
                Author notes
                Address correspondence to Hanneke den Ouden, Wellcome Trust Centre for Neuroimaging, Institute of Neurology, UCL, 12 Queen Square, London, UK WC1N 3BG. Email: h.denouden@ 123456fil.ion.ucl.ac.uk .
                Article
                10.1093/cercor/bhn161
                2665159
                18820290
                73e2451a-06a4-4066-9b0b-0375e5534d92
                © 2008 The Authors

                This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License ( http://creativecommons.org/licenses/by-nc/2.0/uk/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                Categories
                Articles

                Neurology
                fmri,effective connectivity,dynamic causal modeling,cross-modal,rescorla–wagner model,associative learning

                Comments

                Comment on this article