37
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: not found

      Dopamine and Effort-Based Decision Making

      research-article

      Read this article at

      ScienceOpenPublisherPMC
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Motivational theories of choice focus on the influence of goal values and strength of reinforcement to explain behavior. By contrast relatively little is known concerning how the cost of an action, such as effort expended, contributes to a decision to act. Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. Here we review behavioral and neurobiological data regarding the representation of effort as action cost, and how this impacts on decision making. Although organisms expend effort to obtain a desired reward there is a striking sensitivity to the amount of effort required, such that the net preference for an action decreases as effort cost increases. We discuss the contribution of the neurotransmitter dopamine (DA) toward overcoming response costs and in enhancing an animal's motivation toward effortful actions. We also consider the contribution of brain structures, including the basal ganglia and anterior cingulate cortex, in the internal generation of action involving a translation of reward expectation into effortful action.

          Related collections

          Most cited references67

          • Record: found
          • Abstract: found
          • Article: not found

          Cognitive and emotional influences in anterior cingulate cortex.

          Bush, Luu, Posner (2000)
          Anterior cingulate cortex (ACC) is a part of the brain's limbic system. Classically, this region has been related to affect, on the basis of lesion studies in humans and in animals. In the late 1980s, neuroimaging research indicated that ACC was active in many studies of cognition. The findings from EEG studies of a focal area of negativity in scalp electrodes following an error response led to the idea that ACC might be the brain's error detection and correction device. In this article, these various findings are reviewed in relation to the idea that ACC is a part of a circuit involved in a form of attention that serves to regulate both cognitive and emotional processing. Neuroimaging studies showing that separate areas of ACC are involved in cognition and emotion are discussed and related to results showing that the error negativity is influenced by affect and motivation. In addition, the development of the emotional and cognitive roles of ACC are discussed, and how the success of this regulation in controlling responses might be correlated with cingulate size. Finally, some theories are considered about how the different subdivisions of ACC might interact with other cortical structures as a part of the circuits involved in the regulation of mental and emotional activity.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex.

            Anatomical and functional refinements of the meso-limbic dopamine system of the rat are discussed. Present experiments suggest that dopaminergic neurons localized in the posteromedial ventral tegmental area (VTA) and central linear nucleus raphe selectively project to the ventromedial striatum (medial olfactory tubercle and medial nucleus accumbens shell), whereas the anteromedial VTA has few if any projections to the ventral striatum, and the lateral VTA largely projects to the ventrolateral striatum (accumbens core, lateral shell and lateral tubercle). These findings complement the recent behavioral findings that cocaine and amphetamine are more rewarding when administered into the ventromedial striatum than into the ventrolateral striatum. Drugs such as nicotine and opiates are more rewarding when administered into the posterior VTA or the central linear nucleus than into the anterior VTA. A review of the literature suggests that (1) the midbrain has corresponding zones for the accumbens core and medial shell; (2) the striatal portion of the olfactory tubercle is a ventral extension of the nucleus accumbens shell; and (3) a model of two dopamine projection systems from the ventral midbrain to the ventral striatum is useful for understanding reward function. The medial projection system is important in the regulation of arousal characterized by affect and drive and plays a different role in goal-directed learning than the lateral projection system, as described in the variation-selection hypothesis of striatal functional organization.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              A framework for mesencephalic dopamine systems based on predictive Hebbian learning.

              We develop a theoretical framework that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations. In particular, we show how activity in the cerebral cortex can make predictions about future receipt of reward and how fluctuations in the activity levels of neurons in diffuse dopamine systems above and below baseline levels would represent errors in these predictions that are delivered to cortical and subcortical targets. We present a model for how such errors could be constructed in a real brain that is consistent with physiological results for a subset of dopaminergic neurons located in the ventral tegmental area and surrounding dopaminergic neurons. The theory also makes testable predictions about human choice behavior on a simple decision-making task. Furthermore, we show that, through a simple influence on synaptic plasticity, fluctuations in dopamine release can act to change the predictions in an appropriate manner.
                Bookmark

                Author and article information

                Journal
                Front Neurosci
                Front. Neurosci.
                Frontiers in Neuroscience
                Frontiers Research Foundation
                1662-4548
                1662-453X
                21 June 2011
                2011
                : 5
                : 81
                Affiliations
                [1] 1simpleCognitive, Perceptual, and Brain Sciences, University College London London, UK
                [2] 2simpleWellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London London, UK
                [3] 3simpleInstitute of Cognitive Neuroscience, University College London London, UK
                Author notes

                Edited by: Julia Trommershaeuser, New York University, USA

                Reviewed by: Joseph W. Kable, University of Pennsylvania, USA; Fred H. Hamker, Chemnitz University of Technology, Germany

                *Correspondence: Irma Triasih Kurniawan, Cognitive, Perceptual, and Brain Sciences, University College London, Gower Street, London WC1E 6BT, UK. e-mail: i.kurniawan@ 123456ucl.ac.uk

                This article was submitted to Frontiers in Decision Neuroscience, a specialty of Frontiers in Neuroscience.

                Article
                10.3389/fnins.2011.00081
                3122071
                21734862
                1dd85627-18f9-458b-945c-0843cfc03ce7
                Copyright © 2011 Kurniawan, Guitart-Masip and Dolan.

                This is an open-access article subject to a non-exclusive license between the authors and Frontiers Media SA, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and other Frontiers conditions are complied with.

                History
                : 14 January 2011
                : 06 June 2011
                Page count
                Figures: 3, Tables: 1, Equations: 0, References: 104, Pages: 10, Words: 10431
                Categories
                Neuroscience
                Original Research

                Neurosciences
                basal ganglia,acc,effort,dopamine,apathy,vigor
                Neurosciences
                basal ganglia, acc, effort, dopamine, apathy, vigor

                Comments

                Comment on this article