13
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Reinforcement and Punishment Shape the Learning Dynamics in fMRI Neurofeedback

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Introduction

          Neurofeedback (NF) using real-time functional magnetic resonance imaging (fMRI) has proven to be a valuable neuroscientific tool for probing cognition and promising therapeutic approach for several psychiatric disorders. Even though learning constitutes an elementary aspect of NF, the question whether certain training schemes might positively influence its dynamics has largely been neglected.

          Methods

          To address this issue, participants were trained to exert control on their subgenual anterior cingulate cortex (sgACC) blood-oxygenation-level-dependent signal, receiving either exclusively positive reinforcement (PR, “positive feedback”) or also positive punishment (PP, “negative feedback”). The temporal dynamics of the learning process were investigated by individually modeling the feedback periods and trends, offering the possibility to assess activation changes within and across blocks, runs and sessions.

          Results

          The results show faster initial learning of the PR + PP group by significantly lower deactivations of the sgACC in the first session and stronger regulation trends during the first runs. Independent of the group, significant control over the sgACC could further be shown with but not without feedback.

          Conclusion

          The beneficial effect of PP is supported by previous findings of multiple research domains suggesting that error avoidance represents an important motivational factor of learning, which complements the reward spectrum. This hypothesis warrants further investigation with respect to NF, as it could offer a way to generally facilitate the process of gaining volitional control over brain activity.

          Related collections

          Most cited references45

          • Record: found
          • Abstract: found
          • Article: not found

          Evidence for topographic organization in the cerebellum of motor control versus cognitive and affective processing.

          Patients with cerebellar damage often present with the cerebellar motor syndrome of dysmetria, dysarthria and ataxia, yet cerebellar lesions can also result in the cerebellar cognitive affective syndrome (CCAS), including executive, visual spatial, and linguistic impairments, and affective dysregulation. We have hypothesized that there is topographic organization in the human cerebellum such that the anterior lobe and lobule VIII contain the representation of the sensorimotor cerebellum; lobules VI and VII of the posterior lobe comprise the cognitive cerebellum; and the posterior vermis is the anatomical substrate of the limbic cerebellum. Here we analyze anatomical, functional neuroimaging, and clinical data to test this hypothesis. We find converging lines of evidence supporting regional organization of motor, cognitive, and limbic behaviors in the cerebellum. The cerebellar motor syndrome results when lesions involve the anterior lobe and parts of lobule VI, interrupting cerebellar communication with cerebral and spinal motor systems. Cognitive impairments occur when posterior lobe lesions affect lobules VI and VII (including Crus I, Crus II, and lobule VIIB), disrupting cerebellar modulation of cognitive loops with cerebral association cortices. Neuropsychiatric disorders manifest when vermis lesions deprive cerebro-cerebellar-limbic loops of cerebellar input. We consider this functional topography to be a consequence of the differential arrangement of connections of the cerebellum with the spinal cord, brainstem, and cerebral hemispheres, reflecting cerebellar incorporation into the distributed neural circuits subserving movement, cognition, and emotion. These observations provide testable hypotheses for future investigations. Copyright (c) 2009 Elsevier Srl. All rights reserved.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            The subgenual anterior cingulate cortex in mood disorders.

            The anterior cingulate cortex (ACC) ventral to the genu of the corpus callosum has been implicated in the modulation of emotional behavior on the basis of neuroimaging studies in humans and lesion analyses in experimental animals. In a combined positron emission tomography/magnetic resonance imaging study of mood disorders, we demonstrated that the mean gray matter volume of this "subgenual" ACC (sgACC) cortex is abnormally reduced in subjects with major depressive disorder (MDD) and bipolar disorder, irrespective of mood state. Neuropathological assessments of sgACC tissue acquired postmortem from subjects with MDD or bipolar disorder confirmed the decrement in gray matter volume, and revealed that this abnormality was associated with a reduction in glia, with no equivalent loss of neurons. In positron emission tomography studies, the metabolic activity was elevated in this region in the depressed relative to the remitted phases of the same MDD subjects, and effective antidepressant treatment was associated with a reduction in sgACC activity. Other laboratories replicated and extended these findings, and the clinical importance of this treatment effect was underscored by a study showing that deep brain stimulation of the sgACC ameliorates depressive symptoms in treatment-resistant MDD. This article discusses the functional significance of these findings within the context of the preclinical literature that implicates the putative homologue of this region in the regulation of emotional behavior and stress response. In experimental animals, this region participates in an extended "visceromotor network" of structures that modulates autonomic/neuroendocrine responses and neurotransmitter transmission during the neural processing of reward, fear, and stress. These data thus hold important implications for the development of neural models of depression that can account for the abnormal motivational, neuroendocrine, autonomic, and emotional manifestations evident in human mood disorders.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Self-Regulation of Amygdala Activation Using Real-Time fMRI Neurofeedback

              Real-time functional magnetic resonance imaging (rtfMRI) with neurofeedback allows investigation of human brain neuroplastic changes that arise as subjects learn to modulate neurophysiological function using real-time feedback regarding their own hemodynamic responses to stimuli. We investigated the feasibility of training healthy humans to self-regulate the hemodynamic activity of the amygdala, which plays major roles in emotional processing. Participants in the experimental group were provided with ongoing information about the blood oxygen level dependent (BOLD) activity in the left amygdala (LA) and were instructed to raise the BOLD rtfMRI signal by contemplating positive autobiographical memories. A control group was assigned the same task but was instead provided with sham feedback from the left horizontal segment of the intraparietal sulcus (HIPS) region. In the LA, we found a significant BOLD signal increase due to rtfMRI neurofeedback training in the experimental group versus the control group. This effect persisted during the Transfer run without neurofeedback. For the individual subjects in the experimental group the training effect on the LA BOLD activity correlated inversely with scores on the Difficulty Identifying Feelings subscale of the Toronto Alexithymia Scale. The whole brain data analysis revealed significant differences for Happy Memories versus Rest condition between the experimental and control groups. Functional connectivity analysis of the amygdala network revealed significant widespread correlations in a fronto-temporo-limbic network. Additionally, we identified six regions — right medial frontal polar cortex, bilateral dorsomedial prefrontal cortex, left anterior cingulate cortex, and bilateral superior frontal gyrus — where the functional connectivity with the LA increased significantly across the rtfMRI neurofeedback runs and the Transfer run. The findings demonstrate that healthy subjects can learn to regulate their amygdala activation using rtfMRI neurofeedback, suggesting possible applications of rtfMRI neurofeedback training in the treatment of patients with neuropsychiatric disorders.
                Bookmark

                Author and article information

                Contributors
                Journal
                Front Hum Neurosci
                Front Hum Neurosci
                Front. Hum. Neurosci.
                Frontiers in Human Neuroscience
                Frontiers Media S.A.
                1662-5161
                24 July 2020
                2020
                : 14
                : 304
                Affiliations
                [1] 1Department of Psychiatry and Psychotherapy, Medical University of Vienna , Vienna, Austria
                [2] 2Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna , Vienna, Austria
                [3] 3Centre for Advanced Imaging, University of Queensland , Brisbane, QLD, Australia
                [4] 4Department of Neurology, Medical University of Graz , Graz, Austria
                Author notes

                Edited by: Scott Peltier, University of Michigan, United States

                Reviewed by: Styliani (Stella) Vlachou, Dublin City University, Ireland; Maria Picó-Pérez, University of Minho, Portugal

                *Correspondence: Rupert Lanzenberger, rupert.lanzenberger@ 123456meduniwien.ac.at

                This article was submitted to Brain Imaging and Stimulation, a section of the journal Frontiers in Human Neuroscience

                Article
                10.3389/fnhum.2020.00304
                7393482
                a6ed2b61-4f1d-4ae9-82df-d1d12699cd57
                Copyright © 2020 Klöbl, Michenthaler, Godbersen, Robinson, Hahn and Lanzenberger.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

                History
                : 21 April 2020
                : 08 July 2020
                Page count
                Figures: 4, Tables: 3, Equations: 0, References: 55, Pages: 12, Words: 0
                Funding
                Funded by: Austrian Science Fund 10.13039/501100002428
                Award ID: KLI516
                Award ID: FWF31452
                Funded by: Vienna Science and Technology Fund 10.13039/501100001821
                Award ID: CS18-039
                Funded by: H2020 Marie Skłodowska-Curie Actions 10.13039/100010665
                Award ID: 794298
                Funded by: Österreichischen Akademie der Wissenschaften 10.13039/501100001822
                Categories
                Neuroscience
                Original Research

                Neurosciences
                neurofeedback,punishment,reinforcement (psychology),emotions,magnetic resonance imaging

                Comments

                Comment on this article