8
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      On the effects of multimodal information integration in multitasking

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

          Related collections

          Most cited references43

          • Record: found
          • Abstract: found
          • Article: not found

          From sensation to cognition.

          M. Mesulam (1998)
          Sensory information undergoes extensive associative elaboration and attentional modulation as it becomes incorporated into the texture of cognition. This process occurs along a core synaptic hierarchy which includes the primary sensory, upstream unimodal, downstream unimodal, heteromodal, paralimbic and limbic zones of the cerebral cortex. Connections from one zone to another are reciprocal and allow higher synaptic levels to exert a feedback (top-down) influence upon earlier levels of processing. Each cortical area provides a nexus for the convergence of afferents and divergence of efferents. The resultant synaptic organization supports parallel as well as serial processing, and allows each sensory event to initiate multiple cognitive and behavioural outcomes. Upstream sectors of unimodal association areas encode basic features of sensation such as colour, motion, form and pitch. More complex contents of sensory experience such as objects, faces, word-forms, spatial locations and sound sequences become encoded within downstream sectors of unimodal areas by groups of coarsely tuned neurons. The highest synaptic levels of sensory-fugal processing are occupied by heteromodal, paralimbic and limbic cortices, collectively known as transmodal areas. The unique role of these areas is to bind multiple unimodal and other transmodal areas into distributed but integrated multimodal representations. Transmodal areas in the midtemporal cortex, Wernicke's area, the hippocampal-entorhinal complex and the posterior parietal cortex provide critical gateways for transforming perception into recognition, word-forms into meaning, scenes and events into experiences, and spatial locations into targets for exploration. All cognitive processes arise from analogous associative transformations of similar sets of sensory inputs. The differences in the resultant cognitive operation are determined by the anatomical and physiological properties of the transmodal node that acts as the critical gateway for the dominant transformation. Interconnected sets of transmodal nodes provide anatomical and computational epicentres for large-scale neurocognitive networks. In keeping with the principles of selectively distributed processing, each epicentre of a large-scale network displays a relative specialization for a specific behavioural component of its principal neurospychological domain. The destruction of transmodal epicentres causes global impairments such as multimodal anomia, neglect and amnesia, whereas their selective disconnection from relevant unimodal areas elicits modality-specific impairments such as prosopagnosia, pure word blindness and category-specific anomias. The human brain contains at least five anatomically distinct networks. The network for spatial awareness is based on transmodal epicentres in the posterior parietal cortex and the frontal eye fields; the language network on epicentres in Wernicke's and Broca's areas; the explicit memory/emotion network on epicentres in the hippocampal-entorhinal complex and the amygdala; the face-object recognition network on epicentres in the midtemporal and temporopolar cortices; and the working memory-executive function network on epicentres in the lateral prefrontal cortex and perhaps the posterior parietal cortex. Individual sensory modalities give rise to streams of processing directed to transmodal nodes belonging to each of these networks. The fidelity of sensory channels is actively protected through approximately four synaptic levels of sensory-fugal processing. The modality-specific cortices at these four synaptic levels encode the most veridical representations of experience. Attentional, motivational and emotional modulations, including those related to working memory, novelty-seeking and mental imagery, become increasingly more pronounced within downstream components of unimodal areas, where they help to create a highly edited subjective version of the world. (ABSTRACT TRUNCATED)
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Event-related potential studies of attention.

            Over the past 30 years, recordings of event-related potentials (ERPs) from normal individuals have played an increasingly important role in our understanding of the mechanisms of attention. This article reviews some of the recent ERP studies of attention, focusing on studies that isolate the operation of attention in specific cognitive subsystems such as perception, working memory, and response selection. Several conclusions are drawn. First, under some conditions attention modulates the initial feedforward volley of neural activity in intermediate visual processing areas. Second, these early effects can be observed for both the voluntary allocation of attention and for the automatic capture of attention following a peripheral visual transient. Third, these effects are present not only when attention is directed to a location in 2-dimensional space, but also when attention is directed to one of two spatially overlapping surfaces. Fourth, attention does not modulate sensory activity unless sensory systems are overloaded; when sensory systems are not taxed, attention may instead operate to influence memory or response processes. That is, attention operates to mitigate information overload in whichever cognitive subsystems are overloaded by a particular combination of stimuli and task.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              EEG coherency. I: Statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales.

              Several methodological issues which impact experimental design and physiological interpretations in EEG coherence studies are considered, including reference electrode and volume conduction contributions to erroneous coherence estimates. A new measure, 'reduced coherency', is introduced as the difference between measured coherency and the coherency expected from uncorrelated neocortical sources, based on simulations and analytic-statistical studies with a volume conductor model. The concept of reduced coherency is shown to be in semi-quantitative agreement with experimental EEG data. The impact of volume conduction on statistical confidence intervals for coherence estimates is discussed. Conventional reference, average reference, bipolar, Laplacian, and cortical image coherencies are shown to be partly independent measures of neocortical dynamic function at different spatial scales, due to each method's unique spatial filtering of intracranial source activity.
                Bookmark

                Author and article information

                Contributors
                Ann-Kathrin.Stock@uniklinikum-dresden.de
                Journal
                Sci Rep
                Sci Rep
                Scientific Reports
                Nature Publishing Group UK (London )
                2045-2322
                7 July 2017
                7 July 2017
                2017
                : 7
                : 4927
                Affiliations
                [1 ]Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Carl Gustav Carus Faculty of Medicine, TU Dresden, Germany
                [2 ]ISNI 0000 0004 1936 8921, GRID grid.5510.1, Department of Psychology, , University of Oslo, ; Oslo, Norway
                [3 ]GRID grid.447902.c, , Experimental Neurobiology, National Institute of Mental Health, ; Klecany, Czech Republic
                Author information
                http://orcid.org/0000-0001-7113-4020
                Article
                4828
                10.1038/s41598-017-04828-w
                5501795
                28687804
                01d8fbf5-1a58-4ac1-98c7-d120fae99f62
                © The Author(s) 2017

                Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

                History
                : 16 November 2016
                : 4 May 2017
                Categories
                Article
                Custom metadata
                © The Author(s) 2017

                Uncategorized
                Uncategorized

                Comments

                Comment on this article