32
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      When a photograph can be heard: Vision activates the auditory cortex within 110 ms

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          As the makers of silent movies knew well, it is not necessary to provide an actual auditory stimulus to activate the sensation of sounds typically associated with what we are viewing. Thus, you could almost hear the neigh of Rodolfo Valentino's horse, even though the film was mute. Evidence is provided that the mere sight of a photograph associated with a sound can activate the associative auditory cortex. High-density ERPs were recorded in 15 participants while they viewed hundreds of perceptually matched images that were associated (or not) with a given sound. Sound stimuli were discriminated from non-sound stimuli as early as 110 ms. SwLORETA reconstructions showed common activation of ventral stream areas for both types of stimuli and of the associative temporal cortex, at the earliest stage, only for sound stimuli. The primary auditory cortex (BA41) was also activated by sound images after ∼ 200 ms.

          Related collections

          Most cited references23

          • Record: found
          • Abstract: found
          • Article: not found

          Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain.

          This paper presents a new method for localizing the electric activity in the brain based on multichannel surface EEG recordings. In contrast to the models presented up to now the new method does not assume a limited number of dipolar point sources nor a distribution on a given known surface, but directly computes a current distribution throughout the full brain volume. In order to find a unique solution for the 3-dimensional distribution among the infinite set of different possible solutions, the method assumes that neighboring neurons are simultaneously and synchronously activated. The basic assumption rests on evidence from single cell recordings in the brain that demonstrates strong synchronization of adjacent neurons. In view of this physiological consideration the computational task is to select the smoothest of all possible 3-dimensional current distributions, a task that is a common procedure in generalized signal processing. The result is a true 3-dimensional tomography with the characteristic that localization is preserved with a certain amount of dispersion, i.e., it has a relatively low spatial resolution. The new method, which we call Low Resolution Electromagnetic Tomography (LORETA) is illustrated with two different sets of evoked potential data, the first showing the tomography of the P100 component to checkerboard stimulation of the left, right, upper and lower hemiretina, and the second showing the results for the auditory N100 component and the two cognitive components CNV and P300. A direct comparison of the tomography results with those obtained from fitting one and two dipoles illustrates that the new method provides physiologically meaningful results while dipolar solutions fail in many situations. In the case of the cognitive components, the method offers new hypotheses on the location of higher cognitive functions in the brain.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            The concept of auditory stimulus representation in cognitive neuroscience.

            The sequence of neurophysiological processes elicited in the auditory system by a sound is analyzed in search of the stage at which the processes carrying sensory information cross the borderline beyond which they directly underlie sound perception. Neurophysiological data suggest that this transition occurs when the sensory input is mapped onto the physiological basis of sensory memory in the auditory cortex. At this point, the sensory information carried by the stimulus-elicited process corresponds, for the first time, to that contained by the actual sound percept. Before this stage, the sensory stimulus code is fragmentary, lacks the time dimension, cannot enter conscious perception, and is not accessible to top-down processes (voluntary mental operations). On these grounds, 2 distinct stages of auditory sensory processing, prerepresentational and representational, can be distinguished.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Integration of auditory and visual information about objects in superior temporal sulcus.

              Two categories of objects in the environment-animals and man-made manipulable objects (tools)-are easily recognized by either their auditory or visual features. Although these features differ across modalities, the brain integrates them into a coherent percept. In three separate fMRI experiments, posterior superior temporal sulcus and middle temporal gyrus (pSTS/MTG) fulfilled objective criteria for an integration site. pSTS/MTG showed signal increases in response to either auditory or visual stimuli and responded more to auditory or visual objects than to meaningless (but complex) control stimuli. pSTS/MTG showed an enhanced response when auditory and visual object features were presented together, relative to presentation in a single modality. Finally, pSTS/MTG responded more to object identification than to other components of the behavioral task. We suggest that pSTS/MTG is specialized for integrating different types of information both within modalities (e.g., visual form, visual motion) and across modalities (auditory and visual).
                Bookmark

                Author and article information

                Journal
                Sci Rep
                Scientific Reports
                Nature Publishing Group
                2045-2322
                04 August 2011
                2011
                : 1
                : 54
                Affiliations
                [1 ]simpleDept. of Psychology, University of Milano-Bicocca , Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy
                [2 ]simpleInstitute of Molecular Bioimaging and Physiology, National Research Council (CNR) , Milano-Segrate, Italy
                Author notes
                Article
                srep00054
                10.1038/srep00054
                3216541
                22355573
                fe7015b5-4b08-48ea-a83d-1c5803f34034
                Copyright © 2011, Macmillan Publishers Limited. All rights reserved

                This work is licensed under a Creative Commons Attribution-NonCommercial-ShareALike 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/3.0/

                History
                : 05 April 2011
                : 20 July 2011
                Categories
                Article

                Uncategorized
                Uncategorized

                Comments

                Comment on this article