Blog
About

191
views
0
recommends
+1 Recommend
1 collections
    4
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Approaches to Visualising the Spatial Position of ‘Sound-objects’

      1 , 1

      Electronic Visualisation and the Arts (EVA)

      Electronic Visualisation and the Arts

      12 - 14 July 2016

      Digital art, Mobile applications, Music, Performing arts, Technologies

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          In this paper we present the rationale and design for two systems (developed by the Integra Lab research group at Birmingham Conservatoire) implementing a common approach to interactive visualisation of the spatial position of ‘sound-objects’. The first system forms part of the AHRC-funded project ‘Transforming Transformation: 3D Models for Interactive Sound Design’, which entails the development of a new interaction model for audio processing whereby sound can be manipulated through grasp as if it were an invisible 3D object. The second system concerns the spatial manipulation of ‘beatboxer’ vocal sound using handheld mobile devices through already-learned physical movement. In both cases a means to visualise the spatial position of multiple sound sources within a 3D ‘stereo image’ is central to the system design, so a common model for this task was therefore developed. This paper describes the ways in which sound and spatial information are implemented to meet the practical demands of these systems, whilst relating this to the wider context of extant, and potential future methods for spatial audio visualisation.

          Related collections

          Most cited references 42

          • Record: found
          • Abstract: found
          • Article: not found

          Internal models for motor control and trajectory planning.

           Mitsuo Kawato (1999)
          A number of internal model concepts are now widespread in neuroscience and cognitive science. These concepts are supported by behavioral, neurophysiological, and imaging data; furthermore, these models have had their structures and functions revealed by such data. In particular, a specific theory on inverse dynamics model learning is directly supported by unit recordings from cerebellar Purkinje cells. Multiple paired forward inverse models describing how diverse objects and environments can be controlled and learned separately have recently been proposed. The 'minimum variance model' is another major recent advance in the computational theory of motor control. This model integrates two furiously disputed approaches on trajectory planning, strongly suggesting that both kinematic and dynamic internal models are utilized in movement planning and control.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Enhancement of visual perception by crossmodal visuo-auditory interaction.

            Neurophysiological studies have shown in animals that a sudden sound enhanced perceptual processing of subsequent visual stimuli. In the present study, we explored the possibility that such enhancement also exists in humans and can be explained through crossmodal integration effects, whereby the interaction occurs at the level of bimodal neurons. Subjects were required to detect visual stimuli in a unimodal visual condition or in crossmodal audio-visual conditions. The spatial and the temporal proximity of multisensory stimuli were systematically varied. An enhancement of the perceptual sensitivity (d') for luminance detection was found when the audiovisual stimuli followed a rather clear spatial and temporal rule, governing multisensory integration at the neuronal level.
              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              On colored-hearing synesthesia: cross-modal translations of sensory dimensions.

                Bookmark

                Author and article information

                Contributors
                Conference
                July 2016
                July 2016
                : 15-22
                Affiliations
                [1 ] Birmingham Conservatoire

                Birmingham, UK
                10.14236/ewic/EVA2016.4

                This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

                Electronic Visualisation and the Arts
                EVA
                London, UK
                12 - 14 July 2016
                Electronic Workshops in Computing (eWiC)
                Electronic Visualisation and the Arts
                Product
                Product Information: 1477-9358 BCS Learning & Development
                Self URI (journal page): https://ewic.bcs.org/
                Categories
                Electronic Workshops in Computing

                Comments

                Comment on this article