Visualising Sound: Localisation, Feature Analysis and Visualisation

Abstract

Sound is an integral medium of communication in society. Despite its influence in everyday interaction, the fundamental features of sound and its impact are not commonly understood and often not considered. Advanced dissection and analysis of sound is often used to aid technology’s understanding of its environment (e.g. in robotics and telecommunications). The aim of this project is to utilise sound information technology to enhance our understanding of sound and how we process it. Visualisation can provide a more accessible representation of complex sound analysis, and so it is investigated here in the context of musical performance and interactive installation. This cross-modal experience is informed by the phenomenon of synaesthesia and creative mapping to express its subjectivity by providing a user-unique experience. In addition to results and user evaluations, the paper concludes with plans for future development, focusing on the impact of the interactive installation on the user and ways in which the technology developed can be used in creative interaction with sound.

Conference

Publication date: July 2012

Publication date (Print): July 2012

Pages: 135-142

Affiliations

ICSRiM – University of Leeds

School of Electronic and Electrical Engineering

School of Computing and School of Music

Leeds LS2 9JT

United Kingdom

soundvis@ 123456icsrim.org.uk

www.icsrim.org.uk

Article

DOI: 10.14236/ewic/EVA2012.22

Copyright statement: © Jack Armitage et al. Published by BCS Learning and Development Ltd. Electronic Visualisation and the Arts (EVA 2012), London, UK

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Electronic Visualisation and the Arts (EVA 2012)

Conference acronym: EVA

Conference number:

Conference location: London, UK

Conference date: 10 - 12 July 2012

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Electronic Visualisation and the Arts

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/EVA2012.22

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing