Configuring a Haptic Interface for Music Performance

Our daily interactions and perceptions involve multiple sensory multimodalities; most exchanges are inherently multimodal, playing an important part in our decoding and understanding of environments. Events can often engage multiple senses. Furthermore, musical experiences can be highly multisensory, with obvious auditory stimulation, the visual elements of a live performance, and physical stimulation of the body. In this paper, we will propose a means of incorporating an additional somatic channel of communication into live performances and compositional practice to further augment the physical nature of live performance. This work explores the integration of augmented vibratory, or haptic stimulation for audiences in live performance. The vibration interface is presented as an expressive and creative live performance-based tool for composers. Vibrations, or haptics, are implemented as an additional instrumental line, alongside auditory musical gestures, to expand the composer’s palette of expressions through augmented somatic engagement. This paper will describe the background, and design and development of a haptic interface for the purpose of audio-haptic listening-feeling. The focus of this paper is to describe a study into motor latency for informing multimedia simultaneity.

Content

Author and article information

Conference

Publication date: July 2015

Publication date (Print): July 2015

Pages: 41-45

Affiliations

[0001]ICSRiM – University of Leeds, School of Music and School of Computing, Leeds LS2 9JT, U.K.

haptics@icsrim.org.uk, www.icsrim.leeds.ac.uk

Article

DOI: 10.14236/ewic/eva2015.4

SO-VID: 9e310f25-6362-4e0d-91f0-6eafeade9f5f

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Electronic Visualisation and the Arts (EVA 2015)

Conference acronym: EVA

Conference number:

Conference location: London, UK

Conference date: 7 & 9 July 2015

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Electronic Visualisation and the Arts

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/eva2015.4

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

M. E Altinsoy 2003 Perceptual Aspects of Auditory-Tactile Asynchrony International Congress on Sound and Vibration, (IIAV 2003), Stockholm, Swedenp3831 3838
M. E Altinsoy 2012 The Quality of Auditory-Tactile Virtual Environments Journal of the Audio Engineering Society 60 1 38 46
J ArmitageP BakanasJ BalmerP HalpinK HudspethK Ng 2012 mConduct: A Multi-Sensor Interface for the Capture and Analysis of Conducting Gesture Electronic Visualisation and the Arts (EVA 2012) London, UK 10–12 07 2012 p229 236 British Computer Society London
J ArmitageK Ng 2013 Multimodal Music Composition Electronic Visualisation and the Arts (EVA 2013) London, UK 29–31 07 2013 p40– 46 British Computer Society London
D. M Birnbaum 2007 Musical Vibrotactile Feedback Masters Thesis, McGill University Canada
E Gunther 2007 Organ, Organ http://www.ericgunther.info/projects/system.html 17 03 2015
L Hayes and C Michalakos 2012 Imposing a networked vibrotactile communication system for improvisational suggestion Organised Sound 17 1 36 44
S. J LedermanL. A Jones 2011 Tactile and haptic illusions IEEE Transactions on Haptics 4 4) 273 294
D. J LevitinK MacLeanM MathewsL Chu and E Jensen 2000 The Perception of Cross-modal Simultaneity Computing Anticipatory Systems, AIP 2000 p323 329
Precision Microdrives Measuring vibration strength a quick method http://www.precisionmicrodrives.com/tech-blog/2014/06/03/measuring-vibration-strength-a-quick-method 15 03 2015
Precision Microdrives Adding and Improving Haptics http://www.precisionmicrodrives.com/haptics-haptic-feedback-vibration-alerting/haptic-feedback-in-detail/adding-and-improving-haptic-feedback 15 03 2015
J. B. F van Erp 2002 Guidelines for the Use of Vibro-Tactile Displays in Human Computer Interaction Eurohaptics Edinburgh, UK
B VerplankM GurevichM Matthews 2002 The Plank: Designing a simple haptic controller New Instruments for Musical Expression (NIME 2002) Dublin, Ireland 24–26 05 2002
L WyseS NanayakkaraP SeekingsS. H OngE Taylor Perception of vibrotactile stimuli above 1kHz by the hearing impaired New Interfaces in Musical Expression (NIME 2012) Oslo, Norway

Comments

Comment on this article

[1] M. E Altinsoy 2003 Perceptual Aspects of Auditory-Tactile Asynchrony International Congress on Sound and Vibration, (IIAV 2003), Stockholm, Swedenp3831 3838

[2] M. E Altinsoy 2012 The Quality of Auditory-Tactile Virtual Environments Journal of the Audio Engineering Society 60 1 38 46

[3] J ArmitageP BakanasJ BalmerP HalpinK HudspethK Ng 2012 mConduct: A Multi-Sensor Interface for the Capture and Analysis of Conducting Gesture Electronic Visualisation and the Arts (EVA 2012) London, UK 10–12 07 2012 p229 236 British Computer Society London

[4] J ArmitageK Ng 2013 Multimodal Music Composition Electronic Visualisation and the Arts (EVA 2013) London, UK 29–31 07 2013 p40– 46 British Computer Society London

[5] D. M Birnbaum 2007 Musical Vibrotactile Feedback Masters Thesis, McGill University Canada

[6] E Gunther 2007 Organ, Organ http://www.ericgunther.info/projects/system.html 17 03 2015

[7] L Hayes and C Michalakos 2012 Imposing a networked vibrotactile communication system for improvisational suggestion Organised Sound 17 1 36 44

[8] S. J LedermanL. A Jones 2011 Tactile and haptic illusions IEEE Transactions on Haptics 4 4) 273 294

[9] D. J LevitinK MacLeanM MathewsL Chu and E Jensen 2000 The Perception of Cross-modal Simultaneity Computing Anticipatory Systems, AIP 2000 p323 329

[10] Precision Microdrives Measuring vibration strength a quick method http://www.precisionmicrodrives.com/tech-blog/2014/06/03/measuring-vibration-strength-a-quick-method 15 03 2015

[11] Precision Microdrives Adding and Improving Haptics http://www.precisionmicrodrives.com/haptics-haptic-feedback-vibration-alerting/haptic-feedback-in-detail/adding-and-improving-haptic-feedback 15 03 2015

[12] J. B. F van Erp 2002 Guidelines for the Use of Vibro-Tactile Displays in Human Computer Interaction Eurohaptics Edinburgh, UK

[13] B VerplankM GurevichM Matthews 2002 The Plank: Designing a simple haptic controller New Instruments for Musical Expression (NIME 2002) Dublin, Ireland 24–26 05 2002

[14] L WyseS NanayakkaraP SeekingsS. H OngE Taylor Perception of vibrotactile stimuli above 1kHz by the hearing impaired New Interfaces in Musical Expression (NIME 2012) Oslo, Norway

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65