mConduct: A Multi-Sensor Interface for the Capture and Analysis of Conducting Gesture

Abstract

The art of conducting has a long and well-established history, using physical gesture to convey musical intent and expressions. Conducting relies on visual communications to direct the ensemble as a coherent unit. The aim of this project is to capture and analyse the hand gestures of conducting in order to provide real-time, interactive multimodal feedback in a number of application contexts including visualisation. This paper presents the design and development of the interface involving hardware sensors and software analysis modules, and discusses the application of visualisation for conducting. The paper concludes with latest findings, future directions and the impact the research may have outside the realm of gesture communication application.

Conference

Publication date: July 2012

Publication date (Print): July 2012

Pages: 229-236

Affiliations

ICSRiM – University of Leeds,

School of Electronic and Electrical Engineering, School of Music & School of Computing,

Leeds LS2 9JT, UK

mconduct@ 123456icsrim.org.uk , www.icsrim.org.uk

Article

DOI: 10.14236/ewic/EVA2012.39

Copyright statement: © Joanne Armitage et al. Published by BCS Learning and Development Ltd. Electronic Visualisation and the Arts (EVA 2012), London, UK

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Electronic Visualisation and the Arts (EVA 2012)

Conference acronym: EVA

Conference number:

Conference location: London, UK

Conference date: 10 - 12 July 2012

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Electronic Visualisation and the Arts

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/EVA2012.39

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing