This paper presents an overview of a system for the acquisition and analysis of a conductor’s hand gesture. Multiple wiimotes are used to capture 3D position and 3D acceleration data which describe the movements. These are then analysed and fed back to the user using sonification and visualisation. An alternative method for using wiimotes to track 3D position is implemented; data segmentation, three analysis modules and a sonification method are also described. Whilst primarily designed with conducting in mind, the system described should provide a highly useful tool in a study of all forms of musical expression through gesture.
Author and article information
ICSRiM - University of Leeds
School of Computing & School of Music
Leeds LS2 9JT