AniMorph: Animation Driven Audio Mosaicing

This paper describes AniMorph a system for animation driven Concatenative Sound Synthesis (CSS). We can distinguish between two main application domains of CSS in the context of music technology: target sound re-synthesis, and free sound synthesis. The difference between these two categories is that in target sound re-synthesis the aim is to re-create a sound or a sound’s characteristics by providing audio examples (see Schwarz & Schnell 2010, Stevens et al. 2012), while free sound synthesis focuses on exploration of the audio corpus in order to synthesise novel sounds that do not necessarily resemble the features of another sound, for examples see (Comajuncosas 2011, Navab et al. 2014, Schwarz & Hackbarth 2012). The main motivation for the present investigation is to (i) develop appropriate models of interaction for efficient exploration of the audio corpus, and (ii) develop perceptually meaningful mappings to enable practitioners to create novel sounds using CSS by specify the perceptual characteristic of the sound that they want to synthesise in visual terms. The present research considers that it is of paramount importance to achieve an intuitive mapping in order to enable interaction with concatenative synthesis for creative purposes (e.g. sound design, electroacoustic composition, live performance). AniMorph builds on the software developed through an earlier system: Morpheme that uses sketching as a model for interaction (Tsiros 2013). To expand upon this work, we modified the existing interface in order to make it work with animation as user input.

Content

Author and article information

Contributors

Augoustinos Tsiros

Grágory Leplâtre

Conference

Publication date: July 2015

Publication date (Print): July 2015

Pages: 115-116

Affiliations

[0001]Centre for Interaction Design

Edinburgh Napier University

10 Colinton Road, EH10 5DT, UK

Article

DOI: 10.14236/ewic/eva2015.55

SO-VID: 77744ec0-65a3-48f6-9c45-91191fe1ec83

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Electronic Visualisation and the Arts (EVA 2015)

Conference acronym: EVA

Conference number:

Conference location: London, UK

Conference date: 7 & 9 July 2015

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Electronic Visualisation and the Arts

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/eva2015.55

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

J Comajuncosas 2011 Nuvolet: 3d gesture-driven collaborative audio mosaicing New Interfaces for Musical Expression
N NavabD NortVanS Wei 2014 A Material Computation Perspective on Audio Mosaicing and Gestural Conditioning New Interfaces for Musical Expression
D Schwarz 2004 Data-driven concatenative sound synthesis Universite Paris 6 France
D SchwarzB Hackbarth 2012 Navigating variation: composing for audio mosaicing International Computer Music Conference
D SchwarzN Schnell 2010 Descriptor-based sound texture sampling Sound and Music Computing Conference
S. A StevensL. J DougS Marschner 2012 Motion-driven concatenative synthesis of cloth sounds ACM Transactions on Graphics 31 4 1 10
A Tsiros 2013 A Multidimensional Sketching Interface for Corpus Based Concatenative Synthesis International Conference on Auditory Display

Comments

Comment on this article

[1] J Comajuncosas 2011 Nuvolet: 3d gesture-driven collaborative audio mosaicing New Interfaces for Musical Expression

[2] N NavabD NortVanS Wei 2014 A Material Computation Perspective on Audio Mosaicing and Gestural Conditioning New Interfaces for Musical Expression

[3] D Schwarz 2004 Data-driven concatenative sound synthesis Universite Paris 6 France

[4] D SchwarzB Hackbarth 2012 Navigating variation: composing for audio mosaicing International Computer Music Conference

[5] D SchwarzN Schnell 2010 Descriptor-based sound texture sampling Sound and Music Computing Conference

[6] S. A StevensL. J DougS Marschner 2012 Motion-driven concatenative synthesis of cloth sounds ACM Transactions on Graphics 31 4 1 10

[7] A Tsiros 2013 A Multidimensional Sketching Interface for Corpus Based Concatenative Synthesis International Conference on Auditory Display

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65