LIVeMotion: A Multi-Sensory System to Encourage the Awareness of Mindfulness

For stress management and well-being, there are many approaches that require heightened awareness of different bodily motions. Based on psychological studies of physiological response to music, LIVeMotion integrates a range of multimedia technologies, exploring several different sensor measurements to monitor external and internal “motions”. Sensor data analysis and feature detections are mapped to visualisation and sonification feedback to enhance awareness of one’s consciousness of bodily movement. With a brief background on the relationship between stress, music, physiology, and related literature, this paper discusses design considerations and development. Using several specific Use Cases, the paper demonstrates different application scenarios with the proposed system.

Content

Author and article information

Conference

Publication date: July 2015

Publication date (Print): July 2015

Pages: 24-31

Affiliations

[0001]Interdisciplinary Centre for Scientific Research in Music (ICSRIM)

University of Leeds

[0002]School of Electronic and Electrical Engineering, School of Music and School of Computing

Leeds LS2 9JT, UK

livemotion@icsrim.org.uk, www.icsrim.org.uk

Article

DOI: 10.14236/ewic/eva2015.2

SO-VID: 085588ec-cbdc-41c4-aa71-cb10161a8a1e

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Electronic Visualisation and the Arts (EVA 2015)

Conference acronym: EVA

Conference number:

Conference location: London, UK

Conference date: 7 & 9 July 2015

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Electronic Visualisation and the Arts

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/eva2015.2

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

American Psychological Association 2015 The State-Trait Anxiety Inventory (STAI) http://www.apa.org/pi/about/publications/caregivers/practice-settings/assessment/tools/trait-state.aspx 19 03 2015
Anon 30 Magical Zen Gardens – Architecture Art Designs http://www.architectureartdesigns.com/30-magical-zen-gardens/ 20 March 2015
D. L Bartlett 1996 Physiological responses to music and sound stimuli Handbook of music psychology 2 343 385
L Bernardi 2000 Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability Journal of the American College of Cardiology 35 1462 1469
B BrethertonK NgL Windsor 2015 Tempo and autonomic control of the heart Proceedings of EVA 2015, Electronic Visualisation and the Arts, British Computer Society, 2015
S Chafin 2004 Music can facilitate blood pressure recovery from stress British journal of health psychology 9 3 393 403
S Davies https://www.gov.uk/government/news/cmos-annual-report-employment-is-good-for-mental-health 11 03 2015
X Ding 2015 Short-term meditation modulates brain activity of insight evoked with solution cue Social cognitive and affective neuroscience 10 1 43 49
M Donnarumma 2012 Music for Flesh II: informing interactive music performance with the viscerality of the body system Proceedings of the International Conference on New Interfaces for Musical Expression Ann Arbor, Michigan University of Michigan
M DonnarummaB CaramiauxA Tanaka 2013 Muscular Interactions Combining EMG and MMG sensing for musical practice Proceedings of the International Conference on New Interfaces for Musical Expression Seoul, South Korea
B Florentino-LiañoN O’MahonyA ArtésRodríguez 2012 Human Activity Recognition Using Inertial Sensors with Invariance to Sensor Orientation 23rd International Workshop on Cognitive Information Processing (CIP) 2012p1 6
R. M Gerard 1958 Differential effects of colored lights on psychophysiological functions PhD diss., University of California Los Angeles
S Le GrouxP. F. M. J Verschure 2009 Situated Interactive Music System: Connecting Mind and Body Through Musical Interaction Proceedings of the International Computer Music Conference 2009
K. W JacobsJ. F Suess 1975 Effects of four psychological primary colors on anxiety state Perceptual and motor skills 41 1 207 210
J Kabat-Zinn 1982 An outpatient program in behavioral medicine for chronic pain patients based on the practice of mindfulness meditation: Theoretical considerations and preliminary results General hospital psychiatry 4 1 33 47
J Kabat-Zinn 1998 Influence of a mindfulness meditation-based stress reduction intervention on rates of skin clearing in patients with moderate to severe psoriasis undergoing photo therapy (UVB) and photochemotherapy (PUVA) Psychosomatic medicine 60 5 625 632
S Khalfa 2002 Event-related skin conductance responses to musical emotions in humans Neuroscience Letters 328 145 149
R. B KnappH. S Lusted 1990 A bioelectric controller for computer music applications Computer Music Journal 14 42 47
T KobayashiK HasidaN Otsu 2011 Rotation invariant feature extraction from 3-D acceleration signals IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2011 3684 3687
R. S Lazarus 2006 Stress and emotion: A new synthesis Springer Publishing Company
R. S LazarusS Folkman 1984 Stress, Appraisal, and Coping Springer Publishing Company
O. K. A Lee 2005 Music and its effect on the physiological responses and anxiety levels of patients receiving mechanical ventilation: a pilot study Journal of Clinical Nursing 14 5 609– 620
J LeonardK Ng 2011 Music via Motion: A distributed framework for interactive multimedia performance DMSp7 8
J Lewinski 1938 An investigation of individual responses to chromatic illumination The Journal of Psychology 6no. 1 155 160
L.-O Lundqvist 2008 Emotional responses to music: experience, expression, and physiology Psychology of Music 37 1 61 90
S. Z MahmoodabadiA AhmadianM. D Abolhasani 2005 ECG feature extraction using Daubechies wavelets Proceedings of the fifth IASTED International conference on Visualization, Imaging and Image Processing 2005p343 348
L. E Marks 1974 On associations of light and sound: The mediation of brightness, pitch, and loudness The American journal of psychology 173 188
G McCaigS Fels 2002 Playing on Heart-Strings: Experiences with the 2Hearts System New Intruments for Musical Expression (NIME), 2002
M Melchior 2007 Work stress precipitates depression and anxiety in young, working women and men Psychological medicine 37 8 1119 29
M MuravenR. F Baumeister 2000 Self-regulation and depletion of limited resources: Does self-control resemble a muscle? Psychological bulletin 126 2p.247
K Ng 2002 Sensing and mapping for interactive performance Organised Sound 7 2 19 20
K Ng 2004 Music via motion: transdomain mapping of motion and sound for interactive performances Proceedings of the IEEE 92 4 645 655
K Ng 2011 Interactive multimedia for technology-enhanced learning with multimodal feedback Musical Robots and Interactive Multimodal Systemsp105 126
U Nilsson 2008 The anxiety-and pain-reducing effects of music interventions: a systematic review AORN journal 87 4 780 807
L. G PetersonL Pbert 1992 Effectiveness of a meditation-based stress reduction program in the treatment of anxiety disorders Am J Psychiatry 149 936 943
M Radstaak 2014 Music and Psychophysiological Recovery from Stress Psychosomatic medicine 76 7 529 537
R SahooS Sethi 2015 Functional analysis of mental stress based on physiological data of GSR sensor Emerging ICT for Bridging the Future-Proceedings of the 49th Annual Convention of the Computer Society of India (CSI) 1 Springerp109 117
P Sanches 2010 Mind the body!: designing a mobile stress management application encouraging personal reflection Proceedings of the 8th ACM Conference on Designing Interactive Systemsp47 56
H Selye 2013 Stress in Health and Disease Elsevier Science
Swedish ICT Research Institutes https://www.swedishict.se/ 18 March 2015
Y Tang 2015 Short-term meditation increases blood flow in anterior cingulate cortex and insula Frontiers in Psychology 6p.212
Y Tang 2007 Short-term meditation training improves attention and self-regulation Proceedings of the National Academy of Sciences of the United States of America 104 43 17152 6
J VidyarthiB. E Riecke 2014 Interactively mediating experiences of mindfulness meditation International Journal of Human-Computer Studies 72 8-9 674 688
J VidyarthiB. E RieckeD Gromala 2012 Sonic Cradle Proceedings of the Designing Interactive Systems Conference on – DIS ’12 New York, New York, USA ACM Pressp. 408
M. V VillarejoB. G ZapirainA. M Zorrilla 2012 A stress sensor based on galvanic skin response (GSR) controlled by ZigBee Sensors (Switzerland) 12 6075 6101
D Wilson 1966 Arousal properties of red versus green. Perceptual and motor skills 23 3 947 949
G. H ZimnyE. W Weidenfeller 1963 Effects of Music upon GSR and Heart-Rate The American Journal of Psychology 76 2 311 314

Comments

Comment on this article

[1] American Psychological Association 2015 The State-Trait Anxiety Inventory (STAI) http://www.apa.org/pi/about/publications/caregivers/practice-settings/assessment/tools/trait-state.aspx 19 03 2015

[2] Anon 30 Magical Zen Gardens – Architecture Art Designs http://www.architectureartdesigns.com/30-magical-zen-gardens/ 20 March 2015

[3] D. L Bartlett 1996 Physiological responses to music and sound stimuli Handbook of music psychology 2 343 385

[4] L Bernardi 2000 Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability Journal of the American College of Cardiology 35 1462 1469

[5] B BrethertonK NgL Windsor 2015 Tempo and autonomic control of the heart Proceedings of EVA 2015, Electronic Visualisation and the Arts, British Computer Society, 2015

[6] S Chafin 2004 Music can facilitate blood pressure recovery from stress British journal of health psychology 9 3 393 403

[7] S Davies https://www.gov.uk/government/news/cmos-annual-report-employment-is-good-for-mental-health 11 03 2015

[8] X Ding 2015 Short-term meditation modulates brain activity of insight evoked with solution cue Social cognitive and affective neuroscience 10 1 43 49

[9] M Donnarumma 2012 Music for Flesh II: informing interactive music performance with the viscerality of the body system Proceedings of the International Conference on New Interfaces for Musical Expression Ann Arbor, Michigan University of Michigan

[10] M DonnarummaB CaramiauxA Tanaka 2013 Muscular Interactions Combining EMG and MMG sensing for musical practice Proceedings of the International Conference on New Interfaces for Musical Expression Seoul, South Korea

[11] B Florentino-LiañoN O’MahonyA ArtésRodríguez 2012 Human Activity Recognition Using Inertial Sensors with Invariance to Sensor Orientation 23rd International Workshop on Cognitive Information Processing (CIP) 2012p1 6

[12] R. M Gerard 1958 Differential effects of colored lights on psychophysiological functions PhD diss., University of California Los Angeles

[13] S Le GrouxP. F. M. J Verschure 2009 Situated Interactive Music System: Connecting Mind and Body Through Musical Interaction Proceedings of the International Computer Music Conference 2009

[14] K. W JacobsJ. F Suess 1975 Effects of four psychological primary colors on anxiety state Perceptual and motor skills 41 1 207 210

[15] J Kabat-Zinn 1982 An outpatient program in behavioral medicine for chronic pain patients based on the practice of mindfulness meditation: Theoretical considerations and preliminary results General hospital psychiatry 4 1 33 47

[16] J Kabat-Zinn 1998 Influence of a mindfulness meditation-based stress reduction intervention on rates of skin clearing in patients with moderate to severe psoriasis undergoing photo therapy (UVB) and photochemotherapy (PUVA) Psychosomatic medicine 60 5 625 632

[17] S Khalfa 2002 Event-related skin conductance responses to musical emotions in humans Neuroscience Letters 328 145 149

[18] R. B KnappH. S Lusted 1990 A bioelectric controller for computer music applications Computer Music Journal 14 42 47

[19] T KobayashiK HasidaN Otsu 2011 Rotation invariant feature extraction from 3-D acceleration signals IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2011 3684 3687

[20] R. S Lazarus 2006 Stress and emotion: A new synthesis Springer Publishing Company

[21] R. S LazarusS Folkman 1984 Stress, Appraisal, and Coping Springer Publishing Company

[22] O. K. A Lee 2005 Music and its effect on the physiological responses and anxiety levels of patients receiving mechanical ventilation: a pilot study Journal of Clinical Nursing 14 5 609– 620

[23] J LeonardK Ng 2011 Music via Motion: A distributed framework for interactive multimedia performance DMSp7 8

[24] J Lewinski 1938 An investigation of individual responses to chromatic illumination The Journal of Psychology 6no. 1 155 160

[25] L.-O Lundqvist 2008 Emotional responses to music: experience, expression, and physiology Psychology of Music 37 1 61 90

[26] S. Z MahmoodabadiA AhmadianM. D Abolhasani 2005 ECG feature extraction using Daubechies wavelets Proceedings of the fifth IASTED International conference on Visualization, Imaging and Image Processing 2005p343 348

[27] L. E Marks 1974 On associations of light and sound: The mediation of brightness, pitch, and loudness The American journal of psychology 173 188

[28] G McCaigS Fels 2002 Playing on Heart-Strings: Experiences with the 2Hearts System New Intruments for Musical Expression (NIME), 2002

[29] M Melchior 2007 Work stress precipitates depression and anxiety in young, working women and men Psychological medicine 37 8 1119 29

[30] M MuravenR. F Baumeister 2000 Self-regulation and depletion of limited resources: Does self-control resemble a muscle? Psychological bulletin 126 2p.247

[31] K Ng 2002 Sensing and mapping for interactive performance Organised Sound 7 2 19 20

[32] K Ng 2004 Music via motion: transdomain mapping of motion and sound for interactive performances Proceedings of the IEEE 92 4 645 655

[33] K Ng 2011 Interactive multimedia for technology-enhanced learning with multimodal feedback Musical Robots and Interactive Multimodal Systemsp105 126

[34] U Nilsson 2008 The anxiety-and pain-reducing effects of music interventions: a systematic review AORN journal 87 4 780 807

[35] L. G PetersonL Pbert 1992 Effectiveness of a meditation-based stress reduction program in the treatment of anxiety disorders Am J Psychiatry 149 936 943

[36] M Radstaak 2014 Music and Psychophysiological Recovery from Stress Psychosomatic medicine 76 7 529 537

[37] R SahooS Sethi 2015 Functional analysis of mental stress based on physiological data of GSR sensor Emerging ICT for Bridging the Future-Proceedings of the 49th Annual Convention of the Computer Society of India (CSI) 1 Springerp109 117

[38] P Sanches 2010 Mind the body!: designing a mobile stress management application encouraging personal reflection Proceedings of the 8th ACM Conference on Designing Interactive Systemsp47 56

[39] H Selye 2013 Stress in Health and Disease Elsevier Science

[40] Swedish ICT Research Institutes https://www.swedishict.se/ 18 March 2015

[41] Y Tang 2015 Short-term meditation increases blood flow in anterior cingulate cortex and insula Frontiers in Psychology 6p.212

[42] Y Tang 2007 Short-term meditation training improves attention and self-regulation Proceedings of the National Academy of Sciences of the United States of America 104 43 17152 6

[43] J VidyarthiB. E Riecke 2014 Interactively mediating experiences of mindfulness meditation International Journal of Human-Computer Studies 72 8-9 674 688

[44] J VidyarthiB. E RieckeD Gromala 2012 Sonic Cradle Proceedings of the Designing Interactive Systems Conference on – DIS ’12 New York, New York, USA ACM Pressp. 408

[45] M. V VillarejoB. G ZapirainA. M Zorrilla 2012 A stress sensor based on galvanic skin response (GSR) controlled by ZigBee Sensors (Switzerland) 12 6075 6101

[46] D Wilson 1966 Arousal properties of red versus green. Perceptual and motor skills 23 3 947 949

[47] G. H ZimnyE. W Weidenfeller 1963 Effects of Music upon GSR and Heart-Rate The American Journal of Psychology 76 2 311 314

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65