Brain Controlled Cinema

This paper is a proposal for PhD level research into brain controlled film. I place brain computer interfaces (BCI) in a historic and then an artistic context before exploring instances of research where film and BCI overlap. I then define what has not been covered by research and propose a way to contribute to that gap in knowledge. I explain my interest in the subject, and the methodologies I plan to undertake in order to complete the research.

Content

Author and article information

Contributors

Richard Ramchurn

Conference

Publication date: July 2016

Publication date (Print): July 2016

Pages: 1-6

Affiliations

[0001]University of Nottingham

Nottingham, UK

Article

DOI: 10.14236/ewic/HCI2016.6

SO-VID: 4d3297e6-3f58-44b6-92ff-91efa5d51f17

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 30th International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 30

Conference location: Bournemouth University, Poole, UK

Conference date: 11 - 15 July 2016

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Fusion

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2016.6

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

D. Millett Hans Berger: from psychic energy to the EEG Perspect. Biol. Med., 44 4 522 542 2001
A. Connect Luciana Haill ICT & Art Connect : Revelations by Flicker , Dreamachines and Electroencephalographic signals in art, 2014
G. Walter The Living Brain Harmondsworth Penguin 1961
T. Conrad The Flicker [Online]. Available https://www.youtube.com/watch?v=ZJbqnztjkbs 04-May-2016
C. S. Herrmann Human EEG responses to 1-100 Hz flicker: Resonance phenomena in visual cortex and their potential correlation to cognitive phenomena Exp. Brain Res 137 3-4 346 353 2001
V. StraebelW. Thoben Alvin Lucier’s Music for Solo Performer: Experimental music beyond sonification Organised Sound 19 01 17 29 2014
R. A. MirandaW. D. CasebeerA. M. HeinJ. W. JudyE. P. KrotkovT. L. LaabsJ. E. ManzoK. G. PankratzG. A. PrattJ. C. SanchezD. J. WeberT. L. WheelerG. F. S. Ling DARPA-funded efforts in the development of novel brain-computer interface technologies J. Neurosci. Methods 244 52 67 2014
J. Vidal TOWARD DIRECT BRAIN-COMPUTER COMMUNICATION 1973
J. Vidal Toward direct brain-computer communication Annu. Re- view Biophys. Bioeng 2 1 157 180 1973
J. R. WolpawN. BirbaumerW. J. HeetderksD. J. McFarlandP. H. PeckhamG. SchalkE. DonchinL. A. QuatranoC. J. RobinsonT. M. Vaughan Brain-computer interface technology: a review of the first international meeting IEEE Trans. Rehabil. Eng 8 2 164 73 Jun 2000
D. Rosenboom Biofeedback and the Arts: Results of Early Experiments by David Rosenboom, Comput. Music J 13 3 86 88 1989
M. Mori Wave ufo Mariko Mori: Wave ufo Walter König 2003 43
Staalhemel | responsive environment for brainwaves [Online]. Available http://www.staalhemel.com/ 07-Mar-2016
xxxy The Ascent 2012 [Online]. Available http://theascent.co/ 22-Feb-2016
M. Abramovic Marina Abramović Neuroscience Experiment 1: Measuring The Magic of Mutual Gaze Garage Center For Contemporary Culture 2011 [Online]. Available http://abramovic.garageccc.com/en/works/10
E. EdmondsG. TurnerL. Candy Approaches to interactive art systems Proc. 2nd Int. Conf. Comput. Graph. Interact. Tech. Austalasia Southe East Asia Graph. 04 113 117 2004
B. Shneiderman Creating creativity: user interfaces for supporting innovation ACM Trans. Comput. Interact 7 1 114 138 2000
S. L. Simon Interactive Art, Autonomy and Evaluation L. CandyS. Ferguson Cham Springer International Publishing 2014 63 73
F. J. VarelaE. RoschE. Thompson The Embodied Mind The MIT Press 1991
V. GalleseM. Guerra Embodying movies: Embodied simulation and film studies Cine. J. Philos. Mov 3 183 210 2012
K. O’HaraA. SellenR. Harper Embodiment in brain-computer interaction Proc. 2011 Annu. Conf. Hum. factors Comput. Syst. - CHI ’11 353 2011
U. HassonA. A. GhazanfarB. GalantucciS. GarrodChristianKeysers Brain-to-Brain coupling: A mechanism for creating and sharing a social world Trends Cogn Sci 2012
L. SchilbachB. TimmermansV. ReddyA. CostallG. BenteT. SchlichtK. Vogeley Toward a second-person neuroscience Behav. Brain Sci 36 4 393 414 2013
V. GalleseA. Goldman Mirror neurons and the simulation theory of mind-reading Trends Cogn. Sci 2 12 493 501 1998
Brandon Keim WIRED Good Connection Really Does Lead to Mind Meld | WIRED [Online]. Available http://www.wired.com/2010/07/mind-meshing/ 22-Feb-2016
U. HassonO. LandesmanB. KnappmeyerI. VallinesN. RubinD. J. Heeger Neurocinematics: The neuroscience of film Projections 2 1 1 26 2008
U. HassonY. NirI. LevyG. FuhrmannR. Malach Intersubject synchronization of cortical activity during natural vision Science 303 1634 1640 2004
M. PikeR. RamchurnM. L. Wilson Two-way Affect Loops in Multimedia Experiences Proc. 2015 Br. HCI Conf 117 118 2015
P. ZiogaP. ChapmanM. MaeF. Pollick A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces 9090 S. GöbelM. MaJ. Baalsrud HaugeM. F. OliveiraJ. WiemeyerV. Wendel Cham Springer International Publishing 2015 103 113
P. TikkaA. VäljamäeA. W. de BorstR. PuglieseN. RavajaM. KaipainenT. Takala Enactive cinema paves way for understanding complex real-time social interaction in neuroimaging experiments Front. Hum. Neurosci 6 2012
D. Norman Emotion & design: attractive things work better Interactions 9 4 36 42 2002
G. HakvoortH. GürkökD. Plass-Oude BosM. ObbinkM. Poel Measuring immersion and affect in a brain-computer interface game Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics) 6946 LNCS 115 128 2011
S. MahlkeM. Thüring Studying antecedents of emotional experiences in interactive contexts Proc. SIGCHI Conf. Hum. factors Comput. Syst. - CHI ’07 915 918 2007
P. N. JuslinP. Laukka Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening J. New Music Res 33 3 217 238 2004
I. DalyA. MalikF. HwangE. RoeschJ. WeaverA. KirkeD. WilliamsE. MirandaS. J. Nasuto Neural correlates of emotional responses to music: An EEG study Neurosci. Lett 573 52 57 2014
BenfordS. GreenhalghC. CrabtreeA. FlinthamM. WalkerB. MarshallJ. KolevaB. EgglestoneS. R. GiannachiG. AdamsM. TandavanitjN. FarrJ. R. Performance-Led Research in the Wild ACM Trans. Comput. Interact 20 3 14:1 14:22 2013
R. Nelson Practice as Research in the Arts Palgrave Macmillan, a division of Macmillan Publishers Limited 2013
CandyL. AscottR. EdmondsE. A. Interacting: Art, Research and the Creative Practitioner April 2011 346 2011
L. CandyS. Ferguson Interactive Experience, Art and Evaluation L. Candy S. Ferguson Cham Springer International Publishing 2014 1 10
E. BjörgvinssonP. EhnP.-A. Hillgren Participatory design and ‘democratizing innovation,’ Proc. 11th Bienn. Particip. Des. Conf no. Ehn 1988 41 50 2010
TrifonovaA. JaccheriL. BergaustK. Software engineering issues in interactive installation art Int. J. Arts Technol 1 1 43 2008

Comments

Comment on this article

[1] D. Millett Hans Berger: from psychic energy to the EEG Perspect. Biol. Med., 44 4 522 542 2001

[2] A. Connect Luciana Haill ICT & Art Connect : Revelations by Flicker , Dreamachines and Electroencephalographic signals in art, 2014

[3] G. Walter The Living Brain Harmondsworth Penguin 1961

[4] T. Conrad The Flicker [Online]. Available https://www.youtube.com/watch?v=ZJbqnztjkbs 04-May-2016

[5] C. S. Herrmann Human EEG responses to 1-100 Hz flicker: Resonance phenomena in visual cortex and their potential correlation to cognitive phenomena Exp. Brain Res 137 3-4 346 353 2001

[6] V. StraebelW. Thoben Alvin Lucier’s Music for Solo Performer: Experimental music beyond sonification Organised Sound 19 01 17 29 2014

[7] R. A. MirandaW. D. CasebeerA. M. HeinJ. W. JudyE. P. KrotkovT. L. LaabsJ. E. ManzoK. G. PankratzG. A. PrattJ. C. SanchezD. J. WeberT. L. WheelerG. F. S. Ling DARPA-funded efforts in the development of novel brain-computer interface technologies J. Neurosci. Methods 244 52 67 2014

[8] J. Vidal TOWARD DIRECT BRAIN-COMPUTER COMMUNICATION 1973

[9] J. Vidal Toward direct brain-computer communication Annu. Re- view Biophys. Bioeng 2 1 157 180 1973

[10] J. R. WolpawN. BirbaumerW. J. HeetderksD. J. McFarlandP. H. PeckhamG. SchalkE. DonchinL. A. QuatranoC. J. RobinsonT. M. Vaughan Brain-computer interface technology: a review of the first international meeting IEEE Trans. Rehabil. Eng 8 2 164 73 Jun 2000

[11] D. Rosenboom Biofeedback and the Arts: Results of Early Experiments by David Rosenboom, Comput. Music J 13 3 86 88 1989

[12] M. Mori Wave ufo Mariko Mori: Wave ufo Walter König 2003 43

[13] Staalhemel | responsive environment for brainwaves [Online]. Available http://www.staalhemel.com/ 07-Mar-2016

[14] xxxy The Ascent 2012 [Online]. Available http://theascent.co/ 22-Feb-2016

[15] M. Abramovic Marina Abramović Neuroscience Experiment 1: Measuring The Magic of Mutual Gaze Garage Center For Contemporary Culture 2011 [Online]. Available http://abramovic.garageccc.com/en/works/10

[16] E. EdmondsG. TurnerL. Candy Approaches to interactive art systems Proc. 2nd Int. Conf. Comput. Graph. Interact. Tech. Austalasia Southe East Asia Graph. 04 113 117 2004

[17] B. Shneiderman Creating creativity: user interfaces for supporting innovation ACM Trans. Comput. Interact 7 1 114 138 2000

[18] S. L. Simon Interactive Art, Autonomy and Evaluation L. CandyS. Ferguson Cham Springer International Publishing 2014 63 73

[19] F. J. VarelaE. RoschE. Thompson The Embodied Mind The MIT Press 1991

[20] V. GalleseM. Guerra Embodying movies: Embodied simulation and film studies Cine. J. Philos. Mov 3 183 210 2012

[21] K. O’HaraA. SellenR. Harper Embodiment in brain-computer interaction Proc. 2011 Annu. Conf. Hum. factors Comput. Syst. - CHI ’11 353 2011

[22] U. HassonA. A. GhazanfarB. GalantucciS. GarrodChristianKeysers Brain-to-Brain coupling: A mechanism for creating and sharing a social world Trends Cogn Sci 2012

[23] L. SchilbachB. TimmermansV. ReddyA. CostallG. BenteT. SchlichtK. Vogeley Toward a second-person neuroscience Behav. Brain Sci 36 4 393 414 2013

[24] V. GalleseA. Goldman Mirror neurons and the simulation theory of mind-reading Trends Cogn. Sci 2 12 493 501 1998

[25] Brandon Keim WIRED Good Connection Really Does Lead to Mind Meld | WIRED [Online]. Available http://www.wired.com/2010/07/mind-meshing/ 22-Feb-2016

[26] U. HassonO. LandesmanB. KnappmeyerI. VallinesN. RubinD. J. Heeger Neurocinematics: The neuroscience of film Projections 2 1 1 26 2008

[27] U. HassonY. NirI. LevyG. FuhrmannR. Malach Intersubject synchronization of cortical activity during natural vision Science 303 1634 1640 2004

[28] M. PikeR. RamchurnM. L. Wilson Two-way Affect Loops in Multimedia Experiences Proc. 2015 Br. HCI Conf 117 118 2015

[29] P. ZiogaP. ChapmanM. MaeF. Pollick A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces 9090 S. GöbelM. MaJ. Baalsrud HaugeM. F. OliveiraJ. WiemeyerV. Wendel Cham Springer International Publishing 2015 103 113

[30] P. TikkaA. VäljamäeA. W. de BorstR. PuglieseN. RavajaM. KaipainenT. Takala Enactive cinema paves way for understanding complex real-time social interaction in neuroimaging experiments Front. Hum. Neurosci 6 2012

[31] D. Norman Emotion & design: attractive things work better Interactions 9 4 36 42 2002

[32] G. HakvoortH. GürkökD. Plass-Oude BosM. ObbinkM. Poel Measuring immersion and affect in a brain-computer interface game Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics) 6946 LNCS 115 128 2011

[33] S. MahlkeM. Thüring Studying antecedents of emotional experiences in interactive contexts Proc. SIGCHI Conf. Hum. factors Comput. Syst. - CHI ’07 915 918 2007

[34] P. N. JuslinP. Laukka Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening J. New Music Res 33 3 217 238 2004

[35] I. DalyA. MalikF. HwangE. RoeschJ. WeaverA. KirkeD. WilliamsE. MirandaS. J. Nasuto Neural correlates of emotional responses to music: An EEG study Neurosci. Lett 573 52 57 2014

[36] BenfordS. GreenhalghC. CrabtreeA. FlinthamM. WalkerB. MarshallJ. KolevaB. EgglestoneS. R. GiannachiG. AdamsM. TandavanitjN. FarrJ. R. Performance-Led Research in the Wild ACM Trans. Comput. Interact 20 3 14:1 14:22 2013

[37] R. Nelson Practice as Research in the Arts Palgrave Macmillan, a division of Macmillan Publishers Limited 2013

[38] CandyL. AscottR. EdmondsE. A. Interacting: Art, Research and the Creative Practitioner April 2011 346 2011

[39] L. CandyS. Ferguson Interactive Experience, Art and Evaluation L. Candy S. Ferguson Cham Springer International Publishing 2014 1 10

[40] E. BjörgvinssonP. EhnP.-A. Hillgren Participatory design and ‘democratizing innovation,’ Proc. 11th Bienn. Particip. Des. Conf no. Ehn 1988 41 50 2010

[41] TrifonovaA. JaccheriL. BergaustK. Software engineering issues in interactive installation art Int. J. Arts Technol 1 1 43 2008

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65