Complex Systems Models of Cognition for HCI

My research investigates dynamical systems models of human behaviour, evaluating these approaches for HCI research. I focus on how so-called interaction dominant (ID) dynamics in individual behaviour can be used to develop low cost an unobtrusive measures of skill learning, task-engagement, and executive function during interaction. ID dynamics are ubiquitous in human behaviour and indicate the central role of complex, nonlinear network effects. Changes in these ID dynamics have been related to high-level features of human behaviour and experience, many of which are of interest to HCI. I adapt this prior research to the conditions and concerns of HCI.

Content

Author and article information

Contributors

Daniel. T. Bennett

Conference

Publication date: July 2020

Publication date (Print): July 2020

Pages: 23-26

Affiliations

[0001]Faculty of Engineering

University of Bristol

Bristol, UK

Article

DOI: 10.14236/ewic/HCI20DC.4

SO-VID: 1813593a-1eb9-49db-9246-e0cbe5e764a0

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 33rd International BCS Human Computer Interaction Conference

Conference acronym: BCS HCI 2020

Conference number: 33

Conference location: Keele University, UK

Conference date: 6 July 2020

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI20DC.4

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

Alzayat AymanMark HancockMiguel A. Nacenta 2019 Quantitative Measurement of Tool Embodiment for Virtual Reality Input Alternatives Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems ACM 443
Jason R. AnastasDamian G. Kelty-StephenJames A. Dixon 2014 Executive Function as an Interaction-Dominant Process Ecological Psychology 26 4 Oct 2014 262 282 https://doi.org/10.1080/10407413.2014.957985
Matthew ChalmersAreti Galani 2004 Seamful Interweaving: Heterogeneity in the Theory and Design of Interactive Systems Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS ’04) ACM New York, NY, USA 243 252 https://doi.org/10.1145/1013115.1013149
Anthony Chemero 2013 Radical embodied cognitive science Review of General Psychology 17 2 2013 145 150 https://doi.org/10.1037/a0032923
James A. DixonJohn G. HoldenDaniel MirmanDamian G. Stephen 2012 Multifractal Dynamics in the Emergence of Cognitive Structure Topics in Cognitive Science 4 1 2012 51 62 https://doi.org/10.1111/j.1756-8765.2011.01162.x
Dobromir DotovLin NieKevin WojcikAnastasia JinksXiaoyu YuAnthony Chemero 2017 Cognitive and movement measures reflect the transition to presence-at-hand New Ideas in Psychology 45 April 2017 1 10 https://doi.org/10.1016/j.newideapsych.2017.01.001
Dobromir G. DotovLin NieAnthony Chemero 2010 A Demonstration of the Transition from Ready-to-Hand to Unreadyto-Hand PLoS ONE 5 3 March 2010 e9433 https://doi.org/10.1371/journal.pone.0009433
Paul Dourish 2004 Where the action is: the foundations of embodied interaction MIT press.
Kasper HornbækAntti Oulasvirta 2017 What Is Interaction? Proceedings of ACM Press 5040 5052 https://doi.org/10.1145/3025453.3025765
J. P. Huke 2006 Embedding Nonlinear Dynamical Systems: A Guide to Takens’ Theorem. http://eprints.maths.manchester.ac.uk/175/ ISSN: 1749-9097 Issue: 2006.26 Library Catalog: eprints.maths.manchester.ac.uk Number: 2006.26 Place: Manchester, UK Publisher: Manchester Institute for Mathematical Sciences, University of Manchester.
Espen AF IhlenBeatrix Vereijken 2010 Interaction-dominant dynamics in human cognition: Beyond 1/fα fluctuation. Journal of Experimental Psychology: General 139 3 2010 436
Alicia Juarrero 1999 Dynamics in action: intentional behavior as a complex system MIT Press, Cambridge, Mass.
Damian G. Kelty-StephenKinga PalatinusElliot SaltzmanJames A. Dixon 2013 A Tutorial on Multifractality, Cascades, and Interactivity for Empirical Time Series in Ecological Science Ecological Psychology 25 1 Jan 2013 1 62 https://doi.org/10.1080/10407413.2013.753804
Damian G. Kelty-StephenLeia A. StirlingLewis A. Lipsitz 2016 Multifractal temporal correlations in circle-tracing behaviors are associated with the executive function of ruleswitching assessed by the Trail Making Test Psychological Assessment 28 2 2016 171 180 https://doi.org/10.1037/pas0000177
D. Likens AaronK. Allen LauraS. McNamara Danielle 2017 Keystroke Dynamics Predict Essay Quality CogSci Cognitive Science Society 2573 2578
Aaron D. LikensPolemnia G. AmazeenRon StevensTrysha GallowayJamie C. Gorman 2014 Neural signatures of team coordination are revealed by multifractal analysis Social Neuroscience 9 3 May 2014 219 234 https://doi.org/10.1080/17470919.2014.882861
Aaron D. LikensJustin M. FineEric L. AmazeenPolemnia G. Amazeen 2015 Experimental control of scaling behavior: what is not fractal? Experimental Brain Research 233 10 Oct 2015 2813 2821 https://doi.org/10.1007/s00221-0154351-4
Darian MeachamMiguel Prado Casanova 2018 The Over-Extended Mind? Pink Noise and the Ethics of InteractionDominant Systems NanoEthics Nov 2018 https://doi.org/10.1007/s11569-018-0325-x
Carlos J. MoralesEric D. Kolaczyk 2002 Wavelet-based multifractal analysis of human balance Annals of biomedical engineering 30 4 2002 588 597
Tetsushi NonakaBlandine Bril 2014 Fractal dynamics in dexterous tool use: The case of hammering behavior of bead craftsmen Journal of Experimental Psychology: Human Perception and Performance 40 1 2014 218 231 https://doi.org/10.1037/a0033277
Ezequiel Di PaoloThomas BuhrmannXabier Barandiaran 2017 Sensorimotor Life: An enactive proposal Oxford University Press. Publication Title: Sensorimotor Life.
C. Van Orden GuyJohn G. HoldenMichael T. Turvey 2003 Self-organization of cognitive performance Journal of Experimental Psychology: General 132 3 2003 331 350 https://doi.org/10.1037/0096-3445.132.3.331
Sebastian WallotJoachim Grabowski 2013 Typewriting Dynamics: What Distinguishes Simple From Complex Writing Tasks? Ecological Psychology 25 3 July 2013 267 280 https://doi.org/10.1080/10407413.2013.810512
Sebastian WallotDamian G. Kelty-Stephen 2018 Interaction-Dominant Causation in Mind and Brain, and Its Implication for Questions of Generalization and Replication Minds and Machines 28 2 June 2018 353 374 https://doi.org/10.1007/s11023-017-9455-0
Lawrence M. Ward 2002 Dynamical cognitive science MIT press.
Mark Weiser 1991 The Computer for the 21 st Century Scientific american 265 3 1991 94 105
Michael Wheeler 2005 Reconstructing the cognitive world 5 Cambridge, Ma MIT Press
Michael Wheeler 2018 The reappearing tool: transparency, smart technology, and the extended mind AI & SOCIETY Feb. 2018 10 https://doi.org/10.1007/s00146-018-0824-x
Terry WinogradFernando FloresFernando F. Flores 1986 Understanding computers and cognition: A new foundation for design Intellect Books.

Comments

Comment on this article

[1] Alzayat AymanMark HancockMiguel A. Nacenta 2019 Quantitative Measurement of Tool Embodiment for Virtual Reality Input Alternatives Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems ACM 443

[2] Jason R. AnastasDamian G. Kelty-StephenJames A. Dixon 2014 Executive Function as an Interaction-Dominant Process Ecological Psychology 26 4 Oct 2014 262 282 https://doi.org/10.1080/10407413.2014.957985

[3] Matthew ChalmersAreti Galani 2004 Seamful Interweaving: Heterogeneity in the Theory and Design of Interactive Systems Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS ’04) ACM New York, NY, USA 243 252 https://doi.org/10.1145/1013115.1013149

[4] Anthony Chemero 2013 Radical embodied cognitive science Review of General Psychology 17 2 2013 145 150 https://doi.org/10.1037/a0032923

[5] James A. DixonJohn G. HoldenDaniel MirmanDamian G. Stephen 2012 Multifractal Dynamics in the Emergence of Cognitive Structure Topics in Cognitive Science 4 1 2012 51 62 https://doi.org/10.1111/j.1756-8765.2011.01162.x

[6] Dobromir DotovLin NieKevin WojcikAnastasia JinksXiaoyu YuAnthony Chemero 2017 Cognitive and movement measures reflect the transition to presence-at-hand New Ideas in Psychology 45 April 2017 1 10 https://doi.org/10.1016/j.newideapsych.2017.01.001

[7] Dobromir G. DotovLin NieAnthony Chemero 2010 A Demonstration of the Transition from Ready-to-Hand to Unreadyto-Hand PLoS ONE 5 3 March 2010 e9433 https://doi.org/10.1371/journal.pone.0009433

[8] Paul Dourish 2004 Where the action is: the foundations of embodied interaction MIT press.

[9] Kasper HornbækAntti Oulasvirta 2017 What Is Interaction? Proceedings of ACM Press 5040 5052 https://doi.org/10.1145/3025453.3025765

[10] J. P. Huke 2006 Embedding Nonlinear Dynamical Systems: A Guide to Takens’ Theorem. http://eprints.maths.manchester.ac.uk/175/ ISSN: 1749-9097 Issue: 2006.26 Library Catalog: eprints.maths.manchester.ac.uk Number: 2006.26 Place: Manchester, UK Publisher: Manchester Institute for Mathematical Sciences, University of Manchester.

[11] Espen AF IhlenBeatrix Vereijken 2010 Interaction-dominant dynamics in human cognition: Beyond 1/fα fluctuation. Journal of Experimental Psychology: General 139 3 2010 436

[12] Alicia Juarrero 1999 Dynamics in action: intentional behavior as a complex system MIT Press, Cambridge, Mass.

[13] Damian G. Kelty-StephenKinga PalatinusElliot SaltzmanJames A. Dixon 2013 A Tutorial on Multifractality, Cascades, and Interactivity for Empirical Time Series in Ecological Science Ecological Psychology 25 1 Jan 2013 1 62 https://doi.org/10.1080/10407413.2013.753804

[14] Damian G. Kelty-StephenLeia A. StirlingLewis A. Lipsitz 2016 Multifractal temporal correlations in circle-tracing behaviors are associated with the executive function of ruleswitching assessed by the Trail Making Test Psychological Assessment 28 2 2016 171 180 https://doi.org/10.1037/pas0000177

[15] D. Likens AaronK. Allen LauraS. McNamara Danielle 2017 Keystroke Dynamics Predict Essay Quality CogSci Cognitive Science Society 2573 2578

[16] Aaron D. LikensPolemnia G. AmazeenRon StevensTrysha GallowayJamie C. Gorman 2014 Neural signatures of team coordination are revealed by multifractal analysis Social Neuroscience 9 3 May 2014 219 234 https://doi.org/10.1080/17470919.2014.882861

[17] Aaron D. LikensJustin M. FineEric L. AmazeenPolemnia G. Amazeen 2015 Experimental control of scaling behavior: what is not fractal? Experimental Brain Research 233 10 Oct 2015 2813 2821 https://doi.org/10.1007/s00221-0154351-4

[18] Darian MeachamMiguel Prado Casanova 2018 The Over-Extended Mind? Pink Noise and the Ethics of InteractionDominant Systems NanoEthics Nov 2018 https://doi.org/10.1007/s11569-018-0325-x

[19] Carlos J. MoralesEric D. Kolaczyk 2002 Wavelet-based multifractal analysis of human balance Annals of biomedical engineering 30 4 2002 588 597

[20] Tetsushi NonakaBlandine Bril 2014 Fractal dynamics in dexterous tool use: The case of hammering behavior of bead craftsmen Journal of Experimental Psychology: Human Perception and Performance 40 1 2014 218 231 https://doi.org/10.1037/a0033277

[21] Ezequiel Di PaoloThomas BuhrmannXabier Barandiaran 2017 Sensorimotor Life: An enactive proposal Oxford University Press. Publication Title: Sensorimotor Life.

[22] C. Van Orden GuyJohn G. HoldenMichael T. Turvey 2003 Self-organization of cognitive performance Journal of Experimental Psychology: General 132 3 2003 331 350 https://doi.org/10.1037/0096-3445.132.3.331

[23] Sebastian WallotJoachim Grabowski 2013 Typewriting Dynamics: What Distinguishes Simple From Complex Writing Tasks? Ecological Psychology 25 3 July 2013 267 280 https://doi.org/10.1080/10407413.2013.810512

[24] Sebastian WallotDamian G. Kelty-Stephen 2018 Interaction-Dominant Causation in Mind and Brain, and Its Implication for Questions of Generalization and Replication Minds and Machines 28 2 June 2018 353 374 https://doi.org/10.1007/s11023-017-9455-0

[25] Lawrence M. Ward 2002 Dynamical cognitive science MIT press.

[26] Mark Weiser 1991 The Computer for the 21 st Century Scientific american 265 3 1991 94 105

[27] Michael Wheeler 2005 Reconstructing the cognitive world 5 Cambridge, Ma MIT Press

[28] Michael Wheeler 2018 The reappearing tool: transparency, smart technology, and the extended mind AI & SOCIETY Feb. 2018 10 https://doi.org/10.1007/s00146-018-0824-x

[29] Terry WinogradFernando FloresFernando F. Flores 1986 Understanding computers and cognition: A new foundation for design Intellect Books.

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65