User Centred Design of Social Signals Feedback for Communication Skills Training

Affective technologies enable the automatic recognition of human emotional expressions and non-verbal signals which play an important part in effective communication. This paper describes the use of user-centred design techniques to establish display designs suitable for feeding back recognised emotional and social signals to trainees during communication skills training. The channels of communication investigated are facial expression, hand gestures, voice emotion recognition and Pentland’s ‘honest signals’. Ease and understanding of the different feedback methods was assessed using System Usability Scale (SUS) and obtaining qualitative views using semi structured interviews. The SUS revealed that participants preferred consistency of feedback method over ease of understanding the method on initial exposure. The themes identified across all communication channels were comparison to good performance, scale considerations, value of visual display, guidance, explanations and temporal behaviour.

Content

Author and article information

Contributors

Monica Pereira

Federico Colecchia

Kate Hone

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

[0001]Brunel University London

Kingston Ln, London Uxbridge UB8 3PH

Article

DOI: 10.14236/ewic/HCI2018.207

SO-VID: 149e09cd-7e5d-4fd5-98f5-4f6322bed87d

Copyright statement: © Pereira et al. Published by BCS Learning and Development Ltd. Proceedings of British HCI 2018. Belfast, UK

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.207

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

A. BangorP. T. KortumJ. T. Miller 2008 An Empirical Evaluation of the System Usability Scale Journal of Human–Computer Interaction Intl. Journal of Human–Computer Interaction 24 6 574 594
K. B. BennettJ. M. Flach 1992 Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving Human Factors: The Journal of the Human Factors and Ergonomics Society 34 5 513 533
J. Brooke 1996 SUS - A quick and dirty usability scale Usability Evaluation in Industry 189 194 4 7
L. Cerrato 2005 Linguistic functions of head nods. In Proc. Conf. Multi--modal Communication 137 152
W. S. CondonW. D. Ogston 1966 Sound film analysis of normal and pathological behavior patterns Journal of Nervous and Mental Disease 143 4 338 347
P. Ekman 1992 An Argument for Basic Emotions Cognition and Emotion
P. EkmanW. V. Friesen 1972 Hand Movements Journal of Communication 22 4 353 374
P. EkmanW. V. Friesen 1978 The Facial Action Coding System 577 College Avenue, Palo Alto, California, 94306 Consulting Psychologists Press Inc.
J. Fiske 2010 Introduction to Communication Studies Routledge
E. Hall 1969 The Hidden Dimension?: man's use of space in public and in private Anchor Books 217
A. Kendon 2004 Gesture: Visible action as utterance Cambridge Cambridge University Press
M. L. KnappJ. A. HallT. G. Horgan 2013 Nonverbal communication in human interaction Cengage Learning
P. T. KortumA. Bangor 2013 Usability Ratings for Everyday Products Measured with the System Usability Scale International Journal of Human-Computer Interaction 29 2 67 76
J. S. Marzillier 1976 Gaze and mutual gaze Behaviour Research and Therapy 14 6 486
D. McNeill 1992 Hand and Mind Chicago Chicago Press
A. PentlandT. Heibeck 2010 Honest signals: how they shape our world MIT press
I. PoggiF. D'errico 2011 Social signals: A psychological perspective In Computer Analysis of Human Behaviour 185 225 London Springer
B. H. SpitzbergT. W. Adams 2007 CSRS, the Conversational Skills Rating Scale: An Instructional Assessment of Interpersonal Competence NCA, National Communication Association
K. J. VicenteJ. Rasmussen 2014 The Ecology of Human-Machine Systems 11: Mediating "Direct Perception" in Complex Work Domains Ecological Psychology 2 3 207 249
R. A. Virzi 1992 Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Human Factors: The Journal of the Human Factors and Ergonomics Society 34 4 457 468

Comments

Comment on this article

[1] A. BangorP. T. KortumJ. T. Miller 2008 An Empirical Evaluation of the System Usability Scale Journal of Human–Computer Interaction Intl. Journal of Human–Computer Interaction 24 6 574 594

[2] K. B. BennettJ. M. Flach 1992 Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving Human Factors: The Journal of the Human Factors and Ergonomics Society 34 5 513 533

[3] J. Brooke 1996 SUS - A quick and dirty usability scale Usability Evaluation in Industry 189 194 4 7

[4] L. Cerrato 2005 Linguistic functions of head nods. In Proc. Conf. Multi--modal Communication 137 152

[5] W. S. CondonW. D. Ogston 1966 Sound film analysis of normal and pathological behavior patterns Journal of Nervous and Mental Disease 143 4 338 347

[6] P. Ekman 1992 An Argument for Basic Emotions Cognition and Emotion

[7] P. EkmanW. V. Friesen 1972 Hand Movements Journal of Communication 22 4 353 374

[8] P. EkmanW. V. Friesen 1978 The Facial Action Coding System 577 College Avenue, Palo Alto, California, 94306 Consulting Psychologists Press Inc.

[9] J. Fiske 2010 Introduction to Communication Studies Routledge

[10] E. Hall 1969 The Hidden Dimension?: man's use of space in public and in private Anchor Books 217

[11] A. Kendon 2004 Gesture: Visible action as utterance Cambridge Cambridge University Press

[12] M. L. KnappJ. A. HallT. G. Horgan 2013 Nonverbal communication in human interaction Cengage Learning

[13] P. T. KortumA. Bangor 2013 Usability Ratings for Everyday Products Measured with the System Usability Scale International Journal of Human-Computer Interaction 29 2 67 76

[14] J. S. Marzillier 1976 Gaze and mutual gaze Behaviour Research and Therapy 14 6 486

[15] D. McNeill 1992 Hand and Mind Chicago Chicago Press

[16] A. PentlandT. Heibeck 2010 Honest signals: how they shape our world MIT press

[17] I. PoggiF. D'errico 2011 Social signals: A psychological perspective In Computer Analysis of Human Behaviour 185 225 London Springer

[18] B. H. SpitzbergT. W. Adams 2007 CSRS, the Conversational Skills Rating Scale: An Instructional Assessment of Interpersonal Competence NCA, National Communication Association

[19] K. J. VicenteJ. Rasmussen 2014 The Ecology of Human-Machine Systems 11: Mediating "Direct Perception" in Complex Work Domains Ecological Psychology 2 3 207 249

[20] R. A. Virzi 1992 Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Human Factors: The Journal of the Human Factors and Ergonomics Society 34 4 457 468

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65