1,870
views
0
recommends
+1 Recommend
1 collections
    4
    shares

      Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65

      scite_
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      Media Skills Training Intervention Based on Automated Recognition of Human Emotion and Non-Verbal Behaviour

      proceedings-article
      1
      Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI)
      Human Computer Interaction Conference
      4 - 6 July 2018
      Social Signals, Training, Automated Affect Technology, Non-verbal Behaviour
      Bookmark

            Abstract

            Across multiple sectors training programmes aim to help learners improve their communication skills. It is well recognised that non-verbal ‘social signals’ play an important role in communication effectiveness. Previous research in the social signalling domain meticulously observed hours of videos and conducted observational studies to identify these social signals. This resulted in subjective inferences about human emotions. The aim of the current research is to investigate whether social signals can be detected and trained using automated technology in a person-to-person training context in three stages; exploratory stage, feedback design stage and an experimental stage. This research will allow trainers to provide objective feedback to trainees about their performance with a clear criterion. This research will also explore the best way to feedback signals detected and whether this is effective and actionable. Further long-term benefits of this research might contribute to the eventual development of a training avatar.

            Content

            Author and article information

            Contributors
            Conference
            July 2018
            July 2018
            : 1-8
            Affiliations
            [0001]Brunel University London Kingston Lane, London, Uxbridge UB8 3PH
            Article
            10.14236/ewic/HCI2018.190
            262aad2f-dc0b-4297-a3a7-5949b788e949
            © Pereira. Published by BCS Learning and Development Ltd.Proceedings of British HCI 2018. Belfast, UK.

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Proceedings of the 32nd International BCS Human Computer Interaction Conference
            HCI
            32
            Belfast, UK
            4 - 6 July 2018
            Electronic Workshops in Computing (eWiC)
            Human Computer Interaction Conference
            History
            Product

            1477-9358 BCS Learning & Development

            Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.190
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Electronic Workshops in Computing

            Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction
            Social Signals,Training,Automated Affect Technology,Non-verbal Behaviour

            REFERENCES

            1. 1966 ‘The Intraclass Correlation Coefficient as a Measure of Reliability’ Psychological Reports SAGE Publications Sage CA Los Angeles, CA 19 1 3 11

            2. 1992 ‘Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving’ Human Factors: The Journal of the Human Factors and Ergonomics Society 34 5 513 533

            3. 1996 ‘SUS - A quick and dirty usability scale’ Usability Evaluation in Industry 189 194 4 7

            4. 1989 ‘The effects of facial control and facial mimicry on subjective reactions to comedy routines’ Motivation and Emotion 13 1 31 52

            5. 2005 ‘Linguistic functions of head nods’ in Proc. Conf. Multi--modal Communication 137 152

            6. 1966 ‘Sound film analysis of normal and pathological behavior patterns’ Journal of Nervous and Mental Disease 143 4 338 347

            7. 1992 ‘Facial expressions of emotion: New findings, new questions’ Psychological science SAGE Publications Sage CA Los Angeles, CA 3 1 34 38

            8. 1982 ‘False, felt, and miserable smiles’ Journal of Nonverbal Behavior 6 4 238 258

            9. 1972 ‘Hand Movements’ Journal of Communication Oxford University Press 22 4 353 374

            10. 1978 The Facial Action Coding System: a technique for the measurement of facial movement Consulting Psychologists San Francisco

            11. 1994 ‘Discourse Strategies of Competent Communicators: Selected Cohesive and Linguistic Devices’ Research on Language and Social Interaction 27 2 145 170

            12. 1996 ‘GPOWER: A general power analysis program’ Behavior Research Methods, Instruments, & Computers 28 1 1 11

            13. 2010 Introduction to Communication Studies Routledge

            14. 1969 ‘The Hidden Dimension?: man’s use of space in public and in private’ Anchor Books New York 217

            15. 2011 ‘Executing Facial Control During Deception Situations’ Journal of Nonverbal Behavior 35 2 119 131

            16. 2004 Gesture: Visible action as utterance Cambridge Cambridge University Press

            17. 2013 ‘Usability Ratings for Everyday Products Measured with the System Usability Scale’ International Journal of Human-Computer Interaction Taylor & Francis Group 29 2 67 76

            18. 2003 ‘The global k-means clustering algorithm’ Pattern Recognition. Pergamon 36 2 451 461

            19. 1975 ‘Linear Prediction: A Tutorial Review’ Proceedings of the IEEE. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education 63 4 561 580

            20. 1976 ‘Gaze and mutual gaze’ Behaviour Research and Therapy 14 6 486

            21. 1992 Hand and Mind Chicago Chicago Press

            22. 2015 ‘Automated Analysis and Prediction of Job Interview Performance’ IEEE Transactions on Affective Computing 1 14

            23. 1987 ‘Towards a Cognitive Theory of Emotions’, Cognition and Emotion 1 1 29 50

            24. 2008 Honest Signals: How They Shape Our World Cambridge, Massachusetts MIT Press

            25. 2011 ‘Social signals: A psychological perspective’ in Computer Analysis of Human Behaviour London Springer 185 225

            26. 1989 ‘Coping with Human Errors through System-Design - Implications for Ecological Interface Design’ International Journal of Man-Machine Studies 31 5 517 534

            27. 2007 ‘CSRS, the Conversational Skills Rating Scale: An Instructional Assessment of Interpersonal Competence’ NCA, National Communication Association

            28. 2015 Media Interview Techniques: A complete guide ot media training London Kogan Page

            29. 2015 ‘The nonverbal communication of emotions’ Current Opinion in Behavioral Sciences 3 25 30

            30. 2014 ‘The Ecology of Human-Machine Systems 11: Mediating "Direct Perception" in Complex Work Domains’ Ecological Psychology 2 3 207 249

            31. 2009 ‘Social signal processing: Survey of an emergin domain’ Image and Vision Computing 27 November 2008 1743 1759

            32. 1992 ‘Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough?’ Human Factors: The Journal of the Human Factors and Ergonomics Society SAGE PublicationsSage CA Los Angeles, CA 34 4 457 468

            33. 2000 ‘Detecting deceit via analysis of verbal and nonverbal behavior’ Ray Bull Journal of Nonverbal Behavior Winter 24 4

            34. 1991 ‘The Cognitive Engineering of Problem Representations’ (eds) Human-Computer Interaction and Complex Systems London Academic 169 188

            Comments

            Comment on this article