Multimodal Interaction and Believability: How can we design and evaluate the next generation of IPA?

Believability of Intelligent personal assistants (IPA) has proven to be an important building block of successful human-agent interaction. Yet, only a handful of studies have focused on proposing and validating possible approaches to enhance such believability. We hypothesize that IPAs that are capable of handling multimodal interaction, such as facial expression and hand gestures, can appear more believable to human users. This paper illustrates reasons why such interaction can improve believability, in turn enhancing user’s interpersonal rapport with agent. It also discusses design of a study to evaluate believability in human-agent interactions.

Content

Author and article information

Contributors

Jiajia Li

Yeuk Yu Lee

Conference

Publication date: July 2017

Publication date (Print): July 2017

Pages: 1-4

Affiliations

[0001]Communication University of China

Beijing, China

[0002]Carnegie Mellon University

Pittsburgh, USA

Article

DOI: 10.14236/ewic/HCI2017.17

SO-VID: 132e929f-6cdc-44de-8af8-3a8b01b8ce10

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 31st International BCS Human Computer Interaction Conference (HCI 2017)

Conference acronym: HCI

Conference number: 31

Conference location: Sunderland, UK

Conference date: 3 - 6 July 2017

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: digital make-believe, with delegates considering our expansive

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2017.17

Self URI (journal page): https://ewic.bcs.org/

references

M AstridN C KrämerJ Gratch et al It doesn’t matter what you are! Explaining social effects of agents and avatars Computers in Human Behavior 2010 26 6 1641 1650
C BartneckT KandaH Ishiguro et al My robotic doppelgnger-A critical look at the uncanny valley,Robot and Human Interactive Communication 2009 ROMAN 2009 The 18th IEEE International Symposium 2009 269 276
J. Bates The role of emotion in believable agents Communications of the ACM 1994 37 7 122 125
N G CanbekM E. Mutlu On the track of Artificial Intelligence: Learning with Intelligent Personal Assistants Journal of Human Sciences 2016 13 1 592 601
J. Cassell Embodied conversational agents MIT press 2000 29
J GratchS Marsella Social emotions in nature and artifact Oxford University Press 2013
J GratchN WangJ Gerten et al Creating rapport with virtual agents, International Workshop on Intelligent Virtual Agents Springer Berlin Heidelberg 2007 125 138
L HuangL P MorencyJ. Gratch Virtual Rapport 2.0 International Workshop on Intelligent Virtual Agents Springer Berlin Heidelberg 2011 68 79
K Isbister Nass C Consistency of Personality in Interactive Characters: Verbal Cues, NonVerbal Cues, and User Characteristics International Journal of Human- Computer Studies 53 2000 251 267
M MoriK F MacDormanN. Kageki The uncanny valley [from the field] IEEE Robotics Automation Magazine 2012 19 2 98 100
C NassK IsbisterE J. Lee Truth is beauty: Researching embodied conversational agents Embodied conversational agents 2000 374 402
B ReevesC. Nass The media equation: how people treat computers, television, new media like real people places Computers and Mathematics with Applications 1997 5 33 7
L. Tickle-DegnenR. Rosenthal The Nature of Rapport and its Nonverbal Correlates Psychological Inquiry 1 4 285 293 1990
R ZhaoA PapangelisJ. Cassell Towards a dyadic computational model of rapport management for human-virtual agent interaction International Conference on Intelligent Virtual Agents Springer International Publishing 2014 514 527
R ZhaoT SinhaA W Black et al Socially-aware virtual agents: Automatically assessing dyadic rapport from temporal patterns of behaviour International Conference on Intelligent Virtual Agents Springer International Publishing 2016 218 233

Comments

Comment on this article

[1] M AstridN C KrämerJ Gratch et al It doesn’t matter what you are! Explaining social effects of agents and avatars Computers in Human Behavior 2010 26 6 1641 1650

[2] C BartneckT KandaH Ishiguro et al My robotic doppelgnger-A critical look at the uncanny valley,Robot and Human Interactive Communication 2009 ROMAN 2009 The 18th IEEE International Symposium 2009 269 276

[3] J. Bates The role of emotion in believable agents Communications of the ACM 1994 37 7 122 125

[4] N G CanbekM E. Mutlu On the track of Artificial Intelligence: Learning with Intelligent Personal Assistants Journal of Human Sciences 2016 13 1 592 601

[5] J. Cassell Embodied conversational agents MIT press 2000 29

[6] J GratchS Marsella Social emotions in nature and artifact Oxford University Press 2013

[7] J GratchN WangJ Gerten et al Creating rapport with virtual agents, International Workshop on Intelligent Virtual Agents Springer Berlin Heidelberg 2007 125 138

[8] L HuangL P MorencyJ. Gratch Virtual Rapport 2.0 International Workshop on Intelligent Virtual Agents Springer Berlin Heidelberg 2011 68 79

[9] K Isbister Nass C Consistency of Personality in Interactive Characters: Verbal Cues, NonVerbal Cues, and User Characteristics International Journal of Human- Computer Studies 53 2000 251 267

[10] M MoriK F MacDormanN. Kageki The uncanny valley [from the field] IEEE Robotics Automation Magazine 2012 19 2 98 100

[11] C NassK IsbisterE J. Lee Truth is beauty: Researching embodied conversational agents Embodied conversational agents 2000 374 402

[12] B ReevesC. Nass The media equation: how people treat computers, television, new media like real people places Computers and Mathematics with Applications 1997 5 33 7

[13] L. Tickle-DegnenR. Rosenthal The Nature of Rapport and its Nonverbal Correlates Psychological Inquiry 1 4 285 293 1990

[14] R ZhaoA PapangelisJ. Cassell Towards a dyadic computational model of rapport management for human-virtual agent interaction International Conference on Intelligent Virtual Agents Springer International Publishing 2014 514 527

[15] R ZhaoT SinhaA W Black et al Socially-aware virtual agents: Automatically assessing dyadic rapport from temporal patterns of behaviour International Conference on Intelligent Virtual Agents Springer International Publishing 2016 218 233

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65