E-Bot: A Facial Recognition Based Human-Robot Emotion Detection System

Abstract

There are many Emotion Detection Systems which can understand emotion but are only present for monitoring purposes. Emotional Robots currently available predict emotion with low accuracy. Thus there is a requirement for Emotion Detection Robot which can predict emotion of user with high accuracy. The robot should converse with the user based on their emotion. It should be a companion for the user. In this paper we present the development of the E-Bot system, which enables human-robot interaction based on emotion detected from facial recognition. A mobile app is developed to control the robot and guide the chat. The Google Cloud Vision API and Pre-trained Facial Expression Algorithm are explored and the prediction accuracy, sensitivity and specificity of these two approaches are summarised in this paper. Results show that the proposed E-Bot system could be applied to provide affective care for people living alone at home.

Contributors

Rahul Sridhar

Haiying Wang

Patrick McAllister

Huiru Zheng

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

Indian Institute of Technology Dhanbad, Jharkhand, India

Ulster University Newtownabbey, Antrim, UK

Article

DOI: 10.14236/ewic/HCI2018.213

Copyright statement: © Sridhar et al. Published by BCS Learning and Development Ltd.Proceedings of British HCI 2018. Belfast, UK.

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.213

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing