1
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      EMP-EVAL: A Framework for Measuring Empathy in Open Domain Dialogues

      Preprint
      , ,

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Measuring empathy in conversation can be challenging, as empathy is a complex and multifaceted psychological construct that involves both cognitive and emotional components. Human evaluations can be subjective, leading to inconsistent results. Therefore, there is a need for an automatic method for measuring empathy that reduces the need for human evaluations. In this paper, we proposed a novel approach EMP-EVAL, a simple yet effective automatic empathy evaluation method. The proposed technique takes the influence of Emotion, Cognitive and Emotional empathy. To the best knowledge, our work is the first to systematically measure empathy without the human-annotated provided scores. Experimental results demonstrate that our metrics can correlate with human preference, achieving comparable results with human judgments.

          Related collections

          Author and article information

          Journal
          29 January 2023
          Article
          2301.12510
          73e22d57-60fc-4c99-95c5-40005aedf920

          http://creativecommons.org/licenses/by-nc-sa/4.0/

          History
          Custom metadata
          7 pages, 5 figures, 4 tables
          cs.AI

          Artificial intelligence
          Artificial intelligence

          Comments

          Comment on this article