English
Related papers

Related papers: EMP-EVAL: A Framework for Measuring Empathy in Ope…

200 papers

Empathetic conversational models have been shown to improve user satisfaction and task outcomes in numerous domains. In Psychology, persona has been shown to be highly correlated to personality, which in turn influences empathy. In…

Computation and Language · Computer Science 2020-11-20 Peixiang Zhong , Chen Zhang , Hao Wang , Yong Liu , Chunyan Miao

Building a reliable and automated evaluation metric is a necessary but challenging problem for open-domain dialogue systems. Recent studies proposed evaluation metrics that assess generated responses by considering their relevance to…

Computation and Language · Computer Science 2024-07-19 ChaeHun Park , Minseok Choi , Dohyun Lee , Jaegul Choo

Reliable automatic evaluation of dialogue systems under an interactive environment has long been overdue. An ideal environment for evaluating dialog systems, also known as the Turing test, needs to involve human interaction, which is…

Computation and Language · Computer Science 2021-09-23 Haoming Jiang , Bo Dai , Mengjiao Yang , Tuo Zhao , Wei Wei

Expressing empathy is important in everyday conversations, and exploring how empathy arises is crucial in automatic response generation. Most previous approaches consider only a single factor that affects empathy. However, in practice,…

Computation and Language · Computer Science 2022-12-06 Yangbin Chen , Chunfeng Liang

End-to-end Spoken Language Models (SLMs) hold great potential for paralinguistic perception, and numerous studies have aimed to enhance their capabilities, particularly for empathetic dialogue. However, current approaches largely depend on…

Computation and Language · Computer Science 2026-01-27 Yuhang Jia , Pei Liu , Haoqin Sun , Jiaming Zhou , Xuxin Cheng , Cao Liu , Ke Zeng , Xunliang Cai , Yong Qin

This paper describes EmoRAG, a system designed to detect perceived emotions in text for SemEval-2025 Task 11, Subtask A: Multi-label Emotion Detection. We focus on predicting the perceived emotions of the speaker from a given text snippet,…

Computation and Language · Computer Science 2025-06-06 Lev Morozov , Aleksandr Mogilevskii , Alexander Shirnin

In this paper, we introduce EmpBot: an end-to-end empathetic chatbot. Empathetic conversational agents should not only understand what is being discussed, but also acknowledge the implied feelings of the conversation partner and respond…

Computation and Language · Computer Science 2021-11-02 Emmanouil Zaranis , Georgios Paraskevopoulos , Athanasios Katsamanis , Alexandros Potamianos

Empathy is an important characteristic to be considered when building a more intelligent and humanized dialogue agent. However, existing methods did not fully comprehend empathy as a complex process involving three aspects: cognition,…

Computation and Language · Computer Science 2023-02-23 Pan Gao , Donghong Han , Rui Zhou , Xuejiao Zhang , Zikun Wang

Empathetic response from the therapist is key to the success of clinical psychotherapy, especially motivational interviewing. Previous work on computational modelling of empathy in motivational interviewing has focused on offline,…

Computation and Language · Computer Science 2021-05-21 Zixiu Wu , Rim Helaoui , Vivek Kumar , Diego Reforgiato Recupero , Daniele Riboni

Achieving empathy is a crucial step toward humanized dialogue systems. Current approaches for empathetic dialogue generation mainly perceive an emotional label to generate an empathetic response conditioned on it, which simply treat…

Computation and Language · Computer Science 2023-11-28 Fengyi Fu , Lei Zhang , Quan Wang , Zhendong Mao

Empathetic dialogue is a human-like behavior that requires the perception of both affective factors (e.g., emotion status) and cognitive factors (e.g., cause of the emotion). Besides concerning emotion status in early work, the latest…

Computation and Language · Computer Science 2023-02-24 Yushan Qian , Bo Wang , Ting-En Lin , Yinhe Zheng , Ying Zhu , Dongming Zhao , Yuexian Hou , Yuchuan Wu , Yongbin Li

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue that two issues must be tackled at the same time: (i)…

Computation and Language · Computer Science 2021-09-22 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

Evaluating persona-aligned empathy in LLM-based dialogue agents remains challenging. User states are latent, feedback is sparse and difficult to verify in situ, and seemingly supportive turns can still accumulate into trajectories that…

Artificial Intelligence · Computer Science 2026-03-17 Shiya Zhang , Yuhan Zhan , Ruixi Su , Ruihan Sun , Ziyi Song , Zhaohan Chen , Xiaofan Zhang

Understanding speaker's feelings and producing appropriate responses with emotion connection is a key communicative skill for empathetic dialogue systems. In this paper, we propose a simple technique called Affective Decoding for empathetic…

Computation and Language · Computer Science 2021-10-18 Chengkun Zeng , Guanyi Chen , Chenghua Lin , Ruizhe Li , Zhigang Chen

A humanized dialogue system is expected to generate empathetic replies, which should be sensitive to the users' expressed emotion. The task of empathetic dialogue generation is proposed to address this problem. The essential challenges lie…

Computation and Language · Computer Science 2020-11-24 Qintong Li , Hongshen Chen , Zhaochun Ren , Pengjie Ren , Zhaopeng Tu , Zhumin Chen

While the automatic evaluation of omni-modal large models (OLMs) is essential, assessing empathy remains a significant challenge due to its inherent affectivity. To investigate this challenge, we introduce AEQ-Bench (Audio Empathy Quotient…

Computation and Language · Computer Science 2026-01-16 Xuan Luo , Lewei Yao , Libo Zhao , Lanqing Hong , Kai Chen , Dehua Tao , Daxin Tan , Ruifeng Xu , Jing Li

Evaluating open-domain dialogue systems is difficult due to the diversity of possible correct answers. Automatic metrics such as BLEU correlate weakly with human annotations, resulting in a significant bias across different models and…

Computation and Language · Computer Science 2020-04-02 Nouha Dziri , Ehsan Kamalloo , Kory W. Mathewson , Osmar Zaiane

Empathy is a cognitive and emotional reaction to an observed situation of others. Empathy has recently attracted interest because it has numerous applications in psychology and AI, but it is unclear how different forms of empathy (e.g.,…

Computation and Language · Computer Science 2022-05-26 Damilola Omitaomu , Shabnam Tafreshi , Tingting Liu , Sven Buechel , Chris Callison-Burch , Johannes Eichstaedt , Lyle Ungar , João Sedoc

This paper presents the computational details of our emotion model, EEGS, and also provides an overview of a three-stage validation methodology used for the evaluation of our model, which can also be applicable for other computational…

Artificial Intelligence · Computer Science 2020-11-06 Suman Ojha , Jonathan Vitale , Mary-Anne Williams