English
Related papers

Related papers: MoEL: Mixture of Empathetic Listeners

200 papers

Understanding speaker's feelings and producing appropriate responses with emotion connection is a key communicative skill for empathetic dialogue systems. In this paper, we propose a simple technique called Affective Decoding for empathetic…

Computation and Language · Computer Science 2021-10-18 Chengkun Zeng , Guanyi Chen , Chenghua Lin , Ruizhe Li , Zhigang Chen

Multimodal empathetic response generation (MERG) aims to generate emotionally engaging and empathetic responses based on users' multimodal contexts. Existing approaches usually rely on an implicit one-pass generation paradigm from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Liping Wang , Cheng Ye , Weidong Chen , Peipei Song , Bo Hu , Zhendong Mao

Empathetic Conversational Systems (ECS) are built to respond empathetically to the user's emotions and sentiments, regardless of the application domain. Current ECS studies evaluation approaches are restricted to offline evaluation…

Computation and Language · Computer Science 2024-07-29 Aravind Sesagiri Raamkumar , Siyuan Brandon Loh

Neural network-based Open-ended conversational agents automatically generate responses based on predictive models learned from a large number of pairs of utterances. The generated responses are typically acceptable as a sentence but are…

Computation and Language · Computer Science 2019-05-16 Chenyang Huang , Osmar R. Zaïane

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

Software engineering (SE) requires developers to collaborate with stakeholders, and understanding their emotions and perspectives is often vital. Empathy is a concept characterising a person's ability to understand and share the feelings of…

Software Engineering · Computer Science 2024-01-18 Hashini Gunatilake , John Grundy , Rashina Hoda , Ingo Mueller

Effective feature representations play a critical role in enhancing the performance of text generation models that rely on deep neural networks. However, current approaches suffer from several drawbacks, such as the inability to capture the…

Computation and Language · Computer Science 2024-02-27 Omama Hamad , Ali Hamdi , Khaled Shaban

Generating appropriate emotions for responses is essential for dialog systems to provide human-like interaction in various application scenarios. Most previous dialog systems tried to achieve this goal by learning empathetic manners from…

Computation and Language · Computer Science 2024-04-12 Zhiyuan Wen , Jiannong Cao , Jiaxing Shen , Ruosong Yang , Shuaiqi Liu , Maosong Sun

Listener head generation centers on generating non-verbal behaviors (e.g., smile) of a listener in reference to the information delivered by a speaker. A significant challenge when generating such responses is the non-deterministic nature…

Graphics · Computer Science 2023-10-10 Luchuan Song , Guojun Yin , Zhenchao Jin , Xiaoyi Dong , Chenliang Xu

An important aspect of human conversation difficult for machines is conversing with empathy, which is to understand the user's emotion and respond appropriately. Recent neural conversation models that attempted to generate empathetic…

Computation and Language · Computer Science 2021-12-30 Jamin Shin , Peng Xu , Andrea Madotto , Pascale Fung

Empathetic dialogue is a human-like behavior that requires the perception of both affective factors (e.g., emotion status) and cognitive factors (e.g., cause of the emotion). Besides concerning emotion status in early work, the latest…

Computation and Language · Computer Science 2023-02-24 Yushan Qian , Bo Wang , Ting-En Lin , Yinhe Zheng , Ying Zhu , Dongming Zhao , Yuexian Hou , Yuchuan Wu , Yongbin Li

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue that two issues must be tackled at the same time: (i)…

Computation and Language · Computer Science 2021-09-22 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tasks and contexts. In this work, we introduce a novel…

Human-Computer Interaction · Computer Science 2025-11-06 Erfan Shayegani , Jina Suh , Andy Wilson , Nagu Rangan , Javier Hernandez

Emotion Recognition in Conversations (ERC) presents unique challenges, requiring models to capture the temporal flow of multi-turn dialogues and to effectively integrate cues from multiple modalities. We propose Mixture of Speech-Text…

Computation and Language · Computer Science 2026-02-27 Soumya Dutta , Smruthi Balaji , Sriram Ganapathy

Empathy requires perspective-taking: empathetic responses require a person to reason about what another has experienced and communicate that understanding in language. However, most NLP approaches to empathy do not explicitly model this…

Computation and Language · Computer Science 2024-05-03 Jiamin Yang , David Jurgens

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

Understanding emotions and responding accordingly is one of the biggest challenges of dialog systems. This paper presents EmpTransfo, a multi-head Transformer architecture for creating an empathetic dialog system. EmpTransfo utilizes…

Computation and Language · Computer Science 2020-03-09 Rohola Zandie , Mohammad H. Mahoor

Providing Emotional Support (ES) to soothe people in emotional distress is an essential capability in social interactions. Most existing researches on building ES conversation systems only considered single-turn interactions with users,…

Computation and Language · Computer Science 2022-10-11 Yi Cheng , Wenge Liu , Wenjie Li , Jiashuo Wang , Ruihui Zhao , Bang Liu , Xiaodan Liang , Yefeng Zheng

Measuring empathy in conversation can be challenging, as empathy is a complex and multifaceted psychological construct that involves both cognitive and emotional components. Human evaluations can be subjective, leading to inconsistent…

Artificial Intelligence · Computer Science 2023-01-31 Bushra Amjad , Muhammad Zeeshan , Mirza Omer Beg