English
Related papers

Related papers: Empathetic Response in Audio-Visual Conversations …

200 papers

Perception and expression of emotion are key factors to the success of dialogue systems or conversational agents. However, this problem has not been studied in large-scale conversation generation so far. In this paper, we propose Emotional…

Computation and Language · Computer Science 2018-06-04 Hao Zhou , Minlie Huang , Tianyang Zhang , Xiaoyan Zhu , Bing Liu

Work on retrieval-based chatbots, like most sequence pair matching tasks, can be divided into Cross-encoders that perform word matching over the pair, and Bi-encoders that encode the pair separately. The latter has better performance,…

Computation and Language · Computer Science 2019-11-07 Amir Vakili Tahami , Azadeh Shakery

Concept-based explanation methods aim at making machine learning models more transparent by finding the most important semantic features of an input (e.g., colors, patterns, shapes) for a given prediction task. However, these methods…

Machine Learning · Computer Science 2025-10-02 Jacopo Teneggi , Zhenzhen Wang , Paul H. Yi , Tianmin Shu , Jeremias Sulam

While current emotional support dialogue systems typically rely on expert-defined scalar rewards for alignment, these signals suffer from severe information sparsity. They cannot explain why a response failed or how to adapt to dynamic user…

Artificial Intelligence · Computer Science 2026-03-20 Jing Ye , Xinpei Zhao , Lu Xiang , Yaping Zhang , Chengqing Zong

Conformer and Mamba have achieved strong performance in speech modeling but face limitations in speaker diarization. Mamba is efficient but struggles with local details and nonlinear patterns. Conformer's self-attention incurs high memory…

Sound · Computer Science 2026-01-28 Zhen Liao , Gaole Dai , Mengqiao Chen , Wenqing Cheng , Wei Xu

Preference optimization is a standard approach to fine-tuning large language models to align with human preferences. The quantity, diversity, and representativeness of the preference dataset are critical to the effectiveness of preference…

Computation and Language · Computer Science 2025-09-18 Yuu Jinnai , Ukyo Honda

Empathy is an important characteristic to be considered when building a more intelligent and humanized dialogue agent. However, existing methods did not fully comprehend empathy as a complex process involving three aspects: cognition,…

Computation and Language · Computer Science 2023-02-23 Pan Gao , Donghong Han , Rui Zhou , Xuejiao Zhang , Zikun Wang

Many applications of large language models (LLMs), ranging from chatbots to creative writing, require nuanced subjective judgments that can differ significantly across different groups. Existing alignment algorithms can be expensive to…

Machine Learning · Computer Science 2024-10-16 Siyan Zhao , John Dang , Aditya Grover

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Multimodal speech emotion recognition aims to detect speakers' emotions from audio and text. Prior works mainly focus on exploiting advanced networks to model and fuse different modality information to facilitate performance, while…

Computation and Language · Computer Science 2023-04-11 Zhen Wu , Yizhe Lu , Xinyu Dai

In collaboration with Postpartum Support International (PSI), a non-profit organization dedicated to supporting caregivers with postpartum mood and anxiety disorders, we developed three chatbots to provide context-specific empathetic…

Computation and Language · Computer Science 2023-08-16 Xuewen Yao , Miriam Mikhelson , S. Craig Watkins , Eunsol Choi , Edison Thomaz , Kaya de Barbaro

Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tasks and contexts. In this work, we introduce a novel…

Human-Computer Interaction · Computer Science 2025-11-06 Erfan Shayegani , Jina Suh , Andy Wilson , Nagu Rangan , Javier Hernandez

Advances in machine intelligence have enabled conversational interfaces that have the potential to radically change the way humans interact with machines. However, even with the progress in the abilities of these agents, there remain…

Human-Computer Interaction · Computer Science 2019-10-17 Deepali Aneja , Rens Hoegen , Daniel McDuff , Mary Czerwinski

Improving the emotional awareness of pre-trained language models is an emerging important problem for dialogue generation tasks. Although prior studies have introduced methods to improve empathetic dialogue generation, few have discussed…

Computation and Language · Computer Science 2023-02-06 Yiren Liu , Halil Kilicoglu

Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-place conversation…

Computation and Language · Computer Science 2021-03-18 Juntao Li , Chang Liu , Chongyang Tao , Zhangming Chan , Dongyan Zhao , Min Zhang , Rui Yan

One challenge for evaluating current sequence- or dialogue-level chatbots, such as Empathetic Open-domain Conversation Models, is to determine whether the chatbot performs in an emotionally consistent way. The most recent work only…

Computation and Language · Computer Science 2021-12-06 Chenxiao Liu , Guanzhi Deng , Tao Ji , Difei Tang , Silai Zheng

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

Computation and Language · Computer Science 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Previous research on empathetic dialogue systems has mostly focused on generating responses given certain emotions. However, being empathetic not only requires the ability of generating emotional responses, but more importantly, requires…

Computation and Language · Computer Science 2019-08-22 Zhaojiang Lin , Andrea Madotto , Jamin Shin , Peng Xu , Pascale Fung

Empathy involves understanding other people's situation, perspective, and feelings. In clinical interactions, it helps clinicians establish rapport with a patient and support patient-centered care and decision making. Understanding…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-03 Zhuohao Chen , James Gibson , Ming-Chang Chiu , Qiaohong Hu , Tara K Knight , Daniella Meeker , James A Tulsky , Kathryn I Pollak , Shrikanth Narayanan

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi