English
Related papers

Related papers: FADO: Feedback-Aware Double COntrolling Network fo…

200 papers

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

End-to-end task-oriented dialogue (TOD) systems have achieved promising performance by leveraging sophisticated natural language understanding and natural language generation capabilities of pre-trained models. This work enables the TOD…

Computation and Language · Computer Science 2023-08-17 Jianguo Zhang , Stephen Roller , Kun Qian , Zhiwei Liu , Rui Meng , Shelby Heinecke , Huan Wang , Silvio Savarese , Caiming Xiong

Having engaging and informative conversations with users is the utmost goal for open-domain conversational systems. Recent advances in transformer-based language models and their applications to dialogue systems have succeeded to generate…

Computation and Language · Computer Science 2021-02-04 Sarik Ghazarian , Zixi Liu , Tuhin Chakrabarty , Xuezhe Ma , Aram Galstyan , Nanyun Peng

Empathetic speech dialogue requires not only understanding linguistic content but also perceiving rich paralinguistic information such as prosody, tone, and emotional intensity for affective understandings. Existing speech-to-speech large…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Zhuoyue Gao , Xiaohui Wang , Xiaocui Yang , Wen Zhang , Daling Wang , Shi Feng , Yifei Zhang

Despite remarkable advances in emotion recognition, they are severely restrained from either the essentially limited property of the employed single modality, or the synchronous presence of all involved multiple modalities. Motivated by…

Machine Learning · Computer Science 2019-07-25 Jing Han , Zixing Zhang , Zhao Ren , Björn Schuller

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

Applying existing methods to emotional support conversation -- which provides valuable assistance to people who are in need -- has two major limitations: (a) they generally employ a conversation-level emotion label, which is too…

Computation and Language · Computer Science 2022-04-01 Quan Tu , Yanran Li , Jianwei Cui , Bin Wang , Ji-Rong Wen , Rui Yan

The emotion recognition in conversation (ERC) task aims to predict the emotion label of an utterance in a conversation. Since the dependencies between speakers are complex and dynamic, which consist of intra- and inter-speaker dependencies,…

Computation and Language · Computer Science 2022-06-08 Yinan Bao , Qianwen Ma , Lingwei Wei , Wei Zhou , Songlin Hu

Multi-modal emotion recognition is challenging due to the difficulty of extracting features that capture subtle emotional differences. Understanding multi-modal interactions and connections is key to building effective bimodal speech…

Sound · Computer Science 2025-03-25 Jiachen Luo , Huy Phan , Lin Wang , Joshua D. Reiss

ECHO (Evaluation of Chat, Human behavior, and Outcomes) is an open research platform designed to support reproducible, mixed-method studies of human interaction with both conversational AI systems and Web search engines. It enables…

Human-Computer Interaction · Computer Science 2026-02-12 Jiqun Liu , Nischal Dinesh , Ran Yu

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

Emotion Support Conversation (ESC) is a crucial application, which aims to reduce human stress, offer emotional guidance, and ultimately enhance human mental and physical well-being. With the advancement of Large Language Models (LLMs),…

Computation and Language · Computer Science 2024-10-29 Haiquan Zhao , Lingyu Li , Shisong Chen , Shuqi Kong , Jiaan Wang , Kexin Huang , Tianle Gu , Yixu Wang , Wang Jian , Dandan Liang , Zhixu Li , Yan Teng , Yanghua Xiao , Yingchun Wang

Emotional Support Conversation (ESC) aims to provide empathetic and effective emotional assistance through dialogue, addressing the growing demand for mental health support. This paper presents our solution for the NLPCC 2025 Task 8 ESC…

Artificial Intelligence · Computer Science 2025-12-12 Shiquan Wang , Ruiyu Fang , Zhongjiang He , Shuangyong Song , Yongxiang Li

The objective of the Multiple Appropriate Facial Reaction Generation (MAFRG) task is to produce contextually appropriate and diverse listener facial behavioural responses based on the multimodal behavioural data of the conversational…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Guanyu Hu , Jie Wei , Siyang Song , Dimitrios Kollias , Xinyu Yang , Zhonglin Sun , Odysseus Kaloidas

Ensuring safe, comfortable, and efficient navigation is a critical goal for autonomous driving systems. While end-to-end models trained on large-scale datasets excel in common driving scenarios, they often struggle with rare, long-tail…

Controllable generation through Stable Diffusion (SD) fine-tuning aims to improve fidelity, safety, and alignment with human guidance. Existing reinforcement learning from human feedback methods usually rely on predefined heuristic reward…

This paper develops a persistently exciting input generating Online Feedback Optimization (OFO) controller that estimates the sensitivity of a process ensuring minimal deviations from the descent direction while converging. This eliminates…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Tore Gude , Marta Anna Zagorowska , Lars Struen Imsland

Conversational agents have traditionally been developed for either task-oriented dialogue (TOD) or open-ended chitchat, with limited progress in unifying the two. Yet, real-world conversations naturally involve fluid transitions between…

Computation and Language · Computer Science 2025-11-13 Yejin Yoon , Yuri Son , Namyoung So , Minseo Kim , Minsoo Cho , Chanhee Park , Seungshin Lee , Taeuk Kim

Understanding speaker's feelings and producing appropriate responses with emotion connection is a key communicative skill for empathetic dialogue systems. In this paper, we propose a simple technique called Affective Decoding for empathetic…

Computation and Language · Computer Science 2021-10-18 Chengkun Zeng , Guanyi Chen , Chenghua Lin , Ruizhe Li , Zhigang Chen

Document interpretation and dialog understanding are the two major challenges for conversational machine reading. In this work, we propose Discern, a discourse-aware entailment reasoning network to strengthen the connection and enhance the…

Computation and Language · Computer Science 2020-10-19 Yifan Gao , Chien-Sheng Wu , Jingjing Li , Shafiq Joty , Steven C. H. Hoi , Caiming Xiong , Irwin King , Michael R. Lyu