English
Related papers

Related papers: Empathetic Response in Audio-Visual Conversations …

200 papers

Navigating certain communication situations can be challenging due to individuals' lack of skills and the interference of strong emotions. However, effective learning opportunities are rarely accessible. In this work, we conduct a…

Human-Computer Interaction · Computer Science 2024-02-21 Inna Wanyin Lin , Ashish Sharma , Christopher Michael Rytting , Adam S. Miner , Jina Suh , Tim Althoff

Towards human-like dialogue systems, current emotional dialogue approaches jointly model emotion and semantics with a unified neural network. This strategy tends to generate safe responses due to the mutual restriction between emotion and…

Computation and Language · Computer Science 2024-10-02 Yushan Qian , Bo Wang , Shangzhao Ma , Wu Bin , Shuo Zhang , Dongming Zhao , Kun Huang , Yuexian Hou

Existing retrieval-based methods have made significant strides in maintaining long-term conversations. However, these approaches face challenges in memory database management and accurate memory retrieval, hindering their efficacy in…

Computation and Language · Computer Science 2024-07-02 Nuo Chen , Hongguang Li , Juhua Huang , Baoyuan Wang , Jia Li

Direct Preference Optimization (DPO) is widely utilized in the Reinforcement Learning from Human Feedback (RLHF) phase to align Large Language Models (LLMs) with human preferences, thereby enhancing both their harmlessness and efficacy.…

Machine Learning · Computer Science 2024-12-02 Wei Liu , Yang Bai , Chengcheng Han , Rongxiang Weng , Jun Xu , Xuezhi Cao , Jingang Wang , Xunliang Cai

Integrating human feedback to align text-to-speech (TTS) system outputs with human preferences has proven to be an effective approach for enhancing the robustness of language model-based TTS systems. Current approaches primarily focus on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-29 Jixun Yao , Yuguang Yang , Yu Pan , Yuan Feng , Ziqian Ning , Jianhao Ye , Hongbin Zhou , Lei Xie

Chatbots are intelligent conversational computer systems designed to mimic human conversation to enable automated online guidance and support. The increased benefits of chatbots led to their wide adoption by many industries in order to…

Computation and Language · Computer Science 2022-01-19 Guendalina Caldarini , Sardar Jaf , Kenneth McGarry

One challenge for dialogue agents is to recognize feelings of the conversation partner and respond accordingly. In this work, RoBERTa-GPT2 is proposed for empathetic dialogue generation, where the pre-trained auto-encoding RoBERTa is…

Computation and Language · Computer Science 2021-09-08 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes

Two-view correspondence learning aims to discern true and false correspondences between image pairs by recognizing their underlying different information. Previous methods either treat the information equally or require the explicit storage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiang Fang , Shihua Zhang , Hao Zhang , Tao Lu , Huabing Zhou , Jiayi Ma

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

In human conversations, due to their personalities in mind, people can easily carry out and maintain the conversations. Giving conversational context with persona information to a chatbot, how to exploit the information to generate diverse…

Artificial Intelligence · Computer Science 2019-05-30 Haoyu Song , Wei-Nan Zhang , Yiming Cui , Dong Wang , Ting Liu

Large Language Models (LLMs) often experience performance degradation during long-running interactions due to increasing context length, memory saturation, and computational overhead. This paper presents an adaptive context compression…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Payal Fofadiya , Sunil Tiwari

In empathetic conversations, individuals express their empathy towards others. Previous work has mainly focused on generating empathetic responses by utilizing the speaker's emotion. Besides, external commonsense knowledge has been applied…

Computation and Language · Computer Science 2023-06-09 Hua Cai , Xuli Shen , Qing Xu , Weilin Shen , Xiaomei Wang , Weifeng Ge , Xiaoqing Zheng , Xiangyang Xue

Chatbots are intelligent software built to be used as a replacement for human interaction. Existing studies typically do not provide enough support for low-resource languages like Bangla. Due to the increasing popularity of social media, we…

Computation and Language · Computer Science 2021-10-14 Fahim Shahriar Khan , Mueeze Al Mushabbir , Mohammad Sabik Irbaz , MD Abdullah Al Nasim

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Long-horizon decision-making tasks present significant challenges for LLM-based agents due to the need for extensive planning over multiple steps. In this paper, we propose a hierarchical framework that decomposes complex tasks into…

Machine Learning · Computer Science 2024-10-07 Qi Zhao , Haotian Fu , Chen Sun , George Konidaris

This work shows how to improve and interpret the commonly used dual encoder model for response suggestion in dialogue. We present an attentive dual encoder model that includes an attention mechanism on top of the extracted word-level…

Computation and Language · Computer Science 2020-03-12 Yitong Li , Dianqi Li , Sushant Prakash , Peng Wang

We propose ChatGPT-EDSS, an empathetic dialogue speech synthesis (EDSS) method using ChatGPT for extracting dialogue context. ChatGPT is a chatbot that can deeply understand the content and purpose of an input prompt and appropriately…

Sound · Computer Science 2023-05-24 Yuki Saito , Shinnosuke Takamichi , Eiji Iimori , Kentaro Tachibana , Hiroshi Saruwatari

We present STUDIES, a new speech corpus for developing a voice agent that can speak in a friendly manner. Humans naturally control their speech prosody to empathize with each other. By incorporating this "empathetic dialogue" behavior into…

Dialogue engines that incorporate different types of agents to converse with humans are popular. However, conversations are dynamic in the sense that a selected response will change the conversation on-the-fly, influencing the subsequent…

Computation and Language · Computer Science 2020-05-08 Asir Saeed , Khai Mai , Pham Minh , Nguyen Tuan Duc , Danushka Bollegala