English
Related papers

Related papers: SentEmojiBot: Empathising Conversations Generation…

200 papers

With the development of speech large language models (speech LLMs), users can now interact directly with assistants via speech. However, most existing models only convert response content into speech without fully capturing the rich…

Computation and Language · Computer Science 2025-09-18 Haoyu Wang , Guangyan Zhang , Jiale Chen , Jingyu Li , Yuehai Wang , Yiwen Guo

Understanding emotions and responding accordingly is one of the biggest challenges of dialog systems. This paper presents EmpTransfo, a multi-head Transformer architecture for creating an empathetic dialog system. EmpTransfo utilizes…

Computation and Language · Computer Science 2020-03-09 Rohola Zandie , Mohammad H. Mahoor

The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the…

Computation and Language · Computer Science 2022-03-31 Yunlong Liang , Fandong Meng , Ying Zhang , Jinan Xu , Yufeng Chen , Jie Zhou

Existing emotion-aware conversational models usually focus on controlling the response contents to align with a specific emotion class, whereas empathy is the ability to understand and concern the feelings and experience of others. Hence,…

Computation and Language · Computer Science 2021-05-26 Yanran Li , Ke Li , Hongke Ning , xiaoqiang Xia , Yalong Guo , Chen Wei , Jianwei Cui , Bin Wang

Several works have developed end-to-end pipelines for generating lip-synced talking faces with various real-world applications, such as teaching and language translation in videos. However, these prior works fail to create realistic-looking…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sahil Goyal , Shagun Uppal , Sarthak Bhagat , Yi Yu , Yifang Yin , Rajiv Ratn Shah

In the realm of human-AI dialogue, the facilitation of empathetic responses is important. Validation is one of the key communication techniques in psychology, which entails recognizing, understanding, and acknowledging others' emotional…

Computation and Language · Computer Science 2024-02-21 Zi Haur Pang , Yahui Fu , Divesh Lala , Keiko Ochi , Koji Inoue , Tatsuya Kawahara

Graphical emoji are ubiquitous in modern-day online conversations. So is a single thumbs-up emoji able to signify an agreement, without any words. We argue that the current state-of-the-art systems are ill-equipped to correctly interpret…

Computation and Language · Computer Science 2019-10-31 Pieter Delobelle , Bettina Berendt

A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches on this topic mainly…

Computation and Language · Computer Science 2023-02-02 Sahand Sabour , Chujie Zheng , Minlie Huang

Emojis, which encapsulate semantics beyond mere words or phrases, have become prevalent in social network communications. This has spurred increasing scholarly interest in exploring their attributes and functionalities. However,…

Computation and Language · Computer Science 2025-04-08 Yuhang Zhou , Paiheng Xu , Xiyao Wang , Xuan Lu , Ge Gao , Wei Ai

Conversational agents are increasingly used as support tools along mental therapeutic pathways with significant societal impacts. In particular, empathy is a key non-functional requirement in therapeutic contexts, yet current chatbot…

Computation and Language · Computer Science 2026-01-14 Francesco Dettori , Matteo Forasassi , Lorenzo Veronese , Livia Lestingi , Vincenzo Scotti , Matteo Giovanni Rossi

As chatbots are becoming increasingly popular, we often wonder what users perceive as natural and socially accepted manners of interacting with them. Some researchers maintain that humans should avoid engaging in emotional conversations…

Human-Computer Interaction · Computer Science 2020-09-18 Ekaterina Svikhnushina , Pearl Pu

Emotion dynamics modeling is a significant task in emotion recognition in conversation. It aims to predict conversational emotions when building empathetic dialogue systems. Existing studies mainly develop models based on Recurrent Neural…

Artificial Intelligence · Computer Science 2021-04-22 Haiqin Yang , Jianping Shen

A natural conversational interface that allows longitudinal symptom tracking would be extremely valuable in health/wellness applications. However, the task of designing emotionally-aware agents for behavior change is still poorly…

Human-Computer Interaction · Computer Science 2019-07-26 Asma Ghandeharioun , Daniel McDuff , Mary Czerwinski , Kael Rowan

Achieving empathy is a crucial step toward humanized dialogue systems. Current approaches for empathetic dialogue generation mainly perceive an emotional label to generate an empathetic response conditioned on it, which simply treat…

Computation and Language · Computer Science 2023-11-28 Fengyi Fu , Lei Zhang , Quan Wang , Zhendong Mao

Since the late 1990s when speech companies began providing their customer-service software in the market, people have gotten used to speaking to machines. As people interact more often with voice and gesture controlled machines, they expect…

Computation and Language · Computer Science 2016-05-16 Pascale Fung , Dario Bertero , Yan Wan , Anik Dey , Ricky Ho Yin Chan , Farhad Bin Siddique , Yang Yang , Chien-Sheng Wu , Ruixi Lin

Generating appropriate emotions for responses is essential for dialog systems to provide human-like interaction in various application scenarios. Most previous dialog systems tried to achieve this goal by learning empathetic manners from…

Computation and Language · Computer Science 2024-04-12 Zhiyuan Wen , Jiannong Cao , Jiaxing Shen , Ruosong Yang , Shuaiqi Liu , Maosong Sun

With the explosive growth of social media, opinionated postings with emojis have increased explosively. Many emojis are used to express emotions, attitudes, and opinions. Emoji representation learning can be helpful to improve the…

Computation and Language · Computer Science 2022-05-24 Xiaowei Yuan , Jingyuan Hu , Xiaodan Zhang , Honglei Lv

Automated dialogue systems are important applications of artificial intelligence, and traditional systems struggle to understand user emotions and provide empathetic feedback. This study integrates emotional intelligence technology into…

Artificial Intelligence · Computer Science 2024-04-30 Jin Wang , JinFei Wang , Shuying Dai , Jiqiang Yu , Keqin Li

Computer-mediated communication has become more important than face-to-face communication in many contexts. Tracking emotional dynamics in chat conversations can enhance communication, improve services, and support well-being in various…

Computation and Language · Computer Science 2024-10-23 Ayan Igali , Abdulkhak Abdrakhman , Yerdaut Torekhan , Pakizar Shamoi

Emotions are an essential element in verbal communication, so understanding individuals' affect during a human-robot interaction (HRI) becomes imperative. This paper investigates the application of vision transformer models, namely ViT…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-18 Ruchik Mishra , Andrew Frye , Madan Mohan Rayguru , Dan O. Popa