English
Related papers

Related papers: Empathy Omni: Enabling Empathetic Speech Response …

200 papers

Human acceptance of social robots is greatly effected by empathy and perceived understanding. This necessitates accurate and flexible responses to various input data from the user. While systems such as this can become increasingly complex…

Robotics · Computer Science 2024-12-31 Jordan Sinclair , Christopher Reardon

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

The integration of emotional support into various conversational scenarios presents profound societal benefits, such as social interactions, mental health counseling, and customer service. However, there are unsolved challenges that hinder…

Computation and Language · Computer Science 2023-08-23 Zhonghua Zheng , Lizi Liao , Yang Deng , Liqiang Nie

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human…

Artificial Intelligence · Computer Science 2023-07-31 Xuena Wang , Xueting Li , Zi Yin , Yue Wu , Liu Jia

Large Language Models' (LLMs) ability to converse naturally is empowered by their ability to empathetically understand and respond to their users. However, emotional experiences are shaped by demographic and cultural contexts. This raises…

Computation and Language · Computer Science 2025-10-28 Ananya Malik , Nazanin Sabri , Melissa Karnaze , Mai Elsherief

Real-time, intelligent, and natural speech interaction is an essential part of the next-generation human-computer interaction. Recent advancements have showcased the potential of building intelligent spoken chatbots based on large language…

Computation and Language · Computer Science 2025-05-06 Qingkai Fang , Yan Zhou , Shoutao Guo , Shaolei Zhang , Yang Feng

Empathetic response generation is increasingly significant in AI, necessitating nuanced emotional and cognitive understanding coupled with articulate response expression. Current large language models (LLMs) excel in response expression;…

Human-Computer Interaction · Computer Science 2024-02-20 Zhou Yang , Zhaochun Ren , Wang Yufeng , Shizhong Peng , Haizhou Sun , Xiaofei Zhu , Xiangwen Liao

Emotion recognition from speech is a challenging task that requires capturing both linguistic and paralinguistic cues, with critical applications in human-computer interaction and mental health monitoring. Recent works have highlighted the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Hugo Thimonier , Antony Perzo , Renaud Seguier

Recent advances in language models have achieved significant progress. GPT-4o, as a new milestone, has enabled real-time conversations with humans, demonstrating near-human natural fluency. Such human-computer interaction necessitates…

Artificial Intelligence · Computer Science 2024-11-06 Zhifei Xie , Changqiao Wu

Large language models (LLMs) excel at generating empathic responses in text-based conversations. But, how reliably do they judge the nuances of empathic communication? We investigate this question by comparing how experts, crowdworkers, and…

Computation and Language · Computer Science 2025-10-06 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Erina Farrell , Bruce Lambert , Matthew Groh

Affect recognition, encompassing emotions, moods, and feelings, plays a pivotal role in human communication. In the realm of conversational artificial intelligence, the ability to discern and respond to human affective cues is a critical…

Computation and Language · Computer Science 2024-08-06 Shutong Feng , Guangzhi Sun , Nurul Lubis , Wen Wu , Chao Zhang , Milica Gašić

A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches on this topic mainly…

Computation and Language · Computer Science 2023-02-02 Sahand Sabour , Chujie Zheng , Minlie Huang

The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tasks but also in emotion recognition in terms of accuracy,…

Computation and Language · Computer Science 2023-10-24 Liyizhe Peng , Zixing Zhang , Tao Pang , Jing Han , Huan Zhao , Hao Chen , Björn W. Schuller

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

Computation and Language · Computer Science 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Empathetic dialogue is crucial for natural human-computer interaction, allowing the dialogue system to respond in a more personalized and emotionally aware manner, improving user satisfaction and engagement. The emergence of large language…

Computation and Language · Computer Science 2025-01-22 Jingran Xie , Shun Lei , Yue Yu , Yang Xiang , Hui Wang , Xixin Wu , Zhiyong Wu

Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with…

Computation and Language · Computer Science 2026-03-06 Li Zhou , Lutong Yu , You Lyu , Yihang Lin , Zefeng Zhao , Junyi Ao , Yuhao Zhang , Benyou Wang , Haizhou Li

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling,…

Computation and Language · Computer Science 2023-11-02 Yirong Chen , Xiaofen Xing , Jingkai Lin , Huimin Zheng , Zhenyu Wang , Qi Liu , Xiangmin Xu

Understanding emotions accurately is essential for fields like human-computer interaction. Due to the complexity of emotions and their multi-modal nature (e.g., emotions are influenced by facial expressions and audio), researchers have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Qize Yang , Detao Bai , Yi-Xing Peng , Xihan Wei

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and fostering more…

Computation and Language · Computer Science 2024-12-24 Rafid Ishrak Jahan , Heng Fan , Haihua Chen , Yunhe Feng