English
Related papers

Related papers: Empathy Omni: Enabling Empathetic Speech Response …

200 papers

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

Models like GPT-4o enable real-time interaction with large language models (LLMs) through speech, significantly enhancing user experience compared to traditional text-based interaction. However, there is still a lack of exploration on how…

Computation and Language · Computer Science 2025-03-04 Qingkai Fang , Shoutao Guo , Yan Zhou , Zhengrui Ma , Shaolei Zhang , Yang Feng

The evolution of Omni-Modal Large Language Models~(Omni-LLMs) has revolutionized human--computer interaction, enabling unified audio-visual perception and speech response. However, existing Omni-LLMs struggle with complex real-world…

Sound · Computer Science 2026-03-10 Wenjie Tian , Zhixian Zhao , Jingbin Hu , Huakang Chen , Haohe Liu , Binshen Mu , Lei Xie

Empathy is central to human connection, yet people often struggle to express it effectively. In blinded evaluations, large language models (LLMs) generate responses that are often judged more empathic than human-written ones. Yet when a…

Computation and Language · Computer Science 2026-03-17 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Bruce Lambert , Matthew Groh

The development of Large Language Models (LLMs) provides human-centered Artificial General Intelligence (AGI) with a glimmer of hope. Empathy serves as a key emotional attribute of humanity, playing an irreplaceable role in human-centered…

Artificial Intelligence · Computer Science 2024-08-26 Linzhuang Sun , Yao Dong , Nan Xu , Jingxuan Wei , Bihui Yu , Yin Luo

Large language models have become increasingly common, used by millions of people worldwide in both professional and personal contexts. As these models continue to advance, they are frequently serving as virtual assistants and companions.…

Computation and Language · Computer Science 2025-08-13 Victoria Williams , Benjamin Rosman

Evaluating Large Language Models' (LLMs) anthropomorphic capabilities has become increasingly important in contemporary discourse. Utilizing the emotion appraisal theory from psychology, we propose to evaluate the empathy ability of LLMs,…

Computation and Language · Computer Science 2024-10-08 Jen-tse Huang , Man Ho Lam , Eric John Li , Shujie Ren , Wenxuan Wang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

This study focuses on emotion-sensitive spoken dialogue in human-machine speech interaction. With the advancement of Large Language Models (LLMs), dialogue systems can handle multimodal data, including audio. Recent models have enhanced the…

Sound · Computer Science 2024-07-30 Hongfei Xue , Yuhao Liang , Bingshen Mu , Shiliang Zhang , Mengzhe Chen , Qian Chen , Lei Xie

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

Large Language Models (LLMs) have demonstrated surprising performance on many tasks, including writing supportive messages that display empathy. Here, we had these models generate empathic messages in response to posts describing common…

Computation and Language · Computer Science 2024-03-28 Yoon Kyung Lee , Jina Suh , Hongli Zhan , Junyi Jessy Li , Desmond C. Ong

While the automatic evaluation of omni-modal large models (OLMs) is essential, assessing empathy remains a significant challenge due to its inherent affectivity. To investigate this challenge, we introduce AEQ-Bench (Audio Empathy Quotient…

Computation and Language · Computer Science 2026-01-16 Xuan Luo , Lewei Yao , Libo Zhao , Lanqing Hong , Kai Chen , Dehua Tao , Daxin Tan , Ruifeng Xu , Jing Li

Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tasks and contexts. In this work, we introduce a novel…

Human-Computer Interaction · Computer Science 2025-11-06 Erfan Shayegani , Jina Suh , Andy Wilson , Nagu Rangan , Javier Hernandez

Advancements in spoken language processing have driven the development of spoken language models (SLMs), designed to achieve universal audio understanding by jointly learning text and audio representations for a wide range of tasks.…

Computation and Language · Computer Science 2025-10-31 Pedro Corrêa , João Lima , Victor Moreno , Lucas Ueda , Paula Dornhofer Paro Costa

Emotional intelligence in large language models (LLMs) is of great importance in Natural Language Processing. However, the previous research mainly focus on basic sentiment analysis tasks, such as emotion recognition, which is not enough to…

Computation and Language · Computer Science 2024-09-23 Yuyan Chen , Hao Wang , Songzhou Yan , Sijia Liu , Yueze Li , Yi Zhao , Yanghua Xiao

In recent years, Large Language Models (LLMs) have become increasingly more powerful in their ability to complete complex tasks. One such task in which LLMs are often employed is scoring, i.e., assigning a numerical value from a certain…

Computation and Language · Computer Science 2024-12-31 Henry J. Xie , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu

Empathy is essential for fostering natural interactions in spoken dialogue systems, as it enables machines to recognize the emotional tone of human speech and deliver empathetic responses. Recent research has made significant progress in…

Computation and Language · Computer Science 2026-04-21 Yun Hong , Yan Zhou , Yang Feng

Previous research has shown that humans are more receptive towards language models that that exhibit empathetic behavior. While empathy is essential for developing helpful dialogue agents, very few large corpora containing empathetic…

Computation and Language · Computer Science 2025-02-26 Run Chen , Jun Shin , Julia Hirschberg

Empathetic response generation is a desirable aspect of conversational agents, crucial for facilitating engaging and emotionally intelligent multi-turn conversations between humans and machines. Leveraging large language models for this…

Computation and Language · Computer Science 2024-09-18 Ondrej Sotolar , Vojtech Formanek , Alok Debnath , Allison Lahnala , Charles Welch , Lucie FLek
‹ Prev 1 2 3 10 Next ›