English
Related papers

Related papers: Neuron-Level Emotion Control in Speech-Generative …

200 papers

Emotional tone is pervasive in human communication, yet its influence on large language model (LLM) behaviour remains unclear. Here, we examine how first-person emotional framing in user-side queries affect LLM performance across six…

Artificial Intelligence · Computer Science 2026-04-03 Minda Zhao , Yutong Yang , Chufei Peng , Rachel Gonsalves , Weiyue Li , Ruyi Yang , Zhixi Liu , Mengyu Wang

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

Sound · Computer Science 2025-09-22 Yiqing Yang , Man-Wai Mak

Speech large language models (LLMs) observe paralinguistic cues such as prosody, emotion, and non-verbal sounds--crucial for intent understanding. However, leveraging these cues faces challenges: limited training data, annotation…

Emotional intelligence significantly impacts our daily behaviors and interactions. Although Large Language Models (LLMs) are increasingly viewed as a stride toward artificial general intelligence, exhibiting impressive performance in…

Computation and Language · Computer Science 2023-11-14 Cheng Li , Jindong Wang , Yixuan Zhang , Kaijie Zhu , Wenxin Hou , Jianxun Lian , Fang Luo , Qiang Yang , Xing Xie

Speech emotion recognition (SER) models typically rely on costly human-labeled data for training, making scaling methods to large speech datasets and nuanced emotion taxonomies difficult. We present LanSER, a method that enables the use of…

Computation and Language · Computer Science 2023-09-11 Taesik Gong , Josh Belanich , Krishna Somandepalli , Arsha Nagrani , Brian Eoff , Brendan Jou

Conversational systems relying on text-based large language models (LLMs) often overlook paralinguistic cues, essential for understanding emotions and intentions. Speech-language models (SLMs), which use speech as input, are emerging as a…

Computation and Language · Computer Science 2025-08-12 Chun Wang , Chenyang Liu , Wenze Xu , Weihong Deng

Emotional Support Conversation (ESC) is a task aimed at alleviating individuals' emotional distress through daily conversation. Given its inherent complexity and non-intuitive nature, ESConv dataset incorporates support strategies to…

Computation and Language · Computer Science 2025-05-27 Dongjin Kang , Sunghwan Kim , Taeyoon Kwon , Seungjun Moon , Hyunsouk Cho , Youngjae Yu , Dongha Lee , Jinyoung Yeo

Large Vision-Language Models (VLMs) have achieved unprecedented success in several objective multimodal reasoning tasks. However, to further enhance their capabilities of empathetic and effective communication with humans, improving how…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sree Bhattacharyya , James Z. Wang

With generative AI advancing, empathy in human-AI interaction is essential. While prior work focuses on emotional reflection, emotional exploration, key to deeper engagement, remains overlooked. Existing LLMs rely on text which captures…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Jing-Han Chen , Bo-Hao Su , Ya-Tse Wu , Chi-Chun Lee

Large audio-language models (LALMs) have achieved near-human performance in sentence-level transcription and emotion recognition. However, existing evaluations focus mainly on surface-level perception, leaving the capacity of models for…

Computation and Language · Computer Science 2025-08-05 Wanqi Yang , Yanda Li , Yunchao Wei , Meng Fang , Ling Chen

Large language models (LLMs) are increasingly used in emotionally sensitive human-AI applications, yet little is known about how emotion recognition is internally represented. In this work, we investigate the internal mechanisms of emotion…

Computation and Language · Computer Science 2026-04-29 Bangzhao Shu , Arinjay Singh , Mai ElSherief

Large language models (LLMs) have demonstrated impressive performance in mathematical and commonsense reasoning tasks using chain-of-thought (CoT) prompting techniques. But can they perform emotional reasoning by concatenating `Let's think…

Computation and Language · Computer Science 2024-08-12 Ankita Bhaumik , Tomek Strzalkowski

Pervasive polysemanticity in large language models (LLMs) undermines discrete neuron-concept attribution, posing a significant challenge for model interpretation and control. We systematically analyze both encoder and decoder based LLMs…

Machine Learning · Computer Science 2026-04-13 Muhammad Umair Haider , Hammad Rizwan , Hassan Sajjad , Peizhong Ju , A. B. Siddique

Large language models (LLMs) are becoming an increasingly important component of human--computer interaction, enabling users to coordinate a wide range of intelligent agents through natural language. While language-based interfaces are…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Junzi Zhang , Jianing Shen , Weijie Tu , Yi Zhang , Hailin Zhang , Tom Gedeon , Bin Jiang , Yue Yao

Large language models are routinely deployed on text that varies widely in emotional tone, yet their reasoning behavior is typically evaluated without accounting for emotion as a source of representational variation. Prior work has largely…

Computation and Language · Computer Science 2026-03-17 Benjamin Reichman , Adar Avsian , Samuel Webster , Larry Heck

Vietnamese Speech Emotion Recognition (SER) remains challenging due to ambiguous acoustic patterns and the lack of reliable annotated data, especially in real-world conditions where emotional boundaries are not clearly separable. To address…

Computation and Language · Computer Science 2026-04-03 Truc Nguyen , Then Tran , Binh Truong , Phuoc Nguyen T. H

Empathy is central to human connection, yet people often struggle to express it effectively. In blinded evaluations, large language models (LLMs) generate responses that are often judged more empathic than human-written ones. Yet when a…

Computation and Language · Computer Science 2026-03-17 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Bruce Lambert , Matthew Groh

Large language models (LLMs) demonstrate the capacity to reconstruct and trace learned content from their training data under specific elicitation conditions, yet this capability does not manifest in standard generation contexts. This…

Computation and Language · Computer Science 2026-03-20 Toshiyuki Shigemura

Large Language Models (LLMs) have shown remarkable performance in various emotion recognition tasks, thereby piquing the research community's curiosity for exploring their potential in emotional intelligence. However, several issues in the…

Computation and Language · Computer Science 2024-08-08 Zaijing Li , Gongwei Chen , Rui Shao , Yuquan Xie , Dongmei Jiang , Liqiang Nie

Large language models (LLMs) sometimes appear to exhibit emotional reactions. We investigate why this is the case in Claude Sonnet 4.5 and explore implications for alignment-relevant behavior. We find internal representations of emotion…