English
Related papers

Related papers: LLMs Capture Emotion Labels, Not Emotion Uncertain…

200 papers

The subjective perception of emotion leads to inconsistent labels from human annotators. Typically, utterances lacking majority-agreed labels are excluded when training an emotion classifier, which cause problems when encountering ambiguous…

Computation and Language · Computer Science 2024-10-14 Wen Wu , Bo Li , Chao Zhang , Chung-Cheng Chiu , Qiujia Li , Junwen Bai , Tara N. Sainath , Philip C. Woodland

Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated…

Computation and Language · Computer Science 2026-03-16 Sree Bhattacharyya , Evgenii Kuriabov , Lucas Craig , Tharun Dilliraj , Reginald B. Adams, , Jia Li , James Z. Wang

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

Speech emotion recognition plays an important role in various applications. However, most existing approaches predict a single emotion label, oversimplifying the inherently ambiguous nature of human emotional expression. Recent large…

Sound · Computer Science 2026-03-10 Xiaofeng Yu , Jiaheng Dong , Jean Honorio , Abhirup Ghosh , Hong Jia , Ting Dang

Training emotion recognition models has relied heavily on human annotated data, which present diversity, quality, and cost challenges. In this paper, we explore the potential of Large Language Models (LLMs), specifically GPT4, in automating…

Computation and Language · Computer Science 2024-09-02 Minxue Niu , Mimansa Jaiswal , Emily Mower Provost

Human emotions are often not expressed directly, but regulated according to internal processes and social display rules. For affective computing systems, an understanding of how users regulate their emotions can be highly useful, for…

Emotion understanding is a core capability for LLMs to interact effectively with humans, yet existing evaluation paradigms rely on discrete emotion label prediction and fail to capture the cognitive processes underlying emotion generation.…

Artificial Intelligence · Computer Science 2026-05-19 Zhaoyue Sun , Hainiu Xu , Andero Uusberg , James J. Gross , Petr Slovak , Yulan He

Human Label Variation (HLV), i.e. systematic differences among annotators' judgments, remains underexplored in benchmarks despite rapid progress in large language model (LLM) development. We address this gap by introducing an evaluation…

Computation and Language · Computer Science 2026-03-23 Tomas Ruiz , Tanalp Agustoslu , Carsten Schwemmer

Large Language Models (LLMs) are increasingly expected to navigate the nuances of human emotion. While research confirms that LLMs can simulate emotional intelligence, their internal emotional mechanisms remain largely unexplored. This…

Artificial Intelligence · Computer Science 2025-10-14 Jingxiang Zhang , Lujia Zhong

Researchers have proposed the use of generative large language models (LLMs) to label data for research and applied settings. This literature emphasizes the improved performance of these models relative to other natural language models,…

Computation and Language · Computer Science 2025-06-17 Megan A. Brown , Shubham Atreja , Libby Hemphill , Patrick Y. Wu

Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that models deemed…

Computation and Language · Computer Science 2024-03-27 Smriti Singh , Cornelia Caragea , Junyi Jessy Li

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Research in emotion analysis is scattered across different label formats (e.g., polarity types, basic emotion categories, and affective dimensions), linguistic levels (word vs. sentence vs. discourse), and, of course, (few well-resourced…

Computation and Language · Computer Science 2021-11-09 Sven Buechel , Luise Modersohn , Udo Hahn

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

The expression of emotions that serve social purposes, such as asserting independence or fostering interdependence, is central to human interactions and varies systematically across cultures. As LLMs are increasingly used to simulate human…

Computation and Language · Computer Science 2026-04-21 Sree Bhattacharyya , Manas Mehta , Leona Chen , Cristina Salvador , Agata Lapedriza , Shiran Dudy , James Z. Wang

This study investigates the feasibility and performance of using large multimodal models (LMMs) to automatically annotate human emotions in everyday scenarios. We conducted experiments on the DailyLife subset of the publicly available…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 He Zhang , Xinyi Fu

Emotion estimation in images is a challenging task, typically using computer vision methods to directly estimate people's emotions using face, body pose and contextual cues. In this paper, we explore whether Large Language Models (LLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Vera Yang , Archita Srivastava , Yasaman Etesam , Chuxuan Zhang , Angelica Lim

In the era of rapid digital communication, vast amounts of textual data are generated daily, demanding efficient methods for latent content analysis to extract meaningful insights. Large Language Models (LLMs) offer potential for automating…

Computation and Language · Computer Science 2025-01-07 Ljubisa Bojic , Olga Zagovora , Asta Zelenkauskaite , Vuk Vukovic , Milan Cabarkapa , Selma Veseljević Jerkovic , Ana Jovančevic

Speech Emotion Recognition models typically use single categorical labels, overlooking the inherent ambiguity of human emotions. Ambiguous Emotion Recognition addresses this by representing emotions as probability distributions, but…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Wenda Zhang , Hongyu Jin , Siyi Wang , Zhiqiang Wei , Ting Dang