English
Related papers

Related papers: EmoPrefer: Can Large Language Models Understand Hu…

200 papers

Transformer models have significantly advanced the field of emotion recognition. However, there are still open challenges when exploring open-ended queries for Large Language Models (LLMs). Although current models offer good results,…

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Recently, Multimodal Large Language Models (MLLMs) have achieved exceptional performance across diverse tasks, continually surpassing previous expectations regarding their capabilities. Nevertheless, their proficiency in perceiving emotions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human…

Artificial Intelligence · Computer Science 2023-07-31 Xuena Wang , Xueting Li , Zi Yin , Yue Wu , Liu Jia

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Multimodal emotion recognition in conversation (MERC), the task of identifying the emotion label for each utterance in a conversation, is vital for developing empathetic machines. Current MLLM-based MERC studies focus mainly on capturing…

Computation and Language · Computer Science 2025-04-01 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Yulin Wu , Bingquan Liu

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

Multimedia · Computer Science 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

Personality detection from text is commonly performed by analysing users' social media posts. However, existing methods heavily rely on large-scale annotated datasets, making it challenging to obtain high-quality personality labels.…

Computation and Language · Computer Science 2025-09-03 Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel

Emotion understanding is essential for building socially intelligent agents. Although recent multimodal large language models have shown strong performance on this task, two key challenges remain - spurious associations between emotions and…

Machine Learning · Computer Science 2026-02-10 Ashutosh Chaubey , Jiacheng Pang , Maksim Siniukov , Mohammad Soleymani

Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that models deemed…

Computation and Language · Computer Science 2024-03-27 Smriti Singh , Cornelia Caragea , Junyi Jessy Li

Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made tremendous progress in the last few years for many visual tasks, potentially offering a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Madhav Agarwal , Sotirios A. Tsaftaris , Laura Sevilla-Lara , Steven McDonagh

Multimodal Large Language Models (MLLMs) have revolutionized numerous research fields, including computer vision and affective computing. As a pivotal challenge in this interdisciplinary domain, facial expression recognition (FER) has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Fan Zhang , Haoxuan Li , Shengju Qian , Xin Wang , Zheng Lian , Hao Wu , Zhihong Zhu , Yuan Gao , Qiankun Li , Yefeng Zheng , Zhouchen Lin , Pheng-Ann Heng

Emotion recognition in conversation (ERC), the task of discerning human emotions for each utterance within a conversation, has garnered significant attention in human-computer interaction systems. Previous ERC studies focus on…

Computation and Language · Computer Science 2025-03-04 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Lili Shan , Yulin Wu , Bingquan Li

MER2025 is the third year of our MER series of challenges, aiming to bring together researchers in the affective computing community to explore emerging trends and future directions in the field. Previously, MER2023 focused on multi-label…

Designing emotionally intelligent conversational systems to provide comfort and advice to people experiencing distress is a compelling area of research. Recently, with advancements in large language models (LLMs), end-to-end dialogue agents…

Computation and Language · Computer Science 2025-11-13 Chenwei Wan , Matthieu Labeau , Chloé Clavel

Emotion Recognition in Conversation (ERC) is a crucial task for understanding human emotions and enabling natural human-computer interaction. Although Large Language Models (LLMs) have recently shown great potential in this field, their…

Artificial Intelligence · Computer Science 2026-04-14 Xinran Li , Yu Liu , Jiaqi Qiao , Xiujuan Xu

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of human emotions, each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Mahshid Dehghani , Amirahmad Shafiee , Ali Shafiei , Neda Fallah , Farahmand Alizadeh , Mohammad Mehdi Gholinejad , Hamid Behroozi , Jafar Habibi , Ehsaneddin Asgari