English
Related papers

Related papers: AffectGPT: A New Dataset, Model, and Benchmark for…

200 papers

Emotion recognition from electroencephalography (EEG) signals remains challenging due to high inter-subject variability, limited labeled data, and the lack of interpretable reasoning in existing approaches. While recent multimodal large…

Machine Learning · Computer Science 2026-01-14 Fei Ma , Han Lin , Yifan Xie , Hongwei Ren , Xiaoyu Shen , Wenbo Ding , Qi Tian

Multimodal emotion recognition has attracted much attention recently. Fusing multiple modalities effectively with limited labeled data is a challenging task. Considering the success of pre-trained model and fine-grained nature of emotion…

Computation and Language · Computer Science 2023-03-02 Junyi He , Meimei Wu , Meng Li , Xiaobo Zhu , Feng Ye

This paper investigates the challenges of affect control in large language models (LLMs), focusing on their ability to express appropriate emotional states during extended dialogues. We evaluated state-of-the-art open-weight LLMs to assess…

Artificial Intelligence · Computer Science 2025-03-05 Gino Franco Fazzi , Julie Skoven Hinge , Stefan Heinrich , Paolo Burelli

Fine-grained emotion recognition is a challenging multi-label NLP task due to label overlap and class imbalance. In this work, we benchmark three modeling families on the GoEmotions dataset: a TF-IDF-based logistic regression system trained…

Computation and Language · Computer Science 2026-01-27 Ani Harutyunyan , Sachin Kumar

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

In recent years, Multimodal Emotion Recognition (MER) has made substantial progress. Nevertheless, most existing approaches neglect the semantic inconsistencies that may arise across modalities, such as conflicting emotional cues between…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Guowei Zhong , Junjie Li , Huaiyu Zhu , Ruohong Huan , Yun Pan

Multimodal emotion recognition (MMER) systems typically outperform unimodal systems by leveraging the inter- and intra-modal relationships between, e.g., visual, textual, physiological, and auditory modalities. This paper proposes an MMER…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Paul Waligora , Haseeb Aslam , Osama Zeeshan , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Simon Bacon , Eric Granger

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Emotion classification in multilingual settings remains constrained by the scarcity of annotated data: existing corpora are predominantly English, single-label, and cover few languages. We address this gap by constructing a large-scale…

Computation and Language · Computer Science 2026-04-15 Vadim Borisov

In the field of affective computing, researchers in the community have promoted the performance of models and algorithms by using the complementarity of multimodal information. However, the emergence of more and more modal information makes…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Binqiang Wang , Gang Dong , Yaqian Zhao , Rengang Li , Lu Cao , Lihua Lu

Multimodal music emotion recognition (MMER) is an emerging discipline in music information retrieval that has experienced a surge in interest in recent years. This survey provides a comprehensive overview of the current state-of-the-art in…

Multimedia · Computer Science 2025-04-29 Rashini Liyanarachchi , Aditya Joshi , Erik Meijering

Emotion understanding is a critical yet challenging task. Most existing approaches rely heavily on identity-sensitive information, such as facial expressions and speech, which raises concerns about personal privacy. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deng Li , Bohao Xing , Xin Liu , Baiqiang Xia , Bihan Wen , Heikki Kälviäinen

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Multimodal multi-label emotion recognition (MMER) aims to identify the concurrent presence of multiple emotions in multimodal data. Existing studies primarily focus on improving fusion strategies and modeling modality-to-label dependencies.…

Computation and Language · Computer Science 2025-02-20 Jingwang Huang , Jiang Zhong , Qin Lei , Jinpeng Gao , Yuming Yang , Sirui Wang , Peiguang Li , Kaiwen Wei

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Emotion detection from text seeks to identify an individual's emotional or mental state - positive, negative, or neutral - based on linguistic cues. While significant progress has been made for English and other high-resource languages,…

Computation and Language · Computer Science 2025-11-11 Abdullah Al Maruf , Aditi Golder , Zakaria Masud Jiyad , Abdullah Al Numan , Tarannum Shaila Zaman

The latest large language models (LLMs) such as ChatGPT, exhibit strong capabilities in automated mental health analysis. However, existing relevant studies bear several limitations, including inadequate evaluations, lack of prompting…

Computation and Language · Computer Science 2024-10-03 Kailai Yang , Shaoxiong Ji , Tianlin Zhang , Qianqian Xie , Ziyan Kuang , Sophia Ananiadou

Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated…

Computation and Language · Computer Science 2026-03-16 Sree Bhattacharyya , Evgenii Kuriabov , Lucas Craig , Tharun Dilliraj , Reginald B. Adams, , Jia Li , James Z. Wang

Emotion understanding is a fundamental challenge in affective computing and artificial intelligence. While existing approaches predominantly focus on facial expressions and speech, they often overlook the rich emotional cues conveyed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chengyan Wang , Haoyu Chen , Hui Wei , Yueyi Yang , Yunquan Chen , Guoying Zhao

Transfer learning has been widely used in natural language processing through deep pretrained language models, such as Bidirectional Encoder Representations from Transformers and Universal Sentence Encoder. Despite the great success,…

Information Retrieval · Computer Science 2022-06-15 Maryam Hasan , Elke Rundensteiner , Emmanuel Agu