English
Related papers

Related papers: Multi-label Class Incremental Emotion Decoding wit…

200 papers

By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one-hot labels. In…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Shasha Mao , Guanghui Shi , Licheng Jiao , Shuiping Gou , Yangyang Li , Lin Xiong , Boxin Shi

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Multimodal emotion recognition (MER) seeks to integrate various modalities to predict emotional states accurately. However, most current research focuses solely on the fusion of audio and text features, overlooking the valuable information…

Sound · Computer Science 2025-04-08 Xuechun Shao , Yinfeng Yu , Liejun Wang

Multi-modal affective computing aims to automatically recognize and interpret human attitudes from diverse data sources such as images and text, thereby enhancing human-computer interaction and emotion understanding. Existing approaches…

Computation and Language · Computer Science 2025-06-10 Yuanhe Tian , Pengsen Cheng , Guoqing Jin , Lei Zhang , Yan Song

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

There exist two main approaches to automatically extract affective orientation: lexicon-based and corpus-based. In this work, we argue that these two methods are compatible and show that combining them can improve the accuracy of emotion…

Computation and Language · Computer Science 2020-04-30 Mario Giulianelli

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems lack generalisation across different conditions. A key underlying reason for poor generalisation is the scarcity of emotion datasets, which is a…

Sound · Computer Science 2022-07-13 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn W. Schuller

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

Multimodal Large Language Models (MLLMs) are experiencing rapid growth, yielding a plethora of noteworthy contributions in recent months. The prevailing trend involves adopting data-driven methodologies, wherein diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xin He , Longhui Wei , Lingxi Xie , Qi Tian

The emergence of large language models (LLMs) has significantly transformed natural language processing (NLP), enabling more generalized models to perform various tasks with minimal training. However, traditional sentiment analysis methods,…

Computation and Language · Computer Science 2026-01-13 Keito Inoshita , Xiaokang Zhou , Akira Kawai

Like humans, deep networks have been shown to learn better when samples are organized and introduced in a meaningful order or curriculum. Conventional curriculum learning schemes introduce samples in their order of difficulty. This forces…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Madan Ravi Ganesh , Jason J. Corso

Developing and integrating emotion-understanding models are essential for a wide range of human-computer interaction tasks, including customer feedback analysis, marketing research, and social media monitoring. Given that users often…

Computation and Language · Computer Science 2026-03-20 Tadesse Destaw Belay , Dawit Ketema Gete , Abinew Ali Ayele , Olga Kolesnikova , Iqra Ameer , Grigori Sidorov , Seid Muhie Yimam

Large Vision-Language Models (LVLMs) represent a significant leap towards empathetic agents, demonstrating remarkable capabilities in emotion understanding. However, the internal mechanisms governing how LVLMs translate abstract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Chengsheng Zhang , Chenghao Sun , Zhining Xie , Xinmei Tian

Multi-label image recognition with incomplete labels is a challenging yet vital task in computer vision, which faces two fundamental challenges: learning semantic-aware features and recovering missing labels. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhi-Fen He , Ren-Dong Xie , Bo Li , Bin Liu , Jin-Yan Hu

Emotion cause identification aims at identifying the potential causes that lead to a certain emotion expression in text. Several techniques including rule based methods and traditional machine learning methods have been proposed to address…

Computation and Language · Computer Science 2019-06-05 Zixiang Ding , Huihui He , Mengran Zhang , Rui Xia

Multi-label text classification (MLTC) is an attractive and challenging task in natural language processing (NLP). Compared with single-label text classification, MLTC has a wider range of applications in practice. In this paper, we propose…

Computation and Language · Computer Science 2022-05-24 Irene Li , Aosong Feng , Hao Wu , Tianxiao Li , Toyotaro Suzumura , Ruihai Dong

Multi-modal Multi-label Emotion Recognition (MMER) aims to identify various human emotions from heterogeneous visual, audio and text modalities. Previous methods mainly focus on projecting multiple modalities into a common latent space and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yi Zhang , Mingyuan Chen , Jundong Shen , Chongjun Wang