English
Related papers

Related papers: Multi-label Class Incremental Emotion Decoding wit…

200 papers

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

In the Massive Open Online Courses (MOOC) learning scenario, the semantic information of instructional videos has a crucial impact on learners' emotional state. Learners mainly acquire knowledge by watching instructional videos, and the…

Multimedia · Computer Science 2024-04-12 Yuan Zhang , Xiaomei Tao , Hanxu Ai , Tao Chen , Yanling Gan

In class-incremental learning (CIL) scenarios, the phenomenon of catastrophic forgetting caused by the classifier's bias towards the current task has long posed a significant challenge. It is mainly caused by the characteristic of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xusheng Cao , Haori Lu , Linlan Huang , Xialei Liu , Ming-Ming Cheng

In this paper we deal with the task of Disturbing Image Detection (DID), exploiting knowledge encoded in Large Multimodal Models (LMMs). Specifically, we propose to exploit LMM knowledge in a two-fold manner: first by extracting generic…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Maria Tzelepi , Vasileios Mezaris

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

Whilst a majority of affective computing research focuses on inferring emotions, examining mood or understanding the \textit{mood-emotion interplay} has received significantly less attention. Building on prior work, we (a) deduce and…

Human-Computer Interaction · Computer Science 2023-08-21 Soujanya Narayana , Ibrahim Radwan , Ravikiran Parameshwara , Iman Abbasnejad , Akshay Asthana , Ramanathan Subramanian , Roland Goecke

Sentiment and emotion understanding are essential to applications such as human-computer interaction and depression detection. While Multimodal Large Language Models (MLLMs) demonstrate robust general capabilities, they face considerable…

Computation and Language · Computer Science 2025-07-08 Ao Li , Longwei Xu , Chen Ling , Jinghui Zhang , Pengwei Wang

Multimodal sentiment analysis is a fundamental problem in the field of affective computing. Although significant progress has been made in cross-modal interaction, it remains a challenge due to the insufficient reference context in…

Multimedia · Computer Science 2025-08-12 Xianbing Zhao , Shengzun Yang , Buzhou Tang , Ronghuan Jiang

Emotion understanding is a core capability for LLMs to interact effectively with humans, yet existing evaluation paradigms rely on discrete emotion label prediction and fail to capture the cognitive processes underlying emotion generation.…

Artificial Intelligence · Computer Science 2026-05-19 Zhaoyue Sun , Hainiu Xu , Andero Uusberg , James J. Gross , Petr Slovak , Yulan He

Multi-label learning deals with the classification problems where each instance can be assigned with multiple labels simultaneously. Conventional multi-label learning approaches mainly focus on exploiting label correlations. It is usually…

Machine Learning · Computer Science 2014-07-08 Xiangnan Kong , Zhaoming Wu , Li-Jia Li , Ruofei Zhang , Philip S. Yu , Hang Wu , Wei Fan

Multi-label image classification aims to predict all possible labels in an image. It is usually formulated as a partial-label learning problem, given the fact that it could be expensive in practice to annotate all labels in every training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Rabab Abdelfattah , Xin Zhang , Zhenyao Wu , Xinyi Wu , Xiaofeng Wang , Song Wang

Image emotion classification (IEC) is a longstanding research field that has received increasing attention with the rapid progress of deep learning. Although recent advances have leveraged the knowledge encoded in pre-trained visual models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zibo Zhou , Zhengjun Zhai , Huimin Chen , Wei Dai , Hansen Yang

Affective Behavior Analysis is an important part in human-computer interaction. Existing multi-task affective behavior recognition methods suffer from the problem of incomplete labeled datasets. To tackle this problem, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Lingfeng Wang , Shisen Wang , Jin Qi , Kenji Suzuki

Emotion Recognition in Conversation (ERC) plays an important role in driving the development of human-machine interaction. Emotions can exist in multiple modalities, and multimodal ERC mainly faces two problems: (1) the noise problem in the…

Computation and Language · Computer Science 2023-10-10 Shihao Zou , Xianying Huang , Xudong Shen

It is well-known that exploiting label correlations is important to multi-label learning. Existing approaches either assume that the label correlations are global and shared by all instances; or that the label correlations are local and…

Machine Learning · Computer Science 2017-04-06 Yue Zhu , James T. Kwok , Zhi-Hua Zhou

This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these labels. The key…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Baoyuan Wu , Fan Jia , Wei Liu , Bernard Ghanem , Siwei Lyu

We present our shared task on text-based emotion detection, covering more than 30 languages from seven distinct language families. These languages are predominantly low-resource and are spoken across various continents. The data instances…

Human annotators frequently disagree on emotion labels, yet most evaluations of Large Language Model (LLM) emotion annotation collapse these judgments into a single gold standard, discarding the distributional information that disagreement…

Computation and Language · Computer Science 2026-05-04 Keito Inoshita , Xiaokang Zhou , Akira Kawai , Katsutoshi Yada

Misinformation is prevalent in various fields such as education, politics, health, etc., causing significant harm to society. However, current methods for cross-domain misinformation detection rely on effort- and resource-intensive…

Computation and Language · Computer Science 2025-10-28 Zhiwei Liu , Kailai Yang , Qianqian Xie , Christine de Kock , Sophia Ananiadou , Eduard Hovy