English
Related papers

Related papers: Enhance-then-Balance Modality Collaboration for Ro…

200 papers

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

Multimodal Sentiment Analysis (MSA) aims to infer human sentiment by integrating information from multiple modalities such as text, audio, and video. In real-world scenarios, however, the presence of missing modalities and noisy signals…

Multimedia · Computer Science 2025-11-14 Yan Zhuang , Minhao Liu , Yanru Zhang , Jiawen Deng , Fuji Ren

Multimodal Sentiment Analysis (MSA) aims to mine sentiment information from text, visual, and acoustic modalities. Previous works have focused on representation learning and feature fusion strategies. However, most of these efforts ignored…

Multimedia · Computer Science 2023-07-26 Yuxuan Lei , Dingkang Yang , Mingcheng Li , Shunli Wang , Jiawei Chen , Lihua Zhang

Multimodal sentiment analysis (MSA) identifies individuals' sentiment states in videos by integrating visual, audio, and text modalities. Despite progress in existing methods, the inherent modality heterogeneity limits the effective capture…

Machine Learning · Computer Science 2025-12-19 Shanmin Wang , Chengguang Liu , Qingshan Liu

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

Multimedia · Computer Science 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Multimodal Sentiment Analysis (MSA) seeks to understand human emotions by integrating textual, acoustic, and visual signals. Although multimodal fusion is designed to leverage cross-modal complementarity, real-world scenarios often exhibit…

Machine Learning · Computer Science 2025-11-26 Kang He , Boyu Chen , Yuzhe Ding , Fei Li , Chong Teng , Donghong Ji

Multimodal semantic segmentation enhances model robustness by exploiting cross-modal complementarities. However, existing methods often suffer from imbalanced modal dependencies, where overall performance degrades significantly once a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jiaqi Tan , Xu Zheng , Fangyu Li , Yang Liu

Multimodal Sentiment Analysis (MSA) integrates language, visual, and acoustic modalities to infer human sentiment. Most existing methods either focus on globally shared representations or modality-specific features, while overlooking…

Multimedia · Computer Science 2026-02-24 Chunlei Meng , Jiabin Luo , Zhenglin Yan , Zhenyu Yu , Rong Fu , Zhongxue Gan , Chun Ouyang

Multimodal Sentiment Analysis (MSA) integrates complementary features from text, video, and audio for robust emotion understanding in human interactions. However, models suffer from severe data scarcity and high annotation costs, severely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Hongyu Zhu , Lin Chen , Xin Jin , Mingsheng Shang

Multimodal Sentiment Analysis (MSA) is critical for human-computer interaction but faces challenges when the modalities are incomplete or missing. Existing methods often assume pre-defined missing modalities or fixed missing rates, limiting…

Human-Computer Interaction · Computer Science 2025-11-24 Liling Li , Guoyang Xu , Xiongri Shen , Zhifei Xu , Yanbo Zhang , Zhiguo Zhang , Zhenxi Song

Multimodal Sentiment Analysis (MSA) is an important research area that aims to understand and recognize human sentiment through multiple modalities. The complementary information provided by multimodal fusion promotes better sentiment…

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Multimodal Sentiment Analysis (MSA) utilizes multimodal data to infer the users' sentiment. Previous methods focus on equally treating the contribution of each modality or statically using text as the dominant modality to conduct…

Computation and Language · Computer Science 2024-10-08 Xinyu Feng , Yuming Lin , Lihua He , You Li , Liang Chang , Ya Zhou

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

Multimodal sentiment analysis aims to extract and integrate semantic information collected from multiple modalities to recognize the expressed emotions and sentiment in multimodal data. This research area's major concern lies in developing…

Artificial Intelligence · Computer Science 2021-08-31 Wei Han , Hui Chen , Alexander Gelbukh , Amir Zadeh , Louis-philippe Morency , Soujanya Poria
‹ Prev 1 2 3 10 Next ›