English
Related papers

Related papers: Tri-Subspaces Disentanglement for Multimodal Senti…

200 papers

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Multimodal sentiment analysis has recently gained popularity because of its relevance to social media posts, customer service calls and video blogs. In this paper, we address three aspects of multimodal sentiment analysis; 1. Cross modal…

Computation and Language · Computer Science 2020-03-03 Ayush Kumar , Jithendra Vepa

Fusion technique is a key research topic in multimodal sentiment analysis. The recent attention-based fusion demonstrates advances over simple operation-based fusion. However, these fusion works adopt single-scale, i.e., token-level or…

Computation and Language · Computer Science 2021-12-03 Huaishao Luo , Lei Ji , Yanyong Huang , Bin Wang , Shenggong Ji , Tianrui Li

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Mingcheng Li , Dingkang Yang , Xiao Zhao , Shuaibing Wang , Yan Wang , Kun Yang , Mingyang Sun , Dongliang Kou , Ziyun Qian , Lihua Zhang

Multimodal Sentiment Analysis (MSA) aims to recognize human emotions by exploiting textual, acoustic, and visual modalities, and thus how to make full use of the interactions between different modalities is a central challenge of MSA.…

Computation and Language · Computer Science 2025-02-17 Yubo Gao , Haotian Wu , Lei Zhang

Multimodal Sentiment Analysis (MSA) integrates multiple modalities to infer human sentiment, but real-world noise often leads to missing or corrupted data. However, existing feature-disentangled methods struggle to handle the internal…

Multimedia · Computer Science 2026-02-03 Xiang Li , Xiaoming Zhang , Dezhuang Miao , Xianfu Cheng , Dawei Li , Honggui Han , Zhoujun Li

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

Multimodal sentiment analysis (MSA) integrates various modalities, such as text, image, and audio, to provide a more comprehensive understanding of sentiment. However, effective MSA is challenged by alignment and fusion issues. Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yuhua Wen , Qifei Li , Yingying Zhou , Yingming Gao , Zhengqi Wen , Jianhua Tao , Ya Li

Multimodal sentiment analysis (MSA) systems leverage information from different modalities to predict human sentiment intensities. Incomplete modality is an important issue that may cause a significant performance drop in MSA systems. By…

Multimedia · Computer Science 2024-10-14 Zhongyi Sang , Kotaro Funakoshi , Manabu Okumura

Multimodal Sentiment Analysis (MSA) is critical for human-computer interaction but faces challenges when the modalities are incomplete or missing. Existing methods often assume pre-defined missing modalities or fixed missing rates, limiting…

Human-Computer Interaction · Computer Science 2025-11-24 Liling Li , Guoyang Xu , Xiongri Shen , Zhifei Xu , Yanbo Zhang , Zhiguo Zhang , Zhenxi Song

Multimodal Sentiment Analysis (MSA) is an important research area that aims to understand and recognize human sentiment through multiple modalities. The complementary information provided by multimodal fusion promotes better sentiment…

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Multimodal Sentiment Analysis (MSA) leverages multiple data modals to analyze human sentiment. Existing MSA models generally employ cutting-edge multimodal fusion and representation learning-based methods to promote MSA capability. However,…

Computation and Language · Computer Science 2024-12-04 Yijie Jin

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

Multimodal Sentiment Analysis (MSA) has been a popular topic in natural language processing nowadays, at both sentence and aspect level. However, the existing approaches almost require large-size labeled datasets, which bring about large…

Computation and Language · Computer Science 2023-08-01 Zikai Zhou , Haisong Feng , Baiyou Qiao , Gang Wu , Donghong Han

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Multimodal Sentiment Analysis (MSA) stands as a critical research frontier, seeking to comprehensively unravel human emotions by amalgamating text, audio, and visual data. Yet, discerning subtle emotional nuances within audio and video…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sheng Wu , Xiaobao Wang , Longbiao Wang , Dongxiao He , Jianwu Dang

Sentiment analysis is a crucial task that aims to understand people's emotional states and predict emotional categories based on multimodal information. It consists of several subtasks, such as emotion recognition in conversation (ERC),…

Computation and Language · Computer Science 2023-09-06 Zaijing Li , Ting-En Lin , Yuchuan Wu , Meng Liu , Fengxiao Tang , Ming Zhao , Yongbin Li

Multimodal sentiment analysis is an important research task to predict the sentiment score based on the different modality data from a specific opinion video. Many previous pieces of research have proved the significance of utilizing the…

Computation and Language · Computer Science 2022-08-26 Ming Jiang , Shaoxiong Ji

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

Multimedia · Computer Science 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li