English
Related papers

Related papers: Multimodal Sentiment Analysis Based on Causal Reas…

200 papers

Multimodal sentiment analysis is a very actively growing field of research. A promising area of opportunity in this field is to improve the multimodal fusion mechanism. We present a novel feature fusion strategy that proceeds in a…

Computation and Language · Computer Science 2018-06-19 N. Majumder , D. Hazarika , A. Gelbukh , E. Cambria , S. Poria

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

Multimedia · Computer Science 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li

Multimodal Sentiment Analysis (MSA) has been a popular topic in natural language processing nowadays, at both sentence and aspect level. However, the existing approaches almost require large-size labeled datasets, which bring about large…

Computation and Language · Computer Science 2023-08-01 Zikai Zhou , Haisong Feng , Baiyou Qiao , Gang Wu , Donghong Han

Improving model robustness against potential modality noise, as an essential step for adapting multimodal models to real-world applications, has received increasing attention among researchers. For Multimodal Sentiment Analysis (MSA), there…

Multimedia · Computer Science 2022-11-28 Huisheng Mao , Baozheng Zhang , Hua Xu , Ziqi Yuan , Yihe Liu

Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-modality. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhuyang Xie , Yan Yang , Jie Wang , Xiaorong Liu , Xiaofan Li

Multimodal Sentiment Analysis (MSA) endeavors to understand human sentiment by leveraging language, visual, and acoustic modalities. Despite the remarkable performance exhibited by previous MSA approaches, the presence of inherent…

Multimedia · Computer Science 2025-05-09 Weize Quan , Yunfei Feng , Ming Zhou , Yunzhen Zhao , Tong Wang , Dong-Ming Yan

Sentiment analysis is a research topic focused on analysing data to extract information related to the sentiment that it causes. Applications of sentiment analysis are wide, ranging from recommendation systems, and marketing to customer…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , António Gaspar , Luís A. Alexandre , João Cordeiro

Multimodal Sentiment Analysis (MSA) leverages multiple data modals to analyze human sentiment. Existing MSA models generally employ cutting-edge multimodal fusion and representation learning-based methods to promote MSA capability. However,…

Computation and Language · Computer Science 2024-12-04 Yijie Jin

Multimodal Sentiment Analysis (MSA) aims to mine sentiment information from text, visual, and acoustic modalities. Previous works have focused on representation learning and feature fusion strategies. However, most of these efforts ignored…

Multimedia · Computer Science 2023-07-26 Yuxuan Lei , Dingkang Yang , Mingcheng Li , Shunli Wang , Jiawei Chen , Lihua Zhang

As a fine-grained task, multimodal aspect-based sentiment analysis (MABSA) mainly focuses on identifying aspect-level sentiment information in the text-image pair. However, we observe that it is difficult to recognize the sentiment of…

Computation and Language · Computer Science 2024-12-03 Hao Yang , Zhenyu Zhang , Yanyan Zhao , Bing Qin

Recently, Target-oriented Multimodal Sentiment Classification (TMSC) has gained significant attention among scholars. However, current multimodal models have reached a performance bottleneck. To investigate the causes of this problem, we…

Computation and Language · Computer Science 2023-12-27 Junjie Ye , Jie Zhou , Junfeng Tian , Rui Wang , Qi Zhang , Tao Gui , Xuanjing Huang

Multimodal sentiment analysis, which includes both image and text data, presents several challenges due to the dissimilarities in the modalities of text and image, the ambiguity of sentiment, and the complexities of contextual meaning. In…

Machine Learning · Computer Science 2026-02-03 Sumana Biswas , Karen Young , Josephine Griffith

Multimodal aspect-based sentiment analysis (MABSA) aims to identify aspect-level sentiments by jointly modeling textual and visual information, which is essential for fine-grained opinion understanding in social media. Existing approaches…

Computation and Language · Computer Science 2026-01-13 Zhongzheng Wang , Yuanhe Tian , Hongzhi Wang , Yan Song

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

Multimodal sentiment analysis (MSA) leverages information fusion from diverse modalities (e.g., text, audio, visual) to enhance sentiment prediction. However, simple fusion techniques often fail to account for variations in modality…

Machine Learning · Computer Science 2025-10-03 Han Wu , Yanming Sun , Yunhe Yang , Derek F. Wong

Multimodal sentiment analysis aims to identify the emotions expressed by individuals through visual, language, and acoustic cues. However, most existing research assume that all modalities are available during both training and testing,…

Sound · Computer Science 2026-04-21 Weide Liu , Huijing Zhan

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

The effectiveness of a model is heavily reliant on the quality of the fusion representation of multiple modalities in multimodal sentiment analysis. Moreover, each modality is extracted from raw input and integrated with the rest to…

Machine Learning · Computer Science 2023-12-06 Cong-Duy Nguyen , Thong Nguyen , Duc Anh Vu , Luu Anh Tuan

We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing. Our goal is different than the standard sentiment analysis goal of predicting whether a…

Machine Learning · Statistics 2018-05-28 Anthony Hu , Seth Flaxman