English
Related papers

Related papers: Learning Shared Sentiment Prototypes for Adaptive …

200 papers

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to…

Machine Learning · Computer Science 2022-07-05 Jiahao Zheng , Sen Zhang , Xiaoping Wang , Zhigang Zeng

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

Machine Learning · Computer Science 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Multimodal Sentiment Analysis (MSA) is an important research area that aims to understand and recognize human sentiment through multiple modalities. The complementary information provided by multimodal fusion promotes better sentiment…

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

There has been growing interest in Multimodal Aspect-Based Sentiment Analysis (MABSA) in recent years. Existing methods predominantly rely on pre-trained small language models (SLMs) to collect information related to aspects and sentiments…

Computation and Language · Computer Science 2025-05-27 Jun Cao , Jiyi Li , Ziwei Yang , Renjie Zhou

Sentiment analysis is a crucial task that aims to understand people's emotional states and predict emotional categories based on multimodal information. It consists of several subtasks, such as emotion recognition in conversation (ERC),…

Computation and Language · Computer Science 2023-09-06 Zaijing Li , Ting-En Lin , Yuchuan Wu , Meng Liu , Fengxiao Tang , Ming Zhao , Yongbin Li

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Multimodal sentiment analysis (MSA) aims to understand human emotions by integrating information from multiple modalities, such as text, audio, and visual data. However, existing methods often suffer from spurious correlations both within…

Machine Learning · Computer Science 2026-05-21 Menghua Jiang , Yuxia Lin , Baoliang Chen , Haifeng Hu , Yuncheng Jiang , Sijie Mai

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Multimodal sentiment analysis has gained significant attention due to the proliferation of multimodal content on social media. However, existing studies in this area rely heavily on large-scale supervised data, which is time-consuming and…

Computation and Language · Computer Science 2023-08-02 Xiaocui Yang , Shi Feng , Daling Wang , Pengfei Hong , Soujanya Poria

Multimodal Sentiment Analysis (MSA) aims to understand human intentions by integrating emotion-related clues from diverse modalities, such as visual, language, and audio. Unfortunately, the current MSA task invariably suffers from unplanned…

Computation and Language · Computer Science 2024-07-08 Dingkang Yang , Mingcheng Li , Dongling Xiao , Yang Liu , Kun Yang , Zhaoyu Chen , Yuzheng Wang , Peng Zhai , Ke Li , Lihua Zhang

Multimodal aspect-based sentiment analysis (MABSA) aims to understand opinions in a granular manner, advancing human-computer interaction and other fields. Traditionally, MABSA methods use a joint prediction approach to identify aspects and…

Computation and Language · Computer Science 2024-06-14 Shezheng Song , Shasha Li , Shan Zhao , Chengyu Wang , Xiaopeng Li , Jie Yu , Qian Wan , Jun Ma , Tianwei Yan , Wentao Ma , Xiaoguang Mao

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Multimodal sentiment analysis aims to extract and integrate semantic information collected from multiple modalities to recognize the expressed emotions and sentiment in multimodal data. This research area's major concern lies in developing…

Artificial Intelligence · Computer Science 2021-08-31 Wei Han , Hui Chen , Alexander Gelbukh , Amir Zadeh , Louis-philippe Morency , Soujanya Poria

Fusion technique is a key research topic in multimodal sentiment analysis. The recent attention-based fusion demonstrates advances over simple operation-based fusion. However, these fusion works adopt single-scale, i.e., token-level or…

Computation and Language · Computer Science 2021-12-03 Huaishao Luo , Lei Ji , Yanyong Huang , Bin Wang , Shenggong Ji , Tianrui Li

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin

Multimodal sentiment analysis aims to identify the emotions expressed by individuals through visual, language, and acoustic cues. However, most existing research assume that all modalities are available during both training and testing,…

Sound · Computer Science 2026-04-21 Weide Liu , Huijing Zhan

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

Multimodal sentiment analysis has attracted increasing attention and lots of models have been proposed. However, the performance of the state-of-the-art models decreases sharply when they are deployed in the real world. We find that the…

Computation and Language · Computer Science 2022-09-21 Yang Wu , Yanyan Zhao , Hao Yang , Song Chen , Bing Qin , Xiaohuan Cao , Wenting Zhao