English
Related papers

Related papers: SentiFuse: Deep Multi-model Fusion Framework for R…

200 papers

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand…

Multimedia · Computer Science 2021-03-23 Qiuchi Li , Dimitris Gkoumas , Christina Lioma , Massimo Melucci

Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that…

Machine Learning · Computer Science 2022-10-13 Guilherme Lourenço de Toledo , Ricardo Marcondes Marcacini

Sentiment analysis is a domain of study that focuses on identifying and classifying the ideas expressed in the form of text into positive, negative and neutral polarities. Feature selection is a crucial process in machine learning. In this…

Computation and Language · Computer Science 2020-02-04 Avinash Madasu , Sivasankar E

Multimodal sentiment analysis relies on textual, acoustic, and visual signals, yet real-world data often suffer from modality missing and quality imbalance. Existing methods generate features for modality missing from available ones, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chenglizhao Chen , Yuchen Cao , Xinyu Liu , Mengke Song , Guisheng Zhang , Xiaomin Yu

Sentiment analysis can provide a suitable lead for the tools used in software engineering along with the API recommendation systems and relevant libraries to be used. In this context, the existing tools like SentiCR, SentiStrength-SE, etc.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Himanshu Batra , Narinder Singh Punn , Sanjay Kumar Sonbhadra , Sonali Agarwal

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

The human visual perception system has strong robustness in image fusion. This robustness is based on human visual perception system's characteristics of feature selection and non-linear fusion of different features. In order to simulate…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

Social media hold valuable, vast and unstructured information on public opinion that can be utilized to improve products and services. The automatic analysis of such data, however, requires a deep understanding of natural language. Current…

Computation and Language · Computer Science 2019-10-01 Kia Dashtipour , Mandar Gogate , Jingpeng Li , Fengling Jiang , Bin Kong , Amir Hussain

In this paper, we introduce a new framework called the sentiment-aspect attribution module (SAAM). SAAM works on top of traditional neural networks and is designed to address the problem of multi-aspect sentiment classification and…

Computation and Language · Computer Science 2020-12-16 Yifan Zhang , Fan Yang , Marjan Hosseinia , Arjun Mukherjee

Emotion recognition through artificial intelligence and smart sensing of physical and physiological signals (Affective Computing) is achieving very interesting results in terms of accuracy, inference times, and user-independent models. In…

Human-Computer Interaction · Computer Science 2024-10-08 Laura Gutierrez-Martin , Celia Lopez Ongil , Jose M. Lanza-Gutierrez , Jose A. Miranda Calero

Autonomous vehicles and mobile robotic systems are typically equipped with multiple sensors to provide redundancy. By integrating the observations from different sensors, these mobile agents are able to perceive the environment and estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Changhao Chen , Stefano Rosa , Chris Xiaoxuan Lu , Bing Wang , Niki Trigoni , Andrew Markham

Sentiment analysis is a crucial task that aims to understand people's emotional states and predict emotional categories based on multimodal information. It consists of several subtasks, such as emotion recognition in conversation (ERC),…

Computation and Language · Computer Science 2023-09-06 Zaijing Li , Ting-En Lin , Yuchuan Wu , Meng Liu , Fengxiao Tang , Ming Zhao , Yongbin Li

With the increasing popularity of video sharing websites such as YouTube and Facebook, multimodal sentiment analysis has received increasing attention from the scientific community. Contrary to previous works in multimodal sentiment…

Machine Learning · Computer Science 2018-02-06 Minghai Chen , Sen Wang , Paul Pu Liang , Tadas Baltrušaitis , Amir Zadeh , Louis-Philippe Morency

Large language models struggle to accumulate evidence across multiple rounds of user interaction, failing to update their beliefs in a manner consistent with Bayesian inference. Existing solutions require fine-tuning on sensitive user…

Computation and Language · Computer Science 2026-04-07 Fangzhou Lin , Peiran Li , Shuo Xing , Siyuan Yang , Qianwen Ge , Kazunori Yamada , Ziming Zhang , Haichong Zhang , Zhengzhong Tu

Music emotion recognition (MER), a sub-task of music information retrieval (MIR), has developed rapidly in recent years. However, the learning of affect-salient features remains a challenge. In this paper, we propose an end-to-end…

Sound · Computer Science 2022-07-01 Zi Huang , Shulei Ji , Zhilan Hu , Chuangjian Cai , Jing Luo , Xinyu Yang

The emergence of multimodal large models has advanced artificial intelligence, introducing unprecedented levels of performance and functionality. However, optimizing these models remains challenging due to historically isolated paths of…

Artificial Intelligence · Computer Science 2025-06-05 Daoyuan Chen , Haibin Wang , Yilun Huang , Ce Ge , Yaliang Li , Bolin Ding , Jingren Zhou

Nowadays, with the explosive growth of multimodal reviews on social media platforms, multimodal sentiment analysis has recently gained popularity because of its high relevance to these social media posts. Although most previous studies…

Computation and Language · Computer Science 2022-01-26 Luwei Xiao , Xingjiao Wu , Wen Wu , Jing Yang , Liang He

The integration of emotional intelligence in machines is an important step in advancing human-computer interaction. This demands the development of reliable end-to-end emotion recognition systems. However, the scarcity of public affective…

Human-Computer Interaction · Computer Science 2023-06-07 Alireza F. Nia , Vanessa Tang , Gonzalo Maso Talou , Mark Billinghurst

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu