English
Related papers

Related papers: An AutoML-based Approach to Multimodal Image Senti…

200 papers

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

Recent advances in machine learning have led to computer systems that are human-like in behaviour. Sentiment analysis, the automatic determination of emotions in text, is allowing us to capitalize on substantial previously unattainable…

Computation and Language · Computer Science 2021-01-15 Saif M. Mohammad

Multimodal sentiment analysis is a very actively growing field of research. A promising area of opportunity in this field is to improve the multimodal fusion mechanism. We present a novel feature fusion strategy that proceeds in a…

Computation and Language · Computer Science 2018-06-19 N. Majumder , D. Hazarika , A. Gelbukh , E. Cambria , S. Poria

Multimodal aspect-based sentiment analysis (MABSA) aims to identify aspect-level sentiments by jointly modeling textual and visual information, which is essential for fine-grained opinion understanding in social media. Existing approaches…

Computation and Language · Computer Science 2026-01-13 Zhongzheng Wang , Yuanhe Tian , Hongzhi Wang , Yan Song

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Visual-textual sentiment analysis aims to predict sentiment with the input of a pair of image and text, which poses a challenge in learning effective features for diverse input images. To address this, we propose a holistic method that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junyu Chen , Jie An , Hanjia Lyu , Christopher Kanan , Jiebo Luo

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal…

Machine Learning · Computer Science 2019-08-19 Navonil Majumder , Soujanya Poria , Gangeshwar Krishnamurthy , Niyati Chhaya , Rada Mihalcea , Alexander Gelbukh

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Because multimodal data contains more modal information, multimodal sentiment analysis has become a recent research hotspot. However, redundant information is easily involved in feature fusion after feature extraction, which has a certain…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Huiru Wang , Xiuhong Li , Zenyu Ren , Dan Yang , chunming Ma

Multimodal sentiment analysis has become an important research area in the field of artificial intelligence. With the latest advances in deep learning, this technology has reached new heights. It has great potential for both application and…

Computation and Language · Computer Science 2023-07-06 Songning Lai , Xifeng Hu , Haoxuan Xu , Zhaoxia Ren , Zhi Liu

Multimodal sentiment analysis has recently gained popularity because of its relevance to social media posts, customer service calls and video blogs. In this paper, we address three aspects of multimodal sentiment analysis; 1. Cross modal…

Computation and Language · Computer Science 2020-03-03 Ayush Kumar , Jithendra Vepa

This paper studies the best practices for automatic machine learning (AutoML). While previous AutoML efforts have predominantly focused on unimodal data, the multimodal aspect remains under-explored. Our study delves into classification and…

Machine Learning · Computer Science 2024-12-24 Zhiqiang Tang , Zihan Zhong , Tong He , Gerald Friedland

In the last decade, video blogs (vlogs) have become an extremely popular method through which people express sentiment. The ubiquitousness of these videos has increased the importance of multimodal fusion models, which incorporate video and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Nathaniel Blanchard , Daniel Moreira , Aparna Bharati , Walter J. Scheirer

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

Machine Learning · Computer Science 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Multimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this paper,…

Computation and Language · Computer Science 2017-07-25 Amir Zadeh , Minghai Chen , Soujanya Poria , Erik Cambria , Louis-Philippe Morency

Understanding how visual content conveys sentiment is increasingly important in a digital landscape dominated by imagery. However, sentiment perception depends on complex scene-level semantics, making this a challenging task for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Neemias B. da Silva , John Harrison , Rodrigo Minetto , Myriam R. Delgado , Bogdan T. Nassu , Thiago H. Silva

With the rapid development of multimedia, the shift from unimodal textual sentiment analysis to multimodal image-text sentiment analysis has obtained academic and industrial attention in recent years. However, multimodal sentiment analysis…

Multimedia · Computer Science 2024-12-11 Fuhai Chen , Pengpeng Huang , Xuri Ge , Jie Huang , Zishuo Bao

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo