English
Related papers

Related papers: Gated Mechanism for Attention Based Multimodal Sen…

200 papers

Multimodal sentiment analysis aims to extract and integrate semantic information collected from multiple modalities to recognize the expressed emotions and sentiment in multimodal data. This research area's major concern lies in developing…

Artificial Intelligence · Computer Science 2021-08-31 Wei Han , Hui Chen , Alexander Gelbukh , Amir Zadeh , Louis-philippe Morency , Soujanya Poria

Multimodal sentiment analysis (MSA) aims to predict human sentiment from textual, acoustic, and visual information in videos. Recent studies improve multimodal fusion by modeling modality interaction and assigning different modality…

Multimedia · Computer Science 2026-04-08 Chen Su , Yuanhe Tian , Yan Song

Truly real-life data presents a strong, but exciting challenge for sentiment and emotion research. The high variety of possible `in-the-wild' properties makes large datasets such as these indispensable with respect to building robust…

Multimedia · Computer Science 2021-10-22 Lukas Stappen , Alice Baird , Lea Schumann , Björn Schuller

People are sharing their opinions, stories and reviews through online video sharing websites every day. Studying sentiment and subjectivity in these opinion videos is experiencing a growing attention from academia and industry. While…

Computation and Language · Computer Science 2016-11-18 Amir Zadeh , Rowan Zellers , Eli Pincus , Louis-Philippe Morency

The commencement of the decade brought along with it a grave pandemic and in response the movement of education forums predominantly into the online world. With a surge in the usage of online video conferencing platforms and tools to better…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Praneeta Immadisetty , Pooja Rajesh , Akshita Gupta , Anala M R , Soumya A , K. N. Subramanya

The effectiveness of a model is heavily reliant on the quality of the fusion representation of multiple modalities in multimodal sentiment analysis. Moreover, each modality is extracted from raw input and integrated with the rest to…

Machine Learning · Computer Science 2023-12-06 Cong-Duy Nguyen , Thong Nguyen , Duc Anh Vu , Luu Anh Tuan

Multimodal sentiment analysis is drawing an increasing amount of attention these days. It enables mining of opinions in video reviews which are now available aplenty on online platforms. However, multimodal sentiment analysis has only a few…

Computation and Language · Computer Science 2017-04-14 Haohan Wang , Aaksha Meghawat , Louis-Philippe Morency , Eric P. Xing

Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that…

Machine Learning · Computer Science 2022-10-13 Guilherme Lourenço de Toledo , Ricardo Marcondes Marcacini

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

Machine Learning · Computer Science 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu

In the last decade, video blogs (vlogs) have become an extremely popular method through which people express sentiment. The ubiquitousness of these videos has increased the importance of multimodal fusion models, which incorporate video and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Nathaniel Blanchard , Daniel Moreira , Aparna Bharati , Walter J. Scheirer

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Current deep learning approaches for multimodal fusion rely on bottom-up fusion of high and mid-level latent modality representations (late/mid fusion) or low level sensory inputs (early fusion). Models of human perception highlight the…

Machine Learning · Computer Science 2022-01-25 Georgios Paraskevopoulos , Efthymios Georgiou , Alexandros Potamianos

Sentiment analysis, mostly based on text, has been rapidly developing in the last decade and has attracted widespread attention in both academia and industry. However, the information in the real world usually comes from multiple…

Computation and Language · Computer Science 2019-12-12 Feiyang Chen , Ziqian Luo , Yanyan Xu , Dengfeng Ke

With the rapid development of multimedia, the shift from unimodal textual sentiment analysis to multimodal image-text sentiment analysis has obtained academic and industrial attention in recent years. However, multimodal sentiment analysis…

Multimedia · Computer Science 2024-12-11 Fuhai Chen , Pengpeng Huang , Xuri Ge , Jie Huang , Zishuo Bao

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Multimodal Machine Learning has emerged as a prominent research direction across various applications such as Sentiment Analysis, Emotion Recognition, Machine Translation, Hate Speech Recognition, and Movie Genre Classification. This…

Computation and Language · Computer Science 2023-06-13 Abdelhamid Haouhat , Slimane Bellaouar , Attia Nehar , Hadda Cherroun

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

Sentiment analysis and emotion recognition in videos are challenging tasks, given the diversity and complexity of the information conveyed in different modalities. Developing a highly competent framework that effectively addresses the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Prasad Chaudhari , Aman Kumar , Chandravardhan Singh Raghaw , Mohammad Zia Ur Rehman , Nagendra Kumar

Multimodal sentiment analysis has gained significant attention due to the proliferation of multimodal content on social media. However, existing studies in this area rely heavily on large-scale supervised data, which is time-consuming and…

Computation and Language · Computer Science 2023-08-02 Xiaocui Yang , Shi Feng , Daling Wang , Pengfei Hong , Soujanya Poria