English
Related papers

Related papers: A Deep Multi-Level Attentive network for Multimoda…

200 papers

Multimodal target/aspect sentiment classification combines multimodal sentiment analysis and aspect/target sentiment classification. The goal of the task is to combine vision and language to understand the sentiment towards a target entity…

Computation and Language · Computer Science 2021-08-09 Zaid Khan , Yun Fu

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

Multimodal fine-grained sentiment analysis has recently attracted increasing attention due to its broad applications. However, the existing multimodal fine-grained sentiment datasets most focus on annotating the fine-grained elements in…

Computation and Language · Computer Science 2022-06-29 Hao Yang , Yanyan Zhao , Jianwei Liu , Yang Wu , Bing Qin

Multimodal dimensional emotion recognition has drawn a great attention from the affective computing community and numerous schemes have been extensively investigated, making a significant progress in this area. However, several questions…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Dung Nguyen , Duc Thanh Nguyen , Rui Zeng , Thanh Thi Nguyen , Son N. Tran , Thin Nguyen , Sridha Sridharan , Clinton Fookes

Social media networks have become a significant aspect of people's lives, serving as a platform for their ideas, opinions and emotions. Consequently, automated sentiment analysis (SA) is critical for recognising people's feelings in ways…

Computation and Language · Computer Science 2024-10-03 Israa Khalaf Salman Al-Tameemi , Mohammad-Reza Feizi-Derakhshi , Saeed Pashazadeh , Mohammad Asadpour

Understanding Affect from video segments has brought researchers from the language, audio and video domains together. Most of the current multimodal research in this area deals with various techniques to fuse the modalities, and mostly…

Computation and Language · Computer Science 2018-06-11 Saurav Sahay , Shachi H Kumar , Rui Xia , Jonathan Huang , Lama Nachman

Visual Emotion Analysis (VEA) is attracting increasing attention. One of the biggest challenges of VEA is to bridge the affective gap between visual clues in a picture and the emotion expressed by the picture. As the granularity of emotions…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Liwen Xu , Zhengtao Wang , Bin Wu , Simon Lui

Sentiment analysis of online user generated content is important for many social media analytics tasks. Researchers have largely relied on textual sentiment analysis to develop systems to predict political elections, measure economic…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Quanzeng You , Jiebo Luo , Hailin Jin , Jianchao Yang

We propose a novel two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis. The novel two-layered attention network takes advantage of the external knowledge bases to improve the sentiment…

Computation and Language · Computer Science 2018-06-19 Abhishek Kumar , Daisuke Kawahara , Sadao Kurohashi

Multimodal Sentiment Analysis (MSA) seeks to understand human emotions by jointly analyzing data from multiple modalities typically text and images offering a richer and more accurate interpretation than unimodal approaches. In this paper,…

Machine Learning · Computer Science 2025-10-29 Phuong Q. Dao , Mark Roantree , Vuong M. Ngo

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

Machine Learning · Computer Science 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Compared with facial emotion recognition on categorical model, the dimensional emotion recognition can describe numerous emotions of the real world more accurately. Most prior works of dimensional emotion estimation only considered…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Xiaohua Wang , Muzi Peng , Lijuan Pan , Min Hu , Chunhua Jin , Fuji Ren

Human beings have rich ways of emotional expressions, including facial action, voice, and natural languages. Due to the diversity and complexity of different individuals, the emotions expressed by various modalities may be semantically…

Artificial Intelligence · Computer Science 2023-02-06 Chuan Zhang , Daoxin Zhang , Ruixiu Zhang , Jiawei Li , Jianke Zhu

The effectiveness of a model is heavily reliant on the quality of the fusion representation of multiple modalities in multimodal sentiment analysis. Moreover, each modality is extracted from raw input and integrated with the rest to…

Machine Learning · Computer Science 2023-12-06 Cong-Duy Nguyen , Thong Nguyen , Duc Anh Vu , Luu Anh Tuan

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Inspired by the fact that different modalities in videos carry complementary information, we propose a Multimodal Semantic Attention Network(MSAN), which is a new encoder-decoder framework incorporating multimodal semantic attributes for…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Liang Sun , Bing Li , Chunfeng Yuan , Zhengjun Zha , Weiming Hu

Multimodal aspect-based sentiment analysis (MABSA) aims to identify aspect-level sentiments by jointly modeling textual and visual information, which is essential for fine-grained opinion understanding in social media. Existing approaches…

Computation and Language · Computer Science 2026-01-13 Zhongzheng Wang , Yuanhe Tian , Hongzhi Wang , Yan Song

A multi-modal emotion recognition method was established by combining two-channel convolutional neural network with ring network. This method can extract emotional information effectively and improve learning efficiency. The words were…

Artificial Intelligence · Computer Science 2023-11-21 Jiazhen Wang

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin