English
Related papers

Related papers: A Deep Multi-Level Attentive network for Multimoda…

200 papers

Multimodal Sentiment Analysis (MSA) with missing modalities has recently attracted increasing attention. Although existing research mainly focuses on designing complex model architectures to handle incomplete data, it still faces…

Multimedia · Computer Science 2025-08-01 Xiang Li , Xianfu Cheng , Xiaoming Zhang , Zhoujun Li

Multimodal Sentiment Analysis (MSA) integrates complementary features from text, video, and audio for robust emotion understanding in human interactions. However, models suffer from severe data scarcity and high annotation costs, severely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Hongyu Zhu , Lin Chen , Xin Jin , Mingsheng Shang

Aspect-level sentiment classification aims to identify the sentiment polarity towards a specific aspect term in a sentence. Most current approaches mainly consider the semantic information by utilizing attention mechanisms to capture the…

Computation and Language · Computer Science 2021-02-12 Xiaochen Hou , Jing Huang , Guangtao Wang , Xiaodong He , Bowen Zhou

Multimodal affective computing has gained increasing attention due to its broad applications in understanding human behavior and intentions, particularly in text-centric multimodal scenarios. Existing research spans diverse tasks,…

Computation and Language · Computer Science 2026-04-08 Guimin Hu , Weimin Lyu , Chang Sun , Zhihong Zhu , Lin Gui , Ruichu Cai , Erik Cambria , Hasti Seifi

Multimodal sentiment analysis, which includes both image and text data, presents several challenges due to the dissimilarities in the modalities of text and image, the ambiguity of sentiment, and the complexities of contextual meaning. In…

Machine Learning · Computer Science 2026-02-03 Sumana Biswas , Karen Young , Josephine Griffith

Multimedia content in social media platforms provides significant information during disaster events. The types of information shared include reports of injured or deceased people, infrastructure damage, and missing or found people, among…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Ferda Ofli , Firoj Alam , Muhammad Imran

In this paper, we propose a two-layered multi-task attention based neural network that performs sentiment analysis through emotion analysis. The proposed approach is based on Bidirectional Long Short-Term Memory and uses Distributional…

Computation and Language · Computer Science 2019-12-02 Abhishek Kumar , Asif Ekbal , Daisuke Kawahra , Sadao Kurohashi

Sentiment analysis has been emerging recently as one of the major natural language processing (NLP) tasks in many applications. Especially, as social media channels (e.g. social networks or forums) have become significant sources for brands…

Computation and Language · Computer Science 2019-12-23 Khuong Vo , Tri Nguyen , Dang Pham , Mao Nguyen , Minh Truong , Trung Mai , Tho Quan

We address the problem of phrase grounding by lear ing a multi-level common semantic space shared by the textual and visual modalities. We exploit multiple levels of feature maps of a Deep Convolutional Neural Network, as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Hassan Akbari , Svebor Karaman , Surabhi Bhargava , Brian Chen , Carl Vondrick , Shih-Fu Chang

In multimodal sentiment analysis, collecting text data is often more challenging than video or audio due to higher annotation costs and inconsistent automatic speech recognition (ASR) quality. To address this challenge, our study has…

Computation and Language · Computer Science 2025-03-25 Yuzhe Weng , Haotian Wang , Tian Gao , Kewei Li , Shutong Niu , Jun Du

Despite multimodal sentiment analysis being a fertile research ground that merits further investigation, current approaches take up high annotation cost and suffer from label ambiguity, non-amicable to high-quality labeled data acquisition.…

Computation and Language · Computer Science 2024-12-16 Jinhao Lin , Yifei Wang , Yanwu Xu , Qi Liu

This paper describes our deep learning-based approach to multilingual aspect-based sentiment analysis as part of SemEval 2016 Task 5. We use a convolutional neural network (CNN) for both aspect extraction and aspect-based sentiment…

Computation and Language · Computer Science 2016-09-23 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective…

Artificial Intelligence · Computer Science 2017-04-26 Changde Du , Changying Du , Jinpeng Li , Wei-long Zheng , Bao-liang Lu , Huiguang He

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou

Social media users articulate their opinions on a broad spectrum of subjects and share their experiences through posts comprising multiple modes of expression, leading to a notable surge in such multimodal content on social media platforms.…

Information Retrieval · Computer Science 2024-12-17 Shubhi Bansal , Mohit Kumar , Chandravardhan Singh Raghaw , Nagendra Kumar

This paper investigates the optimal selection and fusion of feature encoders across multiple modalities and combines these in one neural network to improve sentiment detection. We compare different fusion methods and examine the impact of…

Computation and Language · Computer Science 2024-06-04 Zehui Wu , Ziwei Gong , Jaywon Koo , Julia Hirschberg

We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand…

Multimedia · Computer Science 2021-03-23 Qiuchi Li , Dimitris Gkoumas , Christina Lioma , Massimo Melucci

Visual multimedia have become an inseparable part of our digital social lives, and they often capture moments tied with deep affections. Automated visual sentiment analysis tools can provide a means of extracting the rich feelings and…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Victor Campos , Brendan Jou , Xavier Giro-i-Nieto

The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the core semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ananya Pandey , Dinesh Kumar Vishwakarma