English
Related papers

Related papers: Contextual Attention-Based Multimodal Fusion of LL…

200 papers

Visual multimedia have become an inseparable part of our digital social lives, and they often capture moments tied with deep affections. Automated visual sentiment analysis tools can provide a means of extracting the rich feelings and…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Victor Campos , Brendan Jou , Xavier Giro-i-Nieto

Multimodal sentiment analysis enhances conventional sentiment analysis, which traditionally relies solely on text, by incorporating information from different modalities such as images, text, and audio. This paper proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Taoxu Zhao , Meisi Li , Kehao Chen , Liye Wang , Xucheng Zhou , Kunal Chaturvedi , Mukesh Prasad , Ali Anaissi , Ali Braytee

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

Convolutional neural networks (CNNs) have recently emerged as a popular building block for natural language processing (NLP). Despite their success, most existing CNN models employed in NLP share the same learned (and static) set of filters…

Computation and Language · Computer Science 2018-08-31 Dinghan Shen , Martin Renqiang Min , Yitong Li , Lawrence Carin

We introduce AdaptiSent, a new framework for Multimodal Aspect-Based Sentiment Analysis (MABSA) that uses adaptive cross-modal attention mechanisms to improve sentiment classification and aspect term extraction from both text and images.…

Computation and Language · Computer Science 2025-07-18 S M Rafiuddin , Sadia Kamal , Mohammed Rakib , Arunkumar Bagavathi , Atriya Sen

Empathetic and coherent responses are critical in auto-mated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric…

Computation and Language · Computer Science 2025-03-12 Abdur Rasool , Muhammad Irfan Shahzad , Hafsa Aslam , Vincent Chan , Muhammad Ali Arshad

Humans express feelings or emotions via different channels. Take language as an example, it entails different sentiments under different visual-acoustic contexts. To precisely understand human intentions as well as reduce the…

Artificial Intelligence · Computer Science 2021-11-17 Ting Wu , Junjie Peng , Wenqiang Zhang , Huiran Zhang , Chuanshuai Ma , Yansong Huang

With the development of the Internet, natural language processing (NLP), in which sentiment analysis is an important task, became vital in information processing.Sentiment analysis includes aspect sentiment classification. Aspect sentiment…

Computation and Language · Computer Science 2018-07-06 Yongping Xing , Chuangbai Xiao , Yifei Wu , Ziming Ding

Sentiment analysis has been emerging recently as one of the major natural language processing (NLP) tasks in many applications. Especially, as social media channels (e.g. social networks or forums) have become significant sources for brands…

Computation and Language · Computer Science 2019-12-23 Khuong Vo , Tri Nguyen , Dang Pham , Mao Nguyen , Minh Truong , Trung Mai , Tho Quan

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Recent Transformer-based contextual word representations, including BERT and XLNet, have shown state-of-the-art performance in multiple disciplines within NLP. Fine-tuning the trained contextual models on task-specific datasets has been the…

Machine Learning · Computer Science 2020-11-24 Wasifur Rahman , Md. Kamrul Hasan , Sangwu Lee , Amir Zadeh , Chengfeng Mao , Louis-Philippe Morency , Ehsan Hoque

This study addressed the complex task of sentiment analysis on a dataset of 119,988 original tweets from Weibo using a Convolutional Neural Network (CNN), offering a new approach to Natural Language Processing (NLP). The data, sourced from…

Computation and Language · Computer Science 2023-07-14 Yufei Xie , Rodolfo C. Raga

Sentiment analysis is a vital tool for uncovering insights from financial articles, news, and social media, shaping our understanding of market movements. Despite the impressive capabilities of large language models (LLMs) in financial…

Computation and Language · Computer Science 2023-06-23 Boyu Zhang , Hongyang Yang , Xiao-Yang Liu

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan

Advances in social media data dissemination enable the provision of real-time information during a crisis. The information comes from different classes, such as infrastructure damages, persons missing or stranded in the affected zone, etc.…

Computation and Language · Computer Science 2026-03-20 Thi Huyen Nguyen , Koustav Rudra , Wolfgang Nejdl

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Multimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this paper,…

Computation and Language · Computer Science 2017-07-25 Amir Zadeh , Minghai Chen , Soujanya Poria , Erik Cambria , Louis-Philippe Morency

Traditional approaches in speech emotion recognition, such as LSTM, CNN, RNN, SVM, and MLP, have limitations such as difficulty capturing long-term dependencies in sequential data, capturing the temporal dynamics, and struggling to capture…

Sound · Computer Science 2023-08-10 Samiul Islam , Md. Maksudul Haque , Abu Jobayer Md. Sadat