English
Related papers

Related papers: Multimodal Sentiment Analysis Based on BERT and Re…

200 papers

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin

We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing. Our goal is different than the standard sentiment analysis goal of predicting whether a…

Machine Learning · Statistics 2018-05-28 Anthony Hu , Seth Flaxman

Multimodal sentiment analysis has attracted increasing attention with broad application prospects. The existing methods focuses on single modality, which fails to capture the social media content for multiple modalities. Moreover, in…

Multimedia · Computer Science 2022-05-11 Ashima Yadav , Dinesh Kumar Vishwakarma

We propose a deep architecture for depression detection from social media posts. The proposed architecture builds upon BERT to extract language representations from social media posts and combines these representations using an attentive…

Computation and Language · Computer Science 2023-03-28 Ilias Triantafyllopoulos , Georgios Paraskevopoulos , Alexandros Potamianos

Emotion Recognition in Conversations (ERC) is crucial in developing sympathetic human-machine interaction. In conversational videos, emotion can be present in multiple modalities, i.e., audio, video, and transcript. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Vishal Chudasama , Purbayan Kar , Ashish Gudmalwar , Nirmesh Shah , Pankaj Wasnik , Naoyuki Onoe

Sentiment analysis is the computational study of opinions and emotions ex-pressed in text. Deep learning is a model that is currently producing state-of-the-art in various application domains, including sentiment analysis. Many researchers…

Computation and Language · Computer Science 2022-11-11 Hendri Murfi , Syamsyuriani , Theresia Gowandi , Gianinna Ardaneswari , Siti Nurrohmah

As posts on social media increase rapidly, analyzing the sentiments embedded in image-text pairs has become a popular research topic in recent years. Although existing works achieve impressive accomplishments in simultaneously harnessing…

Computation and Language · Computer Science 2025-12-04 Daiqing Wu , Dongbao Yang , Yu Zhou , Can Ma

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Multimodal emotion recognition from speech is an important area in affective computing. Fusing multiple data modalities and learning representations with limited amounts of labeled data is a challenging task. In this paper, we explore the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Shamane Siriwardhana , Andrew Reis , Rivindu Weerasekera , Suranga Nanayakkara

Self-supervised bidirectional transformer models such as BERT have led to dramatic improvements in a wide variety of textual classification tasks. The modern digital world is increasingly multimodal, however, and textual information is…

Computation and Language · Computer Science 2020-11-13 Douwe Kiela , Suvrat Bhooshan , Hamed Firooz , Ethan Perez , Davide Testuggine

Artificial intelligence has shown the potential to improve diagnostic accuracy through medical image analysis for pneumonia diagnosis. However, traditional multimodal approaches often fail to address real-world challenges such as incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Jingyu Xu , Yang Wang

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

Multimedia · Computer Science 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

Memes are one of the most popular types of content used to spread information online. They can influence a large number of people through rhetorical and psychological techniques. The task, Detection of Persuasion Techniques in Texts and…

Computation and Language · Computer Science 2021-06-02 Kshitij Gupta , Devansh Gautam , Radhika Mamidi

Sentiment analysis (SA) has become an extensive research area in recent years impacting diverse fields including ecommerce, consumer business, and politics, driven by increasing adoption and usage of social media platforms. It is…

Computation and Language · Computer Science 2021-06-03 Sarojadevi Palani , Prabhu Rajagopal , Sidharth Pancholi

Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities,…

Multimedia · Computer Science 2025-12-02 Heng Xie , Kang Zhu , Zhengqi Wen , Jianhua Tao , Xuefei Liu , Ruibo Fu , Changsheng Li

Memes have become a distinctive and effective form of communication in the digital era, attracting online communities and cutting across cultural barriers. Even though memes are frequently linked with humor, they have an amazing capacity to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kazi Toufique Elahi , Tasnuva Binte Rahman , Shakil Shahriar , Samir Sarker , Sajib Kumar Saha Joy , Faisal Muhammad Shah

Emotion recognition has become a major problem in computer vision in recent years that made a lot of effort by researchers to overcome the difficulties in this task. In the field of affective computing, emotion recognition has a wide range…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Hoang Manh Hung , Hyung-Jeong Yang , Soo-Hyung Kim , Guee-Sang Lee

BERT has revolutionized the NLP field by enabling transfer learning with large language models that can capture complex textual patterns, reaching the state-of-the-art for an expressive number of NLP applications. For text classification…

Computation and Language · Computer Science 2022-01-11 Frederico Souza , João Filho