English
Related papers

Related papers: SentiMM: A Multimodal Multi-Agent Framework for Se…

200 papers

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the…

Computation and Language · Computer Science 2016-11-03 Ameya Prabhu , Aditya Joshi , Manish Shrivastava , Vasudeva Varma

Multimodal speech emotion recognition aims to detect speakers' emotions from audio and text. Prior works mainly focus on exploiting advanced networks to model and fuse different modality information to facilitate performance, while…

Computation and Language · Computer Science 2023-04-11 Zhen Wu , Yizhe Lu , Xinyu Dai

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

Multimodal aspect-based sentiment classification (MASC) is an emerging task due to an increase in user-generated multimodal content on social platforms, aimed at predicting sentiment polarity toward specific aspect targets (i.e., entities…

Computation and Language · Computer Science 2025-04-23 Luwei Xiao , Rui Mao , Shuai Zhao , Qika Lin , Yanhao Jia , Liang He , Erik Cambria

Multimodal sentiment analysis has gained significant attention due to the proliferation of multimodal content on social media. However, existing studies in this area rely heavily on large-scale supervised data, which is time-consuming and…

Computation and Language · Computer Science 2023-08-02 Xiaocui Yang , Shi Feng , Daling Wang , Pengfei Hong , Soujanya Poria

Social media platforms are becoming the foundations of social interactions including messaging and opinion expression. In this regard, Sentiment Analysis techniques focus on providing solutions to ensure the retrieval and analysis of…

Machine Learning · Computer Science 2025-03-14 Bousselham El Haddaoui , Raddouane Chiheb , Rdouan Faizi , Abdellatif El Afia

Sentiment Analysis and Emotion Detection in conversation is key in several real-world applications, with an increase in modalities available aiding a better understanding of the underlying emotions. Multi-modal Emotion Detection and…

Computation and Language · Computer Science 2020-08-04 Aman Shenoy , Ashish Sardana

With the rapid growth of unstructured data from social media, reviews, and forums, text mining has become essential in Information Systems (IS) for extracting actionable insights. Summarization can condense fragmented, emotion-rich posts,…

Computation and Language · Computer Science 2025-12-24 Junyi Liu , Stanley Kok

With the proliferation of social media posts in recent years, the need to detect sentiments in multimodal (image-text) content has grown rapidly. Since posts are user-generated, the image and text from the same post can express different or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Daiqing Wu , Dongbao Yang , Huawen Shen , Can Ma , Yu Zhou

Sentiment analysis, mostly based on text, has been rapidly developing in the last decade and has attracted widespread attention in both academia and industry. However, the information in the real world usually comes from multiple…

Computation and Language · Computer Science 2019-12-12 Feiyang Chen , Ziqian Luo , Yanyan Xu , Dengfeng Ke

Memes have become an ubiquitous social media entity and the processing and analysis of suchmultimodal data is currently an active area of research. This paper presents our work on theMemotion Analysis shared task of SemEval 2020, which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Pradyumna Gupta , Himanshu Gupta , Aman Sinha

The widespread availability of code-mixed data can provide valuable insights into low-resource languages like Bengali, which have limited datasets. Sentiment analysis has been a fundamental text classification task across several languages…

Computation and Language · Computer Science 2024-12-11 Sadia Alam , Md Farhan Ishmam , Navid Hasin Alvee , Md Shahnewaz Siddique , Md Azam Hossain , Abu Raihan Mostofa Kamal

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

Multimodal desire understanding, a task closely related to both emotion and sentiment that aims to infer human intentions from visual and textual cues, is an emerging yet underexplored task in affective computing with applications in social…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wei Chen , Tongguan Wang , Feiyue Xue , Junkai Li , Hui Liu , Ying Sha

Recently, Target-oriented Multimodal Sentiment Classification (TMSC) has gained significant attention among scholars. However, current multimodal models have reached a performance bottleneck. To investigate the causes of this problem, we…

Computation and Language · Computer Science 2023-12-27 Junjie Ye , Jie Zhou , Junfeng Tian , Rui Wang , Qi Zhang , Tao Gui , Xuanjing Huang

Multimodal affective computing has gained increasing attention due to its broad applications in understanding human behavior and intentions, particularly in text-centric multimodal scenarios. Existing research spans diverse tasks,…

Computation and Language · Computer Science 2026-04-08 Guimin Hu , Weimin Lyu , Chang Sun , Zhihong Zhu , Lin Gui , Ruichu Cai , Erik Cambria , Hasti Seifi

Multi-label sentiment classification plays a vital role in natural language processing by detecting multiple emotions within a single text. However, existing datasets like GoEmotions often suffer from severe class imbalance, which hampers…

Computation and Language · Computer Science 2026-03-31 Zijin Su , Huanzhu Lyu , Yuren Niu , Yiming Liu

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

Understanding sentiment in complex textual expressions remains a fundamental challenge in affective computing. To address this, we propose a Dynamic Fusion Learning Model (DyFuLM), a multimodal framework designed to capture both…

Computation and Language · Computer Science 2025-12-02 Ruohan Zhou , Jiachen Yuan , Churui Yang , Wenzheng Huang , Guoyan Zhang , Shiyao Wei , Jiazhen Hu , Ning Xin , Md Maruf Hasan