English
Related papers

Related papers: A Novel Context-Aware Multimodal Framework for Per…

200 papers

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

Short-form video platforms integrate text, visuals, and audio into complex communicative acts, yet existing research analyzes these modalities in isolation, lacking scalable frameworks to interpret their joint contributions. This study…

Multimedia · Computer Science 2026-01-22 Mingyue Zha , Ho-Chun Herbert Chang

This paper focuses on how to extract opinions over each Persian sentence-level text. Deep learning models provided a new way to boost the quality of the output. However, these architectures need to feed on big annotated data as well as an…

Computation and Language · Computer Science 2020-04-14 Javad PourMostafa Roshan Sharami , Parsa Abbasi Sarabestani , Seyed Abolghasem Mirroshandel

Accurate recognition of human emotions is a crucial challenge in affective computing and human-robot interaction (HRI). Emotional states play a vital role in shaping behaviors, decisions, and social interactions. However, emotional…

Robotics · Computer Science 2024-09-19 Youssef Mohamed , Severin Lemaignan , Arzu Guneysu , Patric Jensfelt , Christian Smith

Memes have become a distinctive and effective form of communication in the digital era, attracting online communities and cutting across cultural barriers. Even though memes are frequently linked with humor, they have an amazing capacity to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kazi Toufique Elahi , Tasnuva Binte Rahman , Shakil Shahriar , Samir Sarker , Sajib Kumar Saha Joy , Faisal Muhammad Shah

Multimodal sentiment analysis (MSA), which supposes to improve text-based sentiment analysis with associated acoustic and visual modalities, is an emerging research area due to its potential applications in Human-Computer Interaction (HCI).…

Multimedia · Computer Science 2022-09-07 Yihe Liu , Ziqi Yuan , Huisheng Mao , Zhiyun Liang , Wanqiuyue Yang , Yuanzhe Qiu , Tie Cheng , Xiaoteng Li , Hua Xu , Kai Gao

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal…

Machine Learning · Computer Science 2019-08-19 Navonil Majumder , Soujanya Poria , Gangeshwar Krishnamurthy , Niyati Chhaya , Rada Mihalcea , Alexander Gelbukh

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

Artificial Intelligence · Computer Science 2023-06-06 Puneet Kumar , Xiaobai Li

Sentiment analysis is a research topic focused on analysing data to extract information related to the sentiment that it causes. Applications of sentiment analysis are wide, ranging from recommendation systems, and marketing to customer…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , António Gaspar , Luís A. Alexandre , João Cordeiro

Today, Social networks such as Twitter are the most widely used platforms for communication of people. Analyzing this data has useful information to recognize the opinion of people in tweets. Sentiment analysis plays a vital role in NLP,…

Computation and Language · Computer Science 2026-02-25 Seyed Himan Ghaderi , Saeed Sarbazi Azad , Mohammad Mehdi Jaziriyan , Ahmad Akbari

Recently, multimodal sentiment analysis has seen remarkable advance and a lot of datasets are proposed for its development. In general, current multimodal sentiment analysis datasets usually follow the traditional system of…

Computation and Language · Computer Science 2021-09-20 Hongxuan Tang , Hao Liu , Xinyan Xiao , Hua Wu

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

This paper proposes a system capable of recognizing a speaker's utterance-level emotion through multimodal cues in a video. The system seamlessly integrates multiple AI models to first extract and pre-process multimodal information from the…

Human-Computer Interaction · Computer Science 2023-08-29 Sun-Kyung Lee , Jong-Hwan Kim

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

Machine Learning · Computer Science 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Sentiment analysis, the automated process of determining emotions or opinions expressed in text, has seen extensive exploration in the field of natural language processing. However, one aspect that has remained underrepresented is the…

Computation and Language · Computer Science 2024-09-16 Mouad Jbel , Mourad Jabrane , Imad Hafidi , Abdulmutallib Metrane

Multimodal sentiment analysis has a wide range of applications due to its information complementarity in multimodal interactions. Previous works focus more on investigating efficient joint representations, but they rarely consider the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Rongfei Chen , Wenju Zhou , Yang Li , Huiyu Zhou

Multimodal sentiment analysis (MSA) aims to predict human sentiment from textual, acoustic, and visual information in videos. Recent studies improve multimodal fusion by modeling modality interaction and assigning different modality…

Multimedia · Computer Science 2026-04-08 Chen Su , Yuanhe Tian , Yan Song

An automated approach to text readability assessment is essential to a language and can be a powerful tool for improving the understandability of texts written and published in that language. However, the Persian language, which is spoken…

Computation and Language · Computer Science 2020-04-23 Hamid Mohammadi , Seyed Hossein Khasteh

With the rapid development of multimedia, the shift from unimodal textual sentiment analysis to multimodal image-text sentiment analysis has obtained academic and industrial attention in recent years. However, multimodal sentiment analysis…

Multimedia · Computer Science 2024-12-11 Fuhai Chen , Pengpeng Huang , Xuri Ge , Jie Huang , Zishuo Bao