English
Related papers

Related papers: Multimodal Sentiment Analysis To Explore the Struc…

200 papers

Key features of mental illnesses are reflected in speech. Our research focuses on designing a multimodal deep learning structure that automatically extracts salient features from recorded speech samples for predicting various mental…

Machine Learning · Computer Science 2020-04-15 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

Two modalities are often used to convey information in a complementary and beneficial manner, e.g., in online news, videos, educational resources, or scientific publications. The automatic understanding of semantic correlations between text…

Multimedia · Computer Science 2019-06-21 Christian Otto , Matthias Springstein , Avishek Anand , Ralph Ewerth

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Targeted sentiment analysis is the task of jointly predicting target entities and their associated sentiment information. Existing research efforts mostly regard this joint task as a sequence labeling problem, building models that can…

Computation and Language · Computer Science 2019-09-18 Hao Li , Wei Lu

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Social media is abundant in visual and textual information presented together or in isolation. Memes are the most popular form, belonging to the former class. In this paper, we present our approaches for the Memotion Analysis problem as…

Computation and Language · Computer Science 2020-07-23 Vishal Keswani , Sakshi Singh , Suryansh Agarwal , Ashutosh Modi

In this paper, we propose a new framework for fine-grained emotion prediction in the text through emotion definition modeling. Our approach involves a multi-task learning framework that models definitions of emotions as an auxiliary task…

Computation and Language · Computer Science 2021-07-27 Gargi Singh , Dhanajit Brahma , Piyush Rai , Ashutosh Modi

Over the last few years, social media has evolved into a medium for expressing personal views, emotions, and even business and political proposals, recommendations, and advertisements. We address the topic of identifying emotions from text…

Machine Learning · Computer Science 2025-11-06 Md Mahbubur Rahman , Shaila Sharmin

Multi-modal aspect-based sentiment classification (MABSC) is task of classifying the sentiment of a target entity mentioned in a sentence and an image. However, previous methods failed to account for the fine-grained semantic association…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yufeng Huang , Zhuo Chen , Jiaoyan Chen , Jeff Z. Pan , Zhen Yao , Wen Zhang

Social media users articulate their opinions on a broad spectrum of subjects and share their experiences through posts comprising multiple modes of expression, leading to a notable surge in such multimodal content on social media platforms.…

Information Retrieval · Computer Science 2024-12-17 Shubhi Bansal , Mohit Kumar , Chandravardhan Singh Raghaw , Nagendra Kumar

With the explosive growth of social media, opinionated postings with emojis have increased explosively. Many emojis are used to express emotions, attitudes, and opinions. Emoji representation learning can be helpful to improve the…

Computation and Language · Computer Science 2022-05-24 Xiaowei Yuan , Jingyuan Hu , Xiaodan Zhang , Honglei Lv

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Over the last few years, machine learning over graph structures has manifested a significant enhancement in text mining applications such as event detection, opinion mining, and news recommendation. One of the primary challenges in this…

Computation and Language · Computer Science 2019-11-26 Kayvan Bijari , Hadi Zare , Emad Kebriaei , Hadi Veisi

Leibniz's Monadology mentions perceptional and sentimental variations of the individual in the city. It is the interaction of people with people and events. Film festivals are highly sentimental events of multicultural cities. Each movie…

Computers and Society · Computer Science 2021-02-19 Mehmet Can Yavuz

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

Emotional concepts play a huge role in our daily life since they take part into many cognitive processes: from the perception of the environment around us to different learning processes and natural communication. Social robots need to…

Neural and Evolutionary Computing · Computer Science 2018-08-02 Pablo Barros , Emilia Barakova , Stefan Wermter

Because multimodal data contains more modal information, multimodal sentiment analysis has become a recent research hotspot. However, redundant information is easily involved in feature fusion after feature extraction, which has a certain…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Huiru Wang , Xiuhong Li , Zenyu Ren , Dan Yang , chunming Ma

With ubiquity of social media platforms, millions of people are sharing their online persona by expressing their thoughts, moods, emotions, feelings, and even their daily struggles with mental health issues voluntarily and publicly on…

In this paper, we address the problem of detection, classification and quantification of emotions of text in any form. We consider English text collected from social media like Twitter, which can provide information having utility in a…

Social and Information Networks · Computer Science 2019-06-13 Bharat Gaind , Varun Syal , Sneha Padgalwar

How are emotions formed? Through extensive debate and the promulgation of diverse theories , the theory of constructed emotion has become prevalent in recent research on emotions. According to this theory, an emotion concept refers to a…

Artificial Intelligence · Computer Science 2024-10-27 Kazuki Tsurumaki , Chie Hieida , Kazuki Miyazawa