English
Related papers

Related papers: Multimodal Emotion Classification

200 papers

Large Language Models (LLMs) have rapidly become central to NLP, demonstrating their ability to adapt to various tasks through prompting techniques, including sentiment analysis. However, we still have a limited understanding of how these…

Computation and Language · Computer Science 2025-06-02 Dario Di Palma , Alessandro De Bellis , Giovanni Servedio , Vito Walter Anelli , Fedelucio Narducci , Tommaso Di Noia

Word embeddings are one of the most useful tools in any modern natural language processing expert's toolkit. They contain various types of information about each word which makes them the best way to represent the terms in any NLP task. But…

Computation and Language · Computer Science 2019-06-20 Armin Seyeditabari , Narges Tabari , Shafie Gholizade , Wlodek Zadrozny

The significance of emotion detection is increasing in education, entertainment, and various other domains. We are developing a system that can identify and transform facial expressions into emojis to provide immediate feedback.The project…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Abhilash Khuntia , Shubham Kale

Emotion recognition (ER) is an important task in Natural Language Processing (NLP), due to its high impact in real-world applications from health and well-being to author profiling, consumer analysis and security. Current approaches to ER,…

Computation and Language · Computer Science 2021-01-26 Hassan Alhuzali , Sophia Ananiadou

Emotion classification in text is typically performed with neural network models which learn to associate linguistic units with emotions. While this often leads to good predictive performance, it does only help to a limited degree to…

Computation and Language · Computer Science 2022-05-17 Felix Casel , Amelie Heindl , Roman Klinger

Metaphors play a pivotal role in expressing emotions, making them crucial for emotional intelligence. The advent of multimodal data and widespread communication has led to a proliferation of multimodal metaphors, amplifying the complexity…

Computation and Language · Computer Science 2025-05-21 Xingyuan Lu , Yuxi Liu , Dongyu Zhang , Zhiyao Wu , Jing Ren , Feng Xia

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

Multimedia · Computer Science 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

Large language models (LLMs) are increasingly deployed in real-world communication settings, yet their ability to resolve context-dependent ambiguity remains underexplored. In this work, we present EMODIS, a new benchmark for evaluating…

Computation and Language · Computer Science 2025-11-11 Jiacheng Huang , Ning Yu , Xiaoyin Yi

We widely use emojis in social networking to heighten, mitigate or negate the sentiment of the text. Emoji suggestions already exist in many cross-platform applications but an emoji is predicted solely based a few prominent words instead of…

Computation and Language · Computer Science 2021-03-16 Pranav Venkit , Zeba Karishma , Chi-Yang Hsu , Rahul Katiki , Kenneth Huang , Shomir Wilson , Patrick Dudas

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada

Emotion analysis has been attracting researchers' attention. Most previous works in the artificial intelligence field focus on recognizing emotion rather than mining the reason why emotions are not or wrongly recognized. Correlation among…

Computation and Language · Computer Science 2020-07-29 Xinzhi Wang , Luyao Kou , Vijayan Sugumaran , Xiangfeng Luo , Hui Zhang

The furnishing of multi-modal large language models (MLLMs) has led to the emergence of numerous benchmark studies, particularly those evaluating their perception and understanding capabilities. Among these, understanding image-evoked…

Multimedia · Computer Science 2025-09-18 Lancheng Gao , Ziheng Jia , Yunhao Zeng , Wei Sun , Yiming Zhang , Wei Zhou , Guangtao Zhai , Xiongkuo Min

Emotion recognition has become an important field of research in Human Computer Interactions as we improve upon the techniques for modelling the various aspects of behaviour. With the advancement of technology our understanding of emotions…

Artificial Intelligence · Computer Science 2019-11-11 Samarth Tripathi , Sarthak Tripathi , Homayoon Beigi

Humans are able to comprehend information from multiple domains for e.g. speech, text and visual. With advancement of deep learning technology there has been significant improvement of speech recognition. Recognizing emotion from speech is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Mandeep Singh , Yuan Fang

In recent years, sentiment analysis and emotion classification are two of the most abundantly used techniques in the field of Natural Language Processing (NLP). Although sentiment analysis and emotion classification are used commonly in…

Machine Learning · Computer Science 2021-05-05 Muhammad Zain Ali , Kashif Javed , Ehsan ul Haq , Anoshka Tariq

Emojis, as a new way of conveying nonverbal cues, are widely adopted in computer-mediated communications. In this paper, first from a message sender perspective, we focus on people's motives in using four types of emojis -- positive,…

Computation and Language · Computer Science 2017-03-09 Tianran Hu , Han Guo , Hao Sun , Thuy-vy Thi Nguyen , Jiebo Luo

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Emotion recognition is the task of classifying perceived emotions in people. Previous works have utilized various nonverbal cues to extract features from images and correlate them to emotions. Of these cues, situational context is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Willams de Lima Costa , Estefania Talavera Martinez , Lucas Silva Figueiredo , Veronica Teichrieb

Neural network methods have achieved great success in reviews sentiment classification. Recently, some works achieved improvement by incorporating user and product information to generate a review representation. However, in reviews, we…

Computation and Language · Computer Science 2018-01-25 Zhen Wu , Xin-Yu Dai , Cunyan Yin , Shujian Huang , Jiajun Chen

Textual emotional intelligence is playing a ubiquitously important role in leveraging human emotions on social media platforms. Social media platforms are privileged with emotional content and are leveraged for various purposes like opinion…

Computation and Language · Computer Science 2023-01-10 Danish Muzafar , Furqan Yaqub Khan , Mubashir Qayoom