English
Related papers

Related papers: Emotion Entanglement and Bayesian Inference for Mu…

200 papers

We present EmotiCon, a learning-based algorithm for context-aware perceived human emotion recognition from videos and images. Motivated by Frege's Context Principle from psychology, our approach combines three interpretations of context for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Trisha Mittal , Pooja Guhan , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

In this paper, we introduce EmoGist, a training-free, in-context learning method for performing visual emotion classification with LVLMs. The key intuition of our approach is that context-dependent definition of emotion labels could allow…

Computation and Language · Computer Science 2025-09-23 Ronald Seoh , Dan Goldwasser

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Emotion detection in text is an important task in NLP and is essential in many applications. Most of the existing methods treat this task as a problem of single-label multi-class text classification. To predict multiple emotions for one…

Computation and Language · Computer Science 2019-11-11 Chenyang Huang , Amine Trabelsi , Xuebin Qin , Nawshad Farruque , Osmar R. Zaïane

Psychological studies observe that emotions are rarely expressed in isolation and are typically influenced by the surrounding context. While recent studies effectively harness uni- and multimodal cues for emotion inference, hardly any study…

Human-Computer Interaction · Computer Science 2024-02-14 Soujanya Narayana , Ibrahim Radwan , Ramanathan Subramanian , Roland Goecke

We present a novel deep learning-based framework to generate embedding representations of fine-grained emotions that can be used to computationally describe psychological models of emotions. Our framework integrates a contextualized…

Computation and Language · Computer Science 2021-04-21 Yuting Guo , Jinho Choi

For a long time, images have proved perfect at both storing and conveying rich semantics, especially human emotions. A lot of research has been conducted to provide machines with the ability to recognize emotions in photos of people.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Quoc-Bao Ninh , Hai-Chan Nguyen , Triet Huynh , Trung-Nghia Le

Speech emotion recognition (SER) systems are constrained by existing datasets that typically cover only 6-10 basic emotions, lack scale and diversity, and face ethical challenges when collecting sensitive emotional states. We introduce…

Contemporary knowledge-based systems increasingly rely on multilingual emotion identification to support intelligent decision-making, yet they face major challenges due to emotional ambiguity and incomplete supervision. Emotion recognition…

We introduce the SEER (Span-based Emotion Evidence Retrieval) Benchmark to test Large Language Models' (LLMs) ability to identify the specific spans of text that express emotion. Unlike traditional emotion recognition tasks that assign a…

Computation and Language · Computer Science 2025-10-29 Aneesha Sampath , Oya Aran , Emily Mower Provost

Emotions are an inseparable part of human nature affecting our behavior in response to the outside world. Although most empirical studies have been dominated by two theoretical models including discrete categories of emotion and dichotomous…

Neurons and Cognition · Quantitative Biology 2020-10-23 Gelareh Mohammadi , Patrik Vuilleumier

Emotion recognition is a key attribute for artificial intelligence systems that need to naturally interact with humans. However, the task definition is still an open problem due to the inherent ambiguity of emotions. In this paper, a novel…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Xixin Wu , Philip C. Woodland

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Emotion recognition in conversation, which aims to predict the emotion for all utterances, has attracted considerable research attention in recent years. It is a challenging task since the recognition of the emotion in one utterance…

Computation and Language · Computer Science 2023-06-13 Ting Zhang , Zhuang Chen , Ming Zhong , Tieyun Qian

We investigate cross-lingual sentiment analysis, which has attracted significant attention due to its applications in various areas including market research, politics and social sciences. In particular, we introduce a sentiment analysis…

Machine Learning · Computer Science 2022-02-08 Selim F. Yilmaz , E. Batuhan Kaynak , Aykut Koç , Hamdi Dibeklioğlu , Suleyman S. Kozat

Emotion recognition in conversation (ERC) aims to identify the emotion of each utterance in a conversation, playing a vital role in empathetic artificial intelligence. With the growing of large language models (LLMs), instruction tuning has…

Computation and Language · Computer Science 2025-08-19 Hui Ma , Bo Zhang , Jinpeng Hu , Zenglin Shi

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

Speech emotion recognition (SER), particularly for naturally expressed emotions, remains a challenging computational task. Key challenges include the inherent subjectivity in emotion annotation and the imbalanced distribution of emotion…

Sound · Computer Science 2025-06-03 Tiantian Feng , Thanathai Lertpetchpun , Dani Byrd , Shrikanth Narayanan

Image emotion classification (IEC) is a longstanding research field that has received increasing attention with the rapid progress of deep learning. Although recent advances have leveraged the knowledge encoded in pre-trained visual models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zibo Zhou , Zhengjun Zhai , Huimin Chen , Wei Dai , Hansen Yang

Emotion understanding is a critical yet challenging task. Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced their capabilities in this area. However, MLLMs often suffer from hallucinations, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Bohao Xing , Xin Liu , Guoying Zhao , Chengyu Liu , Xiaolan Fu , Heikki Kälviäinen