English
Related papers

Related papers: A Unified and Interpretable Emotion Representation…

200 papers

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

This paper presents the results of the SUN team for the Compound Expressions Recognition Challenge of the 6th ABAW Competition. We propose a novel audio-visual method for compound expression recognition. Our method relies on emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Elena Ryumina , Maxim Markitantov , Dmitry Ryumin , Heysem Kaya , Alexey Karpov

Generative models have surged in popularity recently due to their ability to produce high-quality images and video. However, steering these models to produce images with specific attributes and precise control remains challenging. Humans,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Tuomas Varanka , Huai-Qian Khor , Yante Li , Mengting Wei , Hanwei Kung , Nicu Sebe , Guoying Zhao

Emotion recognition has received considerable attention from the Computer Vision community in the last 20 years. However, most of the research focused on analyzing the six basic emotions (e.g. joy, anger, surprise), with a limited work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mina Bishay , Jay Turcot , Graham Page , Mohammad Mavadati

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

When assigning quantitative labels to a dataset, different methodologies may rely on different scales. In particular, when assigning polarities to words in a sentiment lexicon, annotators may use binary, categorical, or continuous labels.…

Computation and Language · Computer Science 2019-04-08 Alexander Hoyle , Lawrence Wolf-Sonkin , Hanna Wallach , Ryan Cotterell , Isabelle Augenstein

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

Computational modeling of the emotions evoked by art in humans is a challenging problem because of the subjective and nuanced nature of art and affective signals. In this paper, we consider the above-mentioned problem of understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Digbalay Bose , Krishna Somandepalli , Souvik Kundu , Rimita Lahiri , Jonathan Gratch , Shrikanth Narayanan

We propose a cross-modal co-attention model for continuous emotion recognition using visual-audio-linguistic information. The model consists of four blocks. The visual, audio, and linguistic blocks are used to learn the spatial-temporal…

Multimedia · Computer Science 2022-03-31 Su Zhang , Ruyi An , Yi Ding , Cuntai Guan

Emotion detection in text is an important task in NLP and is essential in many applications. Most of the existing methods treat this task as a problem of single-label multi-class text classification. To predict multiple emotions for one…

Computation and Language · Computer Science 2019-11-11 Chenyang Huang , Amine Trabelsi , Xuebin Qin , Nawshad Farruque , Osmar R. Zaïane

The main idea of this ISO is to use StarGAN (A type of GAN model) to perform training and testing on an emotion dataset resulting in a emotion recognition which can be generated by the valence arousal score of the 7 basic expressions. We…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Aritra Banerjee , Dimitrios Kollias

Managing the emotional aspect remains a challenge in automatic music generation. Prior works aim to learn various emotions at once, leading to inadequate modeling. This paper explores the disentanglement of emotions in piano performance…

Sound · Computer Science 2024-07-31 Jingyue Huang , Ke Chen , Yi-Hsuan Yang

The analysis of emotions expressed in text has numerous applications. In contrast to categorical analysis, focused on classifying emotions according to a pre-defined set of common classes, dimensional approaches can offer a more nuanced way…

Computation and Language · Computer Science 2023-02-28 Gonçalo Azevedo Mendes , Bruno Martins

Recent research shows that emotions can enhance users' cognition and influence information communication. While research on visual emotion analysis is extensive, limited work has been done on helping users generate emotionally rich image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shengqi Dang , Yi He , Long Ling , Ziqing Qian , Nanxuan Zhao , Nan Cao

Humans possess the unique ability to communicate emotions through language. Although concepts like anger or awe are abstract, there is a shared consensus about what these English emotion words mean. This consensus may give the impression…

Computation and Language · Computer Science 2021-08-11 Aotao Xu , Jennifer E. Stellar , Yang Xu

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

The paper concerns affective information systems that represent and visualize human emotional states. The goal of the study was to find typical representations of discrete and dimensional emotion models in terms of color, size, speed,…

Human-Computer Interaction · Computer Science 2026-04-14 Michal R Wrobel , Agnieszka Landowska , Karolina Makuch

Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xuxiong Liu , Kang Shen , Jun Yao , Boyan Wang , Minrui Liu , Liuwei An , Zishun Cui , Weijie Feng , Xiao Sun

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger