English
Related papers

Related papers: A Circular-Structured Representation for Visual Em…

200 papers

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Kaicheng Fu , Changde Du , Shengpei Wang , Huiguang He

Most current audio-visual emotion recognition models lack the flexibility needed for deployment in practical applications. We envision a multimodal system that works even when only one modality is available and can be implemented…

Machine Learning · Computer Science 2026-01-13 Lucas Goncalves , Seong-Gyun Leem , Wei-Cheng Lin , Berrak Sisman , Carlos Busso

This paper develops small vision language models to understand visual art, which, given an art work, aims to identify its emotion category and explain this prediction with natural language. While small models are computationally efficient,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Jing Zhang , Liang Zheng , Meng Wang , Dan Guo

Emotion classification in text is typically performed with neural network models which learn to associate linguistic units with emotions. While this often leads to good predictive performance, it does only help to a limited degree to…

Computation and Language · Computer Science 2022-05-17 Felix Casel , Amelie Heindl , Roman Klinger

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Visual emotion expression plays an important role in audiovisual speech communication. In this work, we propose a novel approach to rendering visual emotion expression in speech-driven talking face generation. Specifically, we design an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Sefik Emre Eskimez , You Zhang , Zhiyao Duan

Thanks to large-scale labeled training data, deep neural networks (DNNs) have obtained remarkable success in many vision and multimedia tasks. However, because of the presence of domain shift, the learned knowledge of the well-trained DNNs…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Sicheng Zhao , Xuanbai Chen , Xiangyu Yue , Chuang Lin , Pengfei Xu , Ravi Krishna , Jufeng Yang , Guiguang Ding , Alberto L. Sangiovanni-Vincentelli , Kurt Keutzer

Visual emotion analysis, which has gained considerable attention in the field of affective computing, aims to predict the dominant emotions conveyed by an image. Despite advancements in visual emotion analysis with the emergence of…

Multimedia · Computer Science 2025-05-13 SangEun Lee , Yubeen Lee , Eunil Park

Relationships in scientific data, such as the numerical and spatial distribution relations of features in univariate data, the scalar-value combinations' relations in multivariate data, and the association of volumes in time-varying and…

Machine Learning · Computer Science 2022-07-25 Xiangyang He , Yubo Tao , Shuoliu Yang , Haoran Dai , Hai Lin

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learning techniques which…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-29 Sneha Das , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Emotion recognition from multi-modal physiological and behavioral signals plays a pivotal role in affective computing, yet most existing models remain constrained to the prediction of singular emotions in controlled laboratory settings.…

Machine Learning · Computer Science 2026-02-25 Ming Li , Yong-Jin Liu , Fang Liu , Huankun Sheng , Yeying Fan , Yixiang Wei , Minnan Luo , Weizhan Zhang , Wenping Wang

Emotion understanding is a complex process that involves multiple components. The ability to recognise emotions not only leads to new context awareness methods but also enhances system interaction's effectiveness by perceiving and…

Human-Computer Interaction · Computer Science 2024-10-27 Rukshani Somarathna , Gelareh Mohammadi

Generative AI has significantly advanced text-driven image generation, but it still faces challenges in producing outputs that consistently align with evolving user preferences and intents, particularly in multi-turn dialogue scenarios. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Kun Li , Jianhui Wang , Miao Zhang , Xueqian Wang

Automatic emotion recognition in conversation (ERC) is crucial for emotion-aware conversational artificial intelligence. This paper proposes a distribution-based framework that formulates ERC as a sequence-to-sequence problem for emotion…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Philip C. Woodland

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Ivona Tautkute , Tomasz Trzcinski

Museums are important sites for the dissemination of culture and art. They are institutions rooted in history and tradition; their exhibitions are often designed to highlight these aspects. Recently, a new approach is being explored in the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Émile Bergeron , Tadagbé Dhossou , Sébastien Tremblay , Jean-François Lalonde

Automated emotion detection in speech is a challenging task due to the complex interdependence between words and the manner in which they are spoken. It is made more difficult by the available datasets; their small size and incompatible…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-16 Amith Ananthram , Kailash Karthik Saravanakumar , Jessica Huynh , Homayoon Beigi

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington