English
Related papers

Related papers: Estimating the Uncertainty in Emotion Class Labels…

200 papers

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

Machine Learning · Statistics 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang

Effectiveness of speech emotion recognition in real-world scenarios is often hindered by noisy environments and variability across datasets. This paper introduces a two-step approach to enhance the robustness and generalization of speech…

Sound · Computer Science 2025-10-13 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

Automated emotion recognition has applications in various fields, such as human-machine interaction, healthcare, security, education, and emotion-aware recommendation/feedback systems. Developing methods to analyze human emotions accurately…

Systems and Control · Electrical Eng. & Systems 2024-09-11 Ruijie Fang , Ruoyu Zhang , Elahe Hosseini , Chongzhou Fang , Mahdi Eslaminehr , Setareh Rafatirad , Houman Homayoun

The emotional content of song lyrics plays a pivotal role in shaping listener experiences and influencing musical preferences. This paper investigates the task of multi-label emotional attribution of song lyrics by predicting six emotional…

Computation and Language · Computer Science 2025-09-09 Shay Dahary , Avi Edana , Alexander Apartsin , Yehudit Aperstein

Machine learning models for speech emotion recognition (SER) can be trained for different tasks and are usually evaluated based on a few available datasets per task. Tasks could include arousal, valence, dominance, emotional categories, or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-13 Anna Derington , Hagen Wierstorf , Ali Özkil , Florian Eyben , Felix Burkhardt , Björn W. Schuller

In this paper, we propose an attention-based classifier that predicts multiple emotions of a given sentence. Our model imitates human's two-step procedure of sentence understanding and it can effectively represent and classify sentences.…

Computation and Language · Computer Science 2018-04-18 Yanghoon Kim , Hwanhee Lee , Kyomin Jung

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger

Language models can learn a range of capabilities from unsupervised training on text corpora. However, to solve a particular problem (such as text summarization) it is typically necessary to fine-tune them on a task-specific dataset. It is…

Computation and Language · Computer Science 2022-03-16 Adam Gleave , Geoffrey Irving

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

Background: Studies have shown the potential adverse health effects, ranging from headaches to cardiovascular disease, associated with long-term negative emotions and chronic stress. Since many indicators of stress are imperceptible to…

Machine Learning · Computer Science 2023-08-29 Joe Li , Peter Washington

In this paper, we investigate the usage of autoencoders in modeling textual data. Traditional autoencoders suffer from at least two aspects: scalability with the high dimensionality of vocabulary size and dealing with task-irrelevant words.…

Machine Learning · Computer Science 2015-12-15 Shuangfei Zhai , Zhongfei Zhang

How are emotions formed? Through extensive debate and the promulgation of diverse theories , the theory of constructed emotion has become prevalent in recent research on emotions. According to this theory, an emotion concept refers to a…

Artificial Intelligence · Computer Science 2024-10-27 Kazuki Tsurumaki , Chie Hieida , Kazuki Miyazawa

Obtaining large, human labelled speech datasets to train models for emotion recognition is a notoriously challenging task, hindered by annotation cost and label ambiguity. In this work, we consider the task of learning embeddings for speech…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Samuel Albanie , Arsha Nagrani , Andrea Vedaldi , Andrew Zisserman

There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performance. Therefore, personalization is an important step in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Minh Tran , Yufeng Yin , Mohammad Soleymani

Emotion understanding is an essential but highly challenging component of artificial general intelligence. The absence of extensively annotated datasets has significantly impeded advancements in this field. We present EmotionCLIP, the first…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Sitao Zhang , Yimu Pan , James Z. Wang

Class probabilities predicted by most multiclass classifiers are uncalibrated, often tending towards over-confidence. With neural networks, calibration can be improved by temperature scaling, a method to learn a single corrective…

Machine Learning · Computer Science 2019-10-29 Meelis Kull , Miquel Perello-Nieto , Markus Kängsepp , Telmo Silva Filho , Hao Song , Peter Flach

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assumed that emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-03 Ismail Rasim Ulgen , Zongyang Du , Carlos Busso , Berrak Sisman