English
Related papers

Related papers: Beyond the Mean: Modelling Annotation Distribution…

200 papers

Emotion expression and perception are nuanced, complex, and highly subjective processes. When multiple annotators label emotional data, the resulting labels contain high variability. Most speech emotion recognition tasks address this by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-16 James Tavernor , Yara El-Tawil , Emily Mower Provost

To train machine learning algorithms to predict emotional expressions in terms of arousal and valence, annotated datasets are needed. However, as different people perceive others' emotional expressions differently, their annotations are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkman

In affective computing, datasets often contain multiple annotations from different annotators, which may lack full agreement. Typically, these annotations are merged into a single gold standard label, potentially losing valuable inter-rater…

Human-Computer Interaction · Computer Science 2025-05-28 Ibrahim Shoer , Engin Erzin

Speech emotion recognition systems often predict a consensus value generated from the ratings of multiple annotators. However, these models have limited ability to predict the annotation of any one person. Alternatively, models can learn to…

Sound · Computer Science 2025-09-17 James Tavernor , Emily Mower Provost

Over the past two decades, speech emotion recognition (SER) has received growing attention. To train SER systems, researchers collect emotional speech databases annotated by crowdsourced or in-house raters who select emotions from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Huang-Cheng Chou , Chi-Chun Lee

Collaborating in a group, whether face-to-face or virtually, involves continuously expressing emotions and interpreting those of other group members. Therefore, understanding group affect is essential to comprehending how groups interact…

Human-Computer Interaction · Computer Science 2024-10-22 Navin Raj Prabhu , Maria Tsfasman , Catharine Oertel , Timo Gerkmann , Nale Lehmann-Willenbrock

Majority voting and averaging are common approaches employed to resolve annotator disagreements and derive single ground truth labels from multiple annotations. However, annotators may systematically disagree with one another, often…

Computation and Language · Computer Science 2021-10-13 Aida Mostafazadeh Davani , Mark Díaz , Vinodkumar Prabhakaran

Emotion is a crucial phenomenon in the functioning of human beings in society. However, it remains a widely open subject, particularly in its textual manifestations. This paper examines an industrial corpus manually annotated following an…

Computation and Language · Computer Science 2025-09-03 Jonas Noblet

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi

As different people perceive others' emotional expressions differently, their annotation in terms of arousal and valence are per se subjective. To address this, these emotion annotations are typically collected by multiple annotators and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkmann

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger

Telling stories is an integral part of human communication which can evoke emotions and influence the affective states of the audience. Automatically modelling emotional trajectories in stories has thus attracted considerable scholarly…

Computation and Language · Computer Science 2024-10-28 Lukas Christ , Shahin Amiriparian , Manuel Milling , Ilhan Aslan , Björn W. Schuller

Many machine learning tasks -- particularly those in affective computing -- are inherently subjective. When asked to classify facial expressions or to rate an individual's attractiveness, humans may disagree with one another, and no single…

Machine Learning · Computer Science 2022-11-24 Aneesha Sampath , Victoria Lin , Louis-Philippe Morency

Emotions are inherently ambiguous and dynamic phenomena, yet existing continuous emotion recognition approaches either ignore their ambiguity or treat ambiguity as an independent and static variable over time. Motivated by this gap in the…

Machine Learning · Computer Science 2025-08-28 Jingyao Wu , Matthew Barthet , David Melhart , Georgios N. Yannakakis

Standard nonlinear regression is commonly used when modeling indifference points due to its ability to closely follow observed data, resulting in a good model fit. However, standard nonlinear regression currently lacks a reasonable…

Methodology · Statistics 2024-06-07 Mingang Kim , Mikhail N. Koffarnus , Christopher T Franck

Supervised machine-learning models often underperform in predicting user behaviors from conversational text, hindered by poor crowdsourced label quality and low NLP task accuracy. We introduce the Metadata-Sensitive Weighted-Encoding…

Machine Learning · Computer Science 2025-05-29 Lynnette Hui Xian Ng , Kokil Jaidka , Kaiyuan Tay , Hansin Ahuja , Niyati Chhaya

Most automatic emotion recognition systems exploit time-continuous annotations of emotion to provide fine-grained descriptions of spontaneous expressions as observed in real-life interactions. As emotion is rather subjective, its annotation…

Sound · Computer Science 2022-09-22 Sina Alisamir , Fabien Ringeval , Francois Portet

The beta model is the most important distribution for fitting data with the unit interval. However, the beta distribution is not suitable to model bimodal unit interval data. In this paper, we propose a bimodal beta distribution constructed…

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

Aspect-Based Sentiment Analysis (ABSA) enables fine-grained opinion analysis by identifying sentiments toward specific aspects or targets within a text. While ABSA has been widely studied for English, research on other languages such as…

Computation and Language · Computer Science 2026-05-06 Niklas Donhauser , Jakob Fehle , Nils Constantin Hellwig , Markus Weinberger , Udo Kruschwitz , Christian Wolff
‹ Prev 1 2 3 10 Next ›