English
Related papers

Related papers: Reasoning under Ambiguity: Uncertainty-Aware Multi…

200 papers

When recognizing emotions, subtle nuances in displays of emotion generate ambiguity or uncertainty in emotion perception. Emotion uncertainty has been previously interpreted as inter-rater disagreement among multiple annotators. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Didan Deng , Liang Wu , Bertram E. Shi

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

Computation and Language · Computer Science 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

Emotions are subjective constructs. Recent end-to-end speech emotion recognition systems are typically agnostic to the subjective nature of emotions, despite their state-of-the-art performance. In this work, we introduce an end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Navin Raj Prabhu , Guillaume Carbajal , Nale Lehmann-Willenbrock , Timo Gerkmann

The quality of rationales is essential in the reasoning capabilities of language models. Rationales not only enhance reasoning performance in complex natural language tasks but also justify model decisions. However, obtaining impeccable…

Computation and Language · Computer Science 2025-03-05 Hazel H. Kim

Annotators exhibit disagreement during data labeling, which can be termed as annotator label uncertainty. Annotator label uncertainty manifests in variations of labeling quality. Training with a single low-quality annotation per sample…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib

Key challenges in developing generalized automatic emotion recognition systems include scarcity of labeled data and lack of gold-standard references. Even for the cues that are labeled as the same emotion category, the variability of…

Sound · Computer Science 2021-06-08 Haoqi Li , Yelin Kim , Cheng-Hao Kuo , Shrikanth Narayanan

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

Machine Learning · Computer Science 2022-07-26 Ehsan Kazemi

In many machine learning systems that jointly learn from multiple modalities, a core research question is to understand the nature of multimodal interactions: how modalities combine to provide new task-relevant information that was not…

Multi-label image recognition in the low-label regime is a task of great challenge and practical significance. Previous works have focused on learning the alignment between textual and visual spaces to compensate for limited image labels,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ping Hu , Ximeng Sun , Stan Sclaroff , Kate Saenko

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada

Text emotion detection constitutes a crucial foundation for advancing artificial intelligence from basic comprehension to the exploration of emotional reasoning. Most existing emotion detection datasets rely on manual annotations, which are…

Computation and Language · Computer Science 2025-11-25 Jingyi Zhou , Senlin Luo , Haofan Chen

Many questions that we ask about the world do not have a single clear answer, yet typical human annotation set-ups in machine learning assume there must be a single ground truth label for all examples in every task. The divergence between…

Computers and Society · Computer Science 2023-06-29 Alicia Parrish , Sarah Laszlo , Lora Aroyo

Achieving advancements in automatic recognition of emotions that music can induce require considering multiplicity and simultaneity of emotions. Comparison of different machine learning algorithms performing multilabel and multiclass…

To train machine learning algorithms to predict emotional expressions in terms of arousal and valence, annotated datasets are needed. However, as different people perceive others' emotional expressions differently, their annotations are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkman

Emotion cause identification aims at identifying the potential causes that lead to a certain emotion expression in text. Several techniques including rule based methods and traditional machine learning methods have been proposed to address…

Computation and Language · Computer Science 2019-06-05 Zixiang Ding , Huihui He , Mengran Zhang , Rui Xia

We investigate cross-lingual sentiment analysis, which has attracted significant attention due to its applications in various areas including market research, politics and social sciences. In particular, we introduce a sentiment analysis…

Machine Learning · Computer Science 2022-02-08 Selim F. Yilmaz , E. Batuhan Kaynak , Aykut Koç , Hamdi Dibeklioğlu , Suleyman S. Kozat

Image classification is often prone to labelling uncertainty. To generate suitable training data, images are labelled according to evaluations of human experts. This can result in ambiguities, which will affect subsequent models. In this…

Applications · Statistics 2024-07-24 Katharina Hechinger , Xiao Xiang Zhu , Göran Kauermann

Due to the difficulty of collecting exhaustive multi-label annotations, multi-label datasets often contain partial labels. We consider an extreme of this weakly supervised learning problem, called single positive multi-label learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Donghao Zhou , Pengfei Chen , Qiong Wang , Guangyong Chen , Pheng-Ann Heng

The study of model bias and variance with respect to decision boundaries is critically important in supervised classification. There is generally a tradeoff between the two, as fine-tuning of the decision boundary of a classification model…

Machine Learning · Computer Science 2020-02-25 Matthew Almeida , Wei Ding , Scott Crouter , Ping Chen