English
Related papers

Related papers: Capturing Label Distribution: A Case Study in NLI

200 papers

When annotators disagree on a label, the disagreement itself carries signal -- and the number of annotators needed to capture it depends on the evaluation metric. We fine-tune NLI models on label distributions subsampled from ChaosNLI, a…

Computation and Language · Computer Science 2026-05-29 Guneet Kohli

We investigate how disagreement in natural language inference (NLI) annotation arises. We developed a taxonomy of disagreement sources with 10 categories spanning 3 high-level classes. We found that some disagreements are due to uncertainty…

Computation and Language · Computer Science 2022-09-09 Nan-Jiang Jiang , Marie-Catherine de Marneffe

Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels. While many research works do not pay much attention to this fact, several recent efforts have been made to acknowledge and embrace the existence of…

Computation and Language · Computer Science 2021-06-08 Johannes Mario Meissner , Napat Thumwanit , Saku Sugawara , Akiko Aizawa

Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of language, we hypothesize that single label is not sufficient to…

Computation and Language · Computer Science 2021-09-14 Shujian Zhang , Chengyue Gong , Eunsol Choi

Many machine learning tasks involve inherent subjectivity, where annotators naturally provide varied labels. Standard practice collapses these label distributions into single labels, aggregating diverse human judgments into point estimates.…

Machine Learning · Computer Science 2025-11-19 Agamdeep Singh , Ashish Tiwari , Hosein Hasanbeig , Priyanshu Gupta

Despite the subjective nature of many NLP tasks, most NLU evaluations have focused on using the majority label with presumably high agreement as the ground truth. Less attention has been paid to the distribution of human opinions. We…

Computation and Language · Computer Science 2020-10-12 Yixin Nie , Xiang Zhou , Mohit Bansal

Human label variation (Plank 2022), or annotation disagreement, exists in many natural language processing (NLP) tasks. To be robust and trusted, NLP models need to identify such variation and be able to explain it. To this end, we created…

Computation and Language · Computer Science 2023-04-26 Nan-Jiang Jiang , Chenhao Tan , Marie-Catherine de Marneffe

In the recent past, a popular way of evaluating natural language understanding (NLU), was to consider a model's ability to perform natural language inference (NLI) tasks. In this paper, we investigate if NLI tasks, that are rarely used for…

Computation and Language · Computer Science 2024-11-22 Lovish Madaan , David Esiobu , Pontus Stenetorp , Barbara Plank , Dieuwke Hupkes

Label distribution learning (LDL) is an effective method to predict the label description degree (a.k.a. label distribution) of a sample. However, annotating label distribution (LD) for training samples is extremely costly. So recent…

Machine Learning · Computer Science 2024-05-14 Yuheng Jia , Jiawei Tang , Jiahao Jiang

Multi-label learning (MLL) has gained attention for its ability to represent real-world data. Label Distribution Learning (LDL), an extension of MLL to learning from label distributions, faces challenges in collecting accurate label…

Machine Learning · Computer Science 2025-02-04 Zhiqiang Kou , Si Qin , Hailin Wang , Mingkun Xie , Shuo Chen , Yuheng Jia , Tongliang Liu , Masashi Sugiyama , Xin Geng

Supervised machine learning often requires human-annotated data. While annotator disagreement is typically interpreted as evidence of noise, population-level label distribution learning (PLDL) treats the collection of annotations for each…

Machine Learning · Computer Science 2021-06-22 Tharindu Cyril Weerasooriya , Tong Liu , Christopher M. Homan

In contrast to multi-label learning, label distribution learning characterizes the polysemy of examples by a label distribution to represent richer semantics. In the learning process of label distribution, the training data is collected…

Machine Learning · Computer Science 2022-09-29 Zhuoran Zheng , Xiuyi Jia

We commonly use agreement measures to assess the utility of judgements made by human annotators in Natural Language Processing (NLP) tasks. While inter-annotator agreement is frequently used as an indication of label reliability by…

Computation and Language · Computer Science 2025-10-21 Gavin Abercrombie , Tanvi Dinkar , Amanda Cercas Curry , Verena Rieser , Dirk Hovy

Although multi-label learning can deal with many problems with label ambiguity, it does not fit some real applications well where the overall distribution of the importance of the labels matters. This paper proposes a novel learning…

Machine Learning · Computer Science 2016-04-06 Xin Geng

Scientific Natural Language Inference (NLI) is the task of predicting the semantic relation between a pair of sentences extracted from research articles. The automatic annotation method based on distant supervision for the training set of…

Computation and Language · Computer Science 2024-06-24 Mobashir Sadat , Cornelia Caragea

There is growing recognition that many NLP tasks lack a single ground truth, as human judgments reflect diverse perspectives. To capture this variation, models have been developed to predict full annotation distributions rather than…

Computation and Language · Computer Science 2026-02-27 Frances Yung , Daniil Ignatev , Merel Scholman , Vera Demberg , Massimo Poesio

Selecting an effective training signal for machine learning tasks is difficult: expert annotations are expensive, and crowd-sourced annotations may not be reliable. Recent work has demonstrated that learning from a distribution over labels…

Computation and Language · Computer Science 2025-04-23 Dustin Wright , Isabelle Augenstein

Humans exhibit disagreement during data labeling. We term this disagreement as human label uncertainty. In this work, we study the ramifications of human label uncertainty (HLU). Our evaluation of existing uncertainty estimation algorithms,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently…

Computation and Language · Computer Science 2024-06-17 Hancheol Park , Soyeong Jeong , Sukmin Cho , Jong C. Park

Human label variation (HLV) is a valuable source of information that arises when multiple human annotators provide different labels for valid reasons. In Natural Language Inference (NLI) earlier approaches to capturing HLV involve either…

Computation and Language · Computer Science 2024-10-07 Beiduo Chen , Xinpeng Wang , Siyao Peng , Robert Litschko , Anna Korhonen , Barbara Plank
‹ Prev 1 2 3 10 Next ›