English
Related papers

Related papers: Learning from Label Proportions by Learning with L…

200 papers

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

Machine Learning · Statistics 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

Multi-label classification is prevalent in real-world settings, but the behavior of Large Language Models (LLMs) in this setting is understudied. We investigate how autoregressive LLMs perform multi-label classification, focusing on…

Computation and Language · Computer Science 2025-11-12 Marcus Ma , Georgios Chochlakis , Niyantha Maruthu Pandiyan , Jesse Thomason , Shrikanth Narayanan

Deep neural networks (DNNs) have the capacity to fit extremely noisy labels nonetheless they tend to learn data with clean labels first and then memorize those with noisy labels. We examine this behavior in light of the Shannon entropy of…

Machine Learning · Computer Science 2021-04-28 Hao Wu , Jiangchao Yao , Jiajie Wang , Yinru Chen , Ya Zhang , Yanfeng Wang

We study the open-set label shift problem, where the test data may include a novel class absent from training. This setting is challenging because both the class proportions and the distribution of the novel class are not identifiable…

Methodology · Statistics 2025-09-19 Siyan Liu , Yukun Liu , Qinglong Tian , Pengfei Li , Jing Qin

Neural Encoders are frequently used in the NLP domain to perform dense retrieval tasks, for instance, to generate the candidate documents for a given query in question-answering tasks. However, sparse annotation and label noise in the…

Machine Learning · Computer Science 2025-12-16 Arnab Sharma

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

Machine Learning · Computer Science 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte

Federated Learning (FL) is a powerful framework for privacy-preserving distributed learning. It enables multiple clients to collaboratively train a global model without sharing raw data. However, handling noisy labels in FL remains a major…

Machine Learning · Computer Science 2026-02-19 Seunghun Yu , Jin-Hyun Ahn , Joonhyuk Kang

We prove that the empirical risk of most well-known loss functions factors into a linear term aggregating all labels with a term that is label free, and can further be expressed by sums of the loss. This holds true even for non-smooth,…

Machine Learning · Computer Science 2016-02-11 Giorgio Patrini , Frank Nielsen , Richard Nock , Marcello Carioni

Multi-instance partial-label learning (MIPL) is an emerging learning framework where each training sample is represented as a multi-instance bag associated with a candidate label set. Existing MIPL algorithms often overlook the margins for…

Machine Learning · Computer Science 2025-01-23 Wei Tang , Yin-Fang Yang , Zhaofei Wang , Weijia Zhang , Min-Ling Zhang

Large-scale datasets in the real world inevitably involve label noise. Deep models can gradually overfit noisy labels and thus degrade model generalization. To mitigate the effects of label noise, learning with noisy labels (LNL) methods…

Computation and Language · Computer Science 2023-05-19 Tingting Wu , Xiao Ding , Minji Tang , Hao Zhang , Bing Qin , Ting Liu

In the weakly supervised learning paradigm, labeling functions automatically assign heuristic, often noisy, labels to data samples. In this work, we provide a method for learning from weak labels by separating two types of complementary…

Machine Learning · Computer Science 2022-10-26 Andreas Stephan , Vasiliki Kougia , Benjamin Roth

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Robust loss functions are crucial for training deep neural networks in the presence of label noise, yet existing approaches require extensive, dataset-specific hyperparameter tuning. In this work, we introduce Fractional Classification Loss…

Machine Learning · Computer Science 2025-08-11 Mert Can Kurucu , Tufan Kumbasar , İbrahim Eksin , Müjde Güzelkaya

There has been much interest in recent years in learning good classifiers from data with noisy labels. Most work on learning from noisy labels has focused on standard loss-based performance measures. However, many machine learning problems…

Machine Learning · Computer Science 2024-04-25 Mingyuan Zhang , Shivani Agarwal

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Conventional multi-label classification (MLC) methods assume that all samples are fully labeled and identically distributed. Unfortunately, this assumption is unrealistic in large-scale MLC data that has long-tailed (LT) distribution and…

Machine Learning · Computer Science 2023-04-24 Wenqiao Zhang , Changshuo Liu , Lingze Zeng , Beng Chin Ooi , Siliang Tang , Yueting Zhuang

Since the rise of deep learning, many computer vision tasks have seen significant advancements. However, the downside of deep learning is that it is very data-hungry. Especially for segmentation problems, training a deep neural net requires…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Robby Neven , Davy Neven , Bert De Brabandere , Marc Proesmans , Toon Goedemé

Label noise significantly degrades the generalization ability of deep models in applications. Effective strategies and approaches, \textit{e.g.} re-weighting, or loss correction, are designed to alleviate the negative impact of label noise…

Machine Learning · Computer Science 2021-11-09 Haoliang Sun , Chenhui Guo , Qi Wei , Zhongyi Han , Yilong Yin