English
Related papers

Related papers: Leveraging an Alignment Set in Tackling Instance-D…

200 papers

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Deep neural networks are known to be data-driven and label noise can have a marked impact on model performance. Recent studies have shown great robustness to classic image recognition even under a high noisy rate. In medical applications,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lie Ju , Xin Wang , Lin Wang , Dwarikanath Mahapatra , Xin Zhao , Mehrtash Harandi , Tom Drummond , Tongliang Liu , Zongyuan Ge

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

Machine Learning · Computer Science 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Label noise is frequently observed in real-world large-scale datasets. The noise is introduced due to a variety of reasons; it is heterogeneous and feature-dependent. Most existing approaches to handling noisy labels fall into two…

Machine Learning · Computer Science 2021-03-30 Yikai Zhang , Songzhu Zheng , Pengxiang Wu , Mayank Goswami , Chao Chen

Existing research on learning with noisy labels predominantly focuses on synthetic label noise. Although synthetic noise possesses well-defined structural properties, it often fails to accurately replicate real-world noise patterns. In…

Computation and Language · Computer Science 2024-07-10 Hongfei Huang , Tingting Liang , Xixi Sun , Zikang Jin , Yuyu Yin

State-of-the-art object detectors rely on regressing and classifying an extensive list of possible anchors, which are divided into positive and negative samples based on their intersection-over-union (IoU) with corresponding groundtruth…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Hengduo Li , Zuxuan Wu , Chen Zhu , Caiming Xiong , Richard Socher , Larry S. Davis

This paper aims to provide understandings for the effect of an over-parameterized model, e.g. a deep neural network, memorizing instance-dependent noisy labels. We first quantify the harms caused by memorizing noisy instances, and show the…

Machine Learning · Computer Science 2021-07-14 Yang Liu

In this paper, we answer the question of when inserting label noise (less informative labels) can instead return us more accurate and fair models. We are primarily inspired by three observations: 1) In contrast to reducing label noise…

Machine Learning · Computer Science 2021-11-09 Yang Liu , Jialu Wang

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

Deep learning models rely heavily on large volumes of labeled data to achieve high performance. However, real-world datasets often contain noisy labels due to human error, ambiguity, or resource constraints during the annotation process.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Gouranga Bala , Anuj Gupta , Subrat Kumar Behera , Amit Sethi

In this paper we provide machine learning practitioners with tools to answer the question: is there class-conditional noise in my labels? In particular, we present hypothesis tests to check whether a given dataset of instance-label pairs…

Machine Learning · Computer Science 2021-06-02 Rafael Poyiadzi , Weisong Yang , Niall Twomey , Raul Santos-Rodriguez

Label noise will degenerate the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let X and Y denote the instance and clean label, respectively. When Y is a cause of X, according to which many…

Machine Learning · Statistics 2022-06-06 Yu Yao , Tongliang Liu , Mingming Gong , Bo Han , Gang Niu , Kun Zhang

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

Sound · Computer Science 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

In learning with noisy labels, for every instance, its label can randomly walk to other classes following a transition distribution which is named a noise model. Well-studied noise models are all instance-independent, namely, the transition…

Machine Learning · Computer Science 2021-02-24 Antonin Berthon , Bo Han , Gang Niu , Tongliang Liu , Masashi Sugiyama

Existing research on learning with noisy labels mainly focuses on synthetic label noise. Synthetic noise, though has clean structures which greatly enabled statistical analyses, often fails to model real-world noise patterns. The recent…

Machine Learning · Computer Science 2022-03-29 Jiaheng Wei , Zhaowei Zhu , Hao Cheng , Tongliang Liu , Gang Niu , Yang Liu

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

Machine Learning · Statistics 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan