English
Related papers

Related papers: Robust Classification with Noisy Labels Based on P…

200 papers

Deep neural networks (DNNs) are capable of perfectly fitting the training data, including memorizing noisy data. It is commonly believed that memorization hurts generalization. Therefore, many recent works propose mitigation strategies to…

Machine Learning · Statistics 2022-10-28 Carey E. Priebe , Ningyuan Huang , Soledad Villar , Cong Mu , Li Chen

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

Machine Learning · Computer Science 2024-01-26 Julian Lienen , Eyke Hüllermeier

The challenge of learning with noisy labels is significant in machine learning, as it can severely degrade the performance of prediction models if not addressed properly. This paper introduces a novel framework that conceptualizes noisy…

Machine Learning · Computer Science 2025-11-26 Marzi Heidari , Hanping Zhang , Yuhong Guo

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

Machine Learning · Computer Science 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

Feature noise and label noise are ubiquitous in practical scenarios, which pose great challenges for training a robust machine learning model. Most previous approaches usually deal with only a single problem of either feature noise or label…

Machine Learning · Computer Science 2024-07-08 Yang Wei , Shuo Chen , Shanshan Ye , Bo Han , Chen Gong

Label noise is frequently observed in real-world large-scale datasets. The noise is introduced due to a variety of reasons; it is heterogeneous and feature-dependent. Most existing approaches to handling noisy labels fall into two…

Machine Learning · Computer Science 2021-03-30 Yikai Zhang , Songzhu Zheng , Pengxiang Wu , Mayank Goswami , Chao Chen

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

Machine Learning · Computer Science 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

Machine Learning · Computer Science 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte

Learning with noisy labels is an important and challenging task for training accurate deep neural networks. Some commonly-used loss functions, such as Cross Entropy (CE), suffer from severe overfitting to noisy labels. Robust loss functions…

Machine Learning · Computer Science 2021-08-03 Xiong Zhou , Xianming Liu , Chenyang Wang , Deming Zhai , Junjun Jiang , Xiangyang Ji

Foundation models (FMs) pretrained on large datasets have become fundamental for various downstream machine learning tasks, in particular in scenarios where obtaining perfectly labeled data is prohibitively expensive. In this paper, we…

Machine Learning · Computer Science 2025-08-04 Ecem Bozkurt , Antonio Ortega

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

Machine Learning · Computer Science 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

Deep neural networks trained with standard cross-entropy loss memorize noisy labels, which degrades their performance. Most research to mitigate this memorization proposes new robust classification loss functions. Conversely, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Robust loss functions are essential for training accurate deep neural networks (DNNs) in the presence of noisy (incorrect) labels. It has been shown that the commonly used Cross Entropy (CE) loss is not robust to noisy labels. Whilst new…

Machine Learning · Computer Science 2020-06-25 Xingjun Ma , Hanxun Huang , Yisen Wang , Simone Romano , Sarah Erfani , James Bailey

Label noise presents a real challenge for supervised learning algorithms. Consequently, mitigating label noise has attracted immense research in recent years. Noise robust losses is one of the more promising approaches for dealing with…

Machine Learning · Computer Science 2021-04-27 Neta Shoham , Tomer Avidor , Nadav Israel

Machine learning classifiers rely on loss functions for performance evaluation, often on a private (hidden) dataset. In a recent line of research, label inference was introduced as the problem of reconstructing the ground truth labels of…

Machine Learning · Computer Science 2021-11-02 Abhinav Aggarwal , Shiva Prasad Kasiviswanathan , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

Labor-intensive labeling becomes a bottleneck in developing computer vision algorithms based on deep learning. For this reason, dealing with imperfect labels has increasingly gained attention and has become an active field of study. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Heewon Kim , Hyun Sung Chang , Kiho Cho , Jaeyun Lee , Bohyung Han

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

Machine Learning · Statistics 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

Deep neural networks are able to memorize noisy labels easily with a softmax cross-entropy (CE) loss. Previous studies attempted to address this issue focus on incorporating a noise-robust loss function to the CE loss. However, the…

Machine Learning · Computer Science 2022-07-26 Li Yi , Sheng Liu , Qi She , A. Ian McLeod , Boyu Wang