English
Related papers

Related papers: Fine tuning Pre trained Models for Robustness Unde…

200 papers

There has been much interest in recent years in learning good classifiers from data with noisy labels. Most work on learning from noisy labels has focused on standard loss-based performance measures. However, many machine learning problems…

Machine Learning · Computer Science 2024-04-25 Mingyuan Zhang , Shivani Agarwal

Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Zhuolin Jiang , Jan Silovsky , Man-Hung Siu , William Hartmann , Herbert Gish , Sancar Adali

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while…

Machine Learning · Computer Science 2023-05-30 Lefan Zhang , Zhang-Hao Tian , Wujun Zhou , Wei Wang

Training modern neural networks is an inherently noisy process that can lead to high \emph{prediction churn} -- disagreements between re-trainings of the same model due to factors such as randomization in the parameter initialization and…

Machine Learning · Computer Science 2021-06-15 Dara Bahri , Heinrich Jiang

The challenge of learning with noisy labels is significant in machine learning, as it can severely degrade the performance of prediction models if not addressed properly. This paper introduces a novel framework that conceptualizes noisy…

Machine Learning · Computer Science 2025-11-26 Marzi Heidari , Hanping Zhang , Yuhong Guo

The most competitive noisy label learning methods rely on an unsupervised classification of clean and noisy samples, where samples classified as noisy are re-labelled and "MixMatched" with the clean samples. These methods have two issues in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Robustness to label noise within data is a significant challenge in federated learning (FL). From the data-centric perspective, the data quality of distributed datasets can not be guaranteed since annotations of different clients contain…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xuefeng Jiang , Jia Li , Nannan Wu , Zhiyuan Wu , Xujing Li , Sheng Sun , Gang Xu , Yuwei Wang , Qi Li , Min Liu

Data-driven software engineering processes, such as vulnerability prediction heavily rely on the quality of the data used. In this paper, we observe that it is infeasible to obtain a noise-free security defect dataset in practice. Despite…

Software Engineering · Computer Science 2022-04-04 Roland Croft , M. Ali Babar , Huaming Chen

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

Machine Learning · Statistics 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

Noisy labels are inevitable in real-world scenarios. Due to the strong capacity of deep neural networks to memorize corrupted labels, these noisy labels can cause significant performance degradation. Existing research on mitigating the…

Machine Learning · Computer Science 2025-10-02 Xinlei Zhang , Fan Liu , Chuanyi Zhang , Fan Cheng , Yuhui Zheng

The efficacy of deep learning depends on large-scale data sets that have been carefully curated with reliable data acquisition and annotation processes. However, acquiring such large-scale data sets with precise annotations is very…

Machine Learning · Computer Science 2020-11-12 Ragav Sachdeva , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Label noise refers to incorrect labels in a dataset caused by human errors or collection defects, which is common in real-world applications and can significantly reduce the accuracy of models. This report explores how to estimate noise…

Machine Learning · Computer Science 2025-01-03 Haixu Liu , Zerui Tao , Naihui Zhang , Sixing Liu

Regression methods assume that accurate labels are available for training. However, in certain scenarios, obtaining accurate labels may not be feasible, and relying on multiple specialists with differing opinions becomes necessary. Existing…

Machine Learning · Statistics 2023-05-15 Milene Regina dos Santos , Rafael Izbicki

Imperfect labels are ubiquitous in real-world datasets and seriously harm the model performance. Several recent effective methods for handling noisy labels have two key steps: 1) dividing samples into cleanly labeled and wrongly labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Wenkai Chen , Chuang Zhu , Yi Chen , Mengting Li , Tiejun Huang

In supervised machine learning, use of correct labels is extremely important to ensure high accuracy. Unfortunately, most datasets contain corrupted labels. Machine learning models trained on such datasets do not generalize well. Thus,…

Machine Learning · Computer Science 2023-09-14 Chang Yue , Niraj K. Jha

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

Deep neural networks (DNNs) exhibit great success on many tasks with the help of large-scale well annotated datasets. However, labeling large-scale data can be very costly and error-prone so that it is difficult to guarantee the annotation…

Machine Learning · Computer Science 2020-07-02 Dongxian Wu , Yisen Wang , Zhuobin Zheng , Shu-tao Xia

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

Learning with noisy labels (LNL) aims to ensure model generalization given a label-corrupted training set. In this work, we investigate a rarely studied scenario of LNL on fine-grained datasets (LNL-FG), which is more practical and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Qi Wei , Lei Feng , Haoliang Sun , Ren Wang , Chenhui Guo , Yilong Yin