English
Related papers

Related papers: Robust Online Classification: From Estimation to D…

200 papers

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

Machine Learning · Computer Science 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

Machine Learning · Computer Science 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

The ability of learning from noisy labels is very useful in many visual recognition tasks, as a vast amount of data with noisy labels are relatively easy to obtain. Traditionally, the label noises have been treated as statistical outliers,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Yuncheng Li , Jianchao Yang , Yale Song , Liangliang Cao , Jiebo Luo , Li-Jia Li

In supervised learning, automatically assessing the quality of the labels before any learning takes place remains an open research question. In certain particular cases, hypothesis testing procedures have been proposed to assess whether a…

Machine Learning · Computer Science 2023-12-19 Weisong Yang , Rafael Poyiadzi , Niall Twomey , Raul Santos Rodriguez

Recent advances in deep learning have relied on large, labelled datasets to train high-capacity models. However, collecting large datasets in a time- and cost-efficient manner often results in label noise. We present a method for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ahmet Iscen , Jack Valmadre , Anurag Arnab , Cordelia Schmid

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

Machine Learning · Computer Science 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

Most studies on learning from noisy labels rely on unrealistic models of i.i.d. label noise, such as class-conditional transition matrices. More recent work on instance-dependent noise models are more realistic, but assume a single…

Machine Learning · Computer Science 2021-06-10 Glenn Dawson , Robi Polikar

A recurring focus of the deep learning community is towards reducing the labeling effort. Data gathering and annotation using a search engine is a simple alternative to generating a fully human-annotated and human-gathered dataset. Although…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Paul Albert , Diego Ortego , Eric Arazo , Noel O'Connor , Kevin McGuinness

We consider the problem of on-line prediction of real-valued labels, assumed bounded in absolute value by a known constant, of new objects from known labeled objects. The prediction algorithm's performance is measured by the squared…

Machine Learning · Computer Science 2007-05-23 Vladimir Vovk

We first exhibit a multimodal image registration task, for which a neural network trained on a dataset with noisy labels reaches almost perfect accuracy, far beyond noise variance. This surprising auto-denoising phenomenon can be explained…

Machine Learning · Computer Science 2021-02-11 Guillaume Charpiat , Nicolas Girard , Loris Felardos , Yuliya Tarabalka

Large-scale datasets in the real world inevitably involve label noise. Deep models can gradually overfit noisy labels and thus degrade model generalization. To mitigate the effects of label noise, learning with noisy labels (LNL) methods…

Computation and Language · Computer Science 2023-05-19 Tingting Wu , Xiao Ding , Minji Tang , Hao Zhang , Bing Qin , Ting Liu

Labels noise refers to errors in training labels caused by cheap data annotation methods, such as web scraping or crowd-sourcing, which can be detrimental to the performance of supervised classifiers. Several methods have been proposed to…

Computation and Language · Computer Science 2023-10-23 Maha Tufail Agro , Hanan Aldarmaki

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Conformal Prediction (CP) controls the prediction uncertainty of classification systems by producing a small prediction set, ensuring a predetermined probability that the true class lies within this set. This is commonly done by defining a…

Machine Learning · Computer Science 2025-08-14 Coby Penso , Jacob Goldberger , Ethan Fetaya

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

Machine Learning · Computer Science 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

A deep neural network trained on noisy labels is known to quickly lose its power to discriminate clean instances from noisy ones. After the early learning phase has ended, the network memorizes the noisy instances, which leads to a…

Machine Learning · Computer Science 2021-09-03 Jason Z. Lin , Jelena Bradic

Deep neural network models are robust to a limited amount of label noise, but their ability to memorise noisy labels in high noise rate problems is still an open issue. The most competitive noisy-label learning algorithms rely on a 2-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Filipe R. Cordeiro , Ragav Sachdeva , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro