English
Related papers

Related papers: Noise in Classification

200 papers

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

We study online learning when individual instances are corrupted by adversarially chosen random noise. We assume the noise distribution is unknown, and may change over time with no restriction other than having zero mean and bounded…

Machine Learning · Computer Science 2015-03-17 Nicolò Cesa-Bianchi , Shai Shalev-Shwartz , Ohad Shamir

Extracting useful information from noisy near-term quantum simulations requires error mitigation strategies. A broad class of these strategies rely on precise characterization of the noise source. We study the robustness of probabilistic…

Quantum Physics · Physics 2025-07-28 Pradeep Niroula , Sarang Gopalakrishnan , Michael J. Gullans

We describe a framework for designing efficient active learning algorithms that are tolerant to random classification noise and are differentially-private. The framework is based on active learning algorithms that are statistical in the…

Machine Learning · Computer Science 2014-11-06 Maria Florina Balcan , Vitaly Feldman

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

Training dialogue systems often entails dealing with noisy training examples and unexpected user inputs. Despite their prevalence, there currently lacks an accurate survey of dialogue noise, nor is there a clear sense of the impact of each…

Computation and Language · Computer Science 2023-08-01 Derek Chen , Zhou Yu

When random label noise is added to a training dataset, the prediction error of a neural network on a label-noise-free test dataset initially improves during early training but eventually deteriorates, following a U-shaped dependence on…

Machine Learning · Computer Science 2023-06-06 Chaoyue Liu , Amirhesam Abedsoltan , Mikhail Belkin

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

The notion of incremental learning is to train an ANN algorithm in stages, as and when newer training data arrives. Incremental learning is becoming widespread in recent times with the advent of deep learning. Noise in the training data…

Machine Learning · Computer Science 2020-05-08 Shovik Ganguly , Atrayee Chatterjee , Debasmita Bhoumik , Ritajit Majumdar

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

We study the problem of robust linear regression with response variable corruptions. We consider the oblivious adversary model, where the adversary corrupts a fraction of the responses in complete ignorance of the data. We provide a nearly…

Machine Learning · Computer Science 2019-03-21 Arun Sai Suggala , Kush Bhatia , Pradeep Ravikumar , Prateek Jain

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

Sound · Computer Science 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

A recurrent neural net is described that learns a set of patterns in the presence of noise. The learning rule is of Hebbian type, and, if noise would be absent during the learning process, the resulting final values of the weights would…

Disordered Systems and Neural Networks · Physics 2009-11-07 W A van Leeuwen , B Wemmenhove

We construct algorithms with optimal error for learning with adversarial noise. The overarching theme of this work is that the use of \textsl{randomized} hypotheses can substantially improve upon the best error rates achievable with…

Data Structures and Algorithms · Computer Science 2026-04-06 Guy Blanc

A leading approach to algorithm design aims to minimize the number of operations in an algorithm's compilation. One intuitively expects that reducing the number of operations may decrease the chance of errors. This paradigm is particularly…

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

Machine Learning · Computer Science 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

In this work we discuss the impact of nuisance parameters on the effectiveness of machine learning in high-energy physics problems, and provide a review of techniques that allow to include their effect and reduce their impact in the search…

Machine Learning · Statistics 2021-01-19 Tommaso Dorigo , Pablo de Castro

Noisy labels are both inevitable and problematic in machine learning methods, as they negatively impact models' generalization ability by causing overfitting. In the context of learning with noise, the transition matrix plays a crucial role…

Machine Learning · Computer Science 2025-03-26 Jiahui Li , Tai-Wei Chang , Kun Kuang , Ximing Li , Long Chen , Jun Zhou

Recent research demonstrate that prediction of time series by predictive recurrent neural networks based on the noisy input generates a smooth anticipated trajectory. We examine influence of the noise component in both the training data…

Machine Learning · Computer Science 2023-05-02 Boris Rubinstein