English
Related papers

Related papers: Detecting Label Noise via Leave-One-Out Cross-Vali…

200 papers

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

Machine Learning · Computer Science 2022-12-06 Deep Patel , P. S. Sastry

In this paper, we study the pooled data problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we…

Machine Learning · Statistics 2017-10-19 Jonathan Scarlett , Volkan Cevher

For multi-class classification under class-conditional label noise, we prove that the accuracy metric itself can be robust. We concretize this finding's inspiration in two essential aspects: training and validation, with which we address…

Machine Learning · Computer Science 2020-12-09 Pengfei Chen , Junjie Ye , Guangyong Chen , Jingwei Zhao , Pheng-Ann Heng

Node classification on graphs is a significant task with a wide range of applications, including social analysis and anomaly detection. Even though graph neural networks (GNNs) have produced promising results on this task, current…

Machine Learning · Computer Science 2023-06-16 Jingyang Yuan , Xiao Luo , Yifang Qin , Yusheng Zhao , Wei Ju , Ming Zhang

In recent years, the remarkable success of deep neural networks (DNNs) in computer vision is largely due to large-scale, high-quality labeled datasets. Training directly on real-world datasets with label noise may result in overfitting. The…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Yuandi Zhao , Qianxi Xia , Yang Sun , Zhijie Wen , Liyan Ma , Shihui Ying

Either human annotation or rule based automatic labeling is an effective method to augment data for relation extraction. However, the inevitable wrong labeling problem for example by distant supervision may deteriorate the performance of…

Computation and Language · Computer Science 2020-04-30 Shanchan Wu , Kai Fan

Many tasks in explainable machine learning, such as data valuation and feature attribution, perform expensive computation for each data point and are intractable for large datasets. These methods require efficient approximations, and…

Machine Learning · Computer Science 2024-10-31 Ian Covert , Chanwoo Kim , Su-In Lee , James Zou , Tatsunori Hashimoto

Class-conditional noise commonly exists in machine learning tasks, where the class label is corrupted with a probability depending on its ground-truth. Many research efforts have been made to improve the model robustness against the…

Machine Learning · Computer Science 2021-05-18 Ming-Kun Xie , Sheng-Jun Huang

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

Machine Learning · Computer Science 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

Learning from noisy data is a challenging task that significantly degenerates the model performance. In this paper, we present TCL, a novel twin contrastive learning model to learn robust representations and handle noisy labels for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhizhong Huang , Junping Zhang , Hongming Shan

With the development of deep learning, medical image classification has been significantly improved. However, deep learning requires massive data with labels. While labeling the samples by human experts is expensive and time-consuming,…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Jiarun Liu , Ruirui Li , Chuan Sun

We study the robustness of conformal prediction, a powerful tool for uncertainty quantification, to label noise. Our analysis tackles both regression and classification problems, characterizing when and how it is possible to construct…

Machine Learning · Computer Science 2024-11-27 Bat-Sheva Einbinder , Shai Feldman , Stephen Bates , Anastasios N. Angelopoulos , Asaf Gendler , Yaniv Romano

We consider the problem of noisy Bayesian active learning, where we are given a finite set of functions $\mathcal{H}$, a sample space $\mathcal{X}$, and a label set $\mathcal{L}$. One of the functions in $\mathcal{H}$ assigns labels to…

Information Theory · Computer Science 2016-11-15 Mohammad Naghshvar , Tara Javidi , Kamalika Chaudhuri

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

Machine Learning · Computer Science 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

The label noise transition matrix, characterizing the probabilities of a training instance being wrongly annotated, is crucial to designing popular solutions to learning with noisy labels. Existing works heavily rely on finding "anchor…

Machine Learning · Computer Science 2021-07-15 Zhaowei Zhu , Yiwen Song , Yang Liu

Learning with noisy labels is a practically challenging problem in weakly supervised learning. In the existing literature, open-set noises are always considered to be poisonous for generalization, similar to closed-set noises. In this…

Machine Learning · Computer Science 2021-11-22 Hongxin Wei , Lue Tao , Renchunzi Xie , Bo An

The quality of training datasets for deep neural networks is a key factor contributing to the accuracy of resulting models. This effect is amplified in difficult tasks such as object detection. Dealing with errors in datasets is often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Krystian Chachuła , Jakub Łyskawa , Bartłomiej Olber , Piotr Frątczak , Adam Popowicz , Krystian Radlak

Signal processing in non-Gaussian noise environment is addressed in this paper. For many real-life situations, the additive noise process present in the system is found to be dominantly non-Gaussian. The problem of detection and estimation…

Statistics Theory · Mathematics 2014-01-23 Jugalkishore K. Banoth , Pradip Sircar

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid