English
Related papers

Related papers: Noise-Resistant Deep Metric Learning with Probabil…

200 papers

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Sample selection is an effective strategy to mitigate the effect of label noise in robust learning. Typical strategies commonly apply the small-loss criterion to identify clean samples. However, those samples lying around the decision…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Qi Wei , Haoliang Sun , Xiankai Lu , Yilong Yin

Label Ranking (LR) corresponds to the problem of learning a hypothesis that maps features to rankings over a finite set of labels. We adopt a nonparametric regression approach to LR and obtain theoretical performance guarantees for this…

Machine Learning · Computer Science 2022-02-11 Dimitris Fotakis , Alkis Kalavasis , Eleni Psaroudaki

Large language models (LLMs) have shown impressive performance on downstream tasks by in-context learning (ICL), which heavily relies on the quality of demonstrations selected from a large set of annotated examples. Recent works claim that…

Computation and Language · Computer Science 2024-10-25 Hongfu Gao , Feipeng Zhang , Wenyu Jiang , Jun Shu , Feng Zheng , Hongxin Wei

The efficacy of deep learning depends on large-scale data sets that have been carefully curated with reliable data acquisition and annotation processes. However, acquiring such large-scale data sets with precise annotations is very…

Machine Learning · Computer Science 2020-11-12 Ragav Sachdeva , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

Machine Learning · Computer Science 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate…

Machine Learning · Statistics 2016-12-07 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

While robust graph neural networks (GNNs) have been widely studied for graph perturbation and attack, those for label noise have received significantly less attention. Most existing methods heavily rely on the label smoothness assumption to…

Machine Learning · Computer Science 2023-11-07 Qingqing Ge , Jianxiang Yu , Zeyuan Zhao , Xiang Li

Datasets with noisy labels are a common occurrence in practical applications of classification methods. We propose a simple probabilistic method for training deep classifiers under input-dependent (heteroscedastic) label noise. We assume an…

Machine Learning · Computer Science 2020-11-16 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

Noisy labels in large E-commerce product data (i.e., product items are placed into incorrect categories) are a critical issue for product categorization task because they are unavoidable, non-trivial to remove and degrade prediction…

Computation and Language · Computer Science 2022-09-16 Huy Nguyen , Devashish Khatwani

In the context of noisy partial label learning (NPLL), each training sample is associated with a set of candidate labels annotated by multiple noisy annotators. With the emergence of high-performance pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Qian-Wei Wang , Yaguang Song , Shu-Tao Xia

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan

The performance of machine learning models often relies on large labeled datasets; however, data collected from diverse sources can contain label noise. Recent work has shown that, in noisy settings, there may exist a subset of the training…

Machine Learning · Computer Science 2026-05-05 Kumar Shubham , Pavan Karjol , Kiran M K , Prathosh AP

In large-scale supervised learning, penalized logistic regression (PLR) effectively mitigates overfitting through regularization, yet its performance critically depends on robust variable selection. This paper demonstrates that label noise…

Machine Learning · Computer Science 2026-02-16 Xiaofei Wu , Rongmei Liangse

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

Machine Learning · Computer Science 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

We present a deep learning model, DE-LSTM, for the simulation of a stochastic process with an underlying nonlinear dynamics. The deep learning model aims to approximate the probability density function of a stochastic process via numerical…

Computational Physics · Physics 2018-10-23 Kyongmin Yeo , Igor Melnyk

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

Computer vision systems recently made a big leap thanks to deep neural networks. However, these systems require correctly labeled large datasets in order to be trained properly, which is very difficult to obtain for medical applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Görkem Algan , Ilkay Ulusoy , Şaban Gönül , Banu Turgut , Berker Bakbak