English
Related papers

Related papers: Limited Gradient Descent: Learning With Noisy Labe…

200 papers

Training deep neural networks (DNNs) with noisy labels is a challenging problem due to over-parameterization. DNNs tend to essentially fit on clean samples at a higher rate in the initial stages, and later fit on the noisy samples at a…

Machine Learning · Computer Science 2021-07-08 Sree Ram Kamabattula , Venkat Devarajan , Babak Namazi , Ganesh Sankaranarayanan

We explore contemporary robust classification algorithms for overcoming class-dependant labelling noise: Forward, Importance Re-weighting and T-revision. The classifiers are trained and evaluated on class-conditional random label noise data…

Machine Learning · Computer Science 2021-06-02 Alex Díaz , Damian Steele

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

Machine Learning · Computer Science 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Deep neural networks are susceptible to label noise. Existing methods to improve robustness, such as meta-learning and regularization, usually require significant change to the network architecture or careful tuning of the optimization…

Machine Learning · Computer Science 2022-05-31 Li Chen , Ningyuan Huang , Cong Mu , Hayden S. Helm , Kate Lytvynets , Weiwei Yang , Carey E. Priebe

While mislabeled or ambiguously-labeled samples in the training set could negatively affect the performance of deep models, diagnosing the dataset and identifying mislabeled samples helps to improve the generalization power. Training…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Qingrui Jia , Xuhong Li , Lei Yu , Jiang Bian , Penghao Zhao , Shupeng Li , Haoyi Xiong , Dejing Dou

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

Machine Learning · Computer Science 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

Machine Learning · Computer Science 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama

Labeling datasets for supervised object detection is a dull and time-consuming task. Errors can be easily introduced during annotation and overlooked during review, yielding inaccurate benchmarks and performance degradation of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Marius Schubert , Tobias Riedlinger , Karsten Kahl , Daniel Kröll , Sebastian Schoenen , Siniša Šegvić , Matthias Rottmann

The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in human-annotated…

Machine Learning · Computer Science 2021-03-31 Zhaowei Zhu , Tongliang Liu , Yang Liu

In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recent studies aim to enhance in-context learning performance by…

Computation and Language · Computer Science 2024-12-02 Junyong Kang , Donghyun Son , Hwanjun Song , Buru Chang

Supervised deep learning methods require a large repository of annotated data; hence, label noise is inevitable. Training with such noisy data negatively impacts the generalization performance of deep neural networks. To combat label noise,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nazmul Karim , Mamshad Nayeem Rizve , Nazanin Rahnavard , Ajmal Mian , Mubarak Shah

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

One crucial factor behind the success of deep learning lies in the implicit bias induced by noise inherent in gradient-based training algorithms. Motivated by empirical observations that training with noisy labels improves model…

Machine Learning · Computer Science 2026-03-12 Tongcheng Zhang , Zhanpeng Zhou , Mingze Wang , Andi Han , Wei Huang , Taiji Suzuki , Junchi Yan

Modern deep neural networks (DNNs) become frail when the datasets contain noisy (incorrect) class labels. Robust techniques in the presence of noisy labels can be categorized into two folds: developing noise-robust functions or using…

Machine Learning · Computer Science 2021-10-28 Taehyeon Kim , Jongwoo Ko , Sangwook Cho , Jinhwan Choi , Se-Young Yun

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Many weakly supervised classification methods employ a noise transition matrix to capture the class-conditional label corruption. To estimate the transition matrix from noisy data, existing methods often need to estimate the noisy…

Machine Learning · Statistics 2021-06-15 Yivan Zhang , Gang Niu , Masashi Sugiyama

In this paper, we investigate the problem of learning with noisy labels in real-world annotation scenarios, where noise can be categorized into two types: factual noise and ambiguity noise. To better distinguish these noise types and…

Machine Learning · Computer Science 2023-08-23 Renyu Zhu , Haoyu Liu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Haobo Wang

Acquiring accurate labels on large-scale datasets is both time consuming and expensive. To reduce the dependency of deep learning models on learning from clean labeled data, several recent research efforts are focused on learning with noisy…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Arushi Goel , Yunlong Jiao , Jordan Massiah

Most studies on learning from noisy labels rely on unrealistic models of i.i.d. label noise, such as class-conditional transition matrices. More recent work on instance-dependent noise models are more realistic, but assume a single…

Machine Learning · Computer Science 2021-06-10 Glenn Dawson , Robi Polikar

In recent years, deep neural networks (DNNs) have gained remarkable achievement in computer vision tasks, and the success of DNNs often depends greatly on the richness of data. However, the acquisition process of data and high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Mengting Li , Chuang Zhu