English
Related papers

Related papers: Confident Learning: Estimating Uncertainty in Data…

200 papers

We propose and study a realistic Continual Learning (CL) setting where learning algorithms are granted a restricted computational budget per time step while training. We apply this setting to large-scale semi-supervised Continual Learning…

Machine Learning · Computer Science 2024-06-11 Wenxuan Zhang , Youssef Mohamed , Bernard Ghanem , Philip H. S. Torr , Adel Bibi , Mohamed Elhoseiny

Training deep neural networks on real-world datasets is often hampered by the presence of noisy labels, which can be memorized by over-parameterized models, leading to significant degradation in generalization performance. While existing…

Machine Learning · Computer Science 2025-12-18 Jianchao Wang , Qingfeng Li , Pengcheng Zheng , Xiaorong Pu , Yazhou Ren

Deep learning with noisy labels presents significant challenges. In this work, we theoretically characterize the role of label noise from a feature learning perspective. Specifically, we consider a signal-noise data distribution, where each…

Machine Learning · Statistics 2025-05-27 Andi Han , Wei Huang , Zhanpeng Zhou , Gang Niu , Wuyang Chen , Junchi Yan , Akiko Takeda , Taiji Suzuki

Recently, learning with soft labels has been shown to achieve better performance than learning with hard labels in terms of model generalization, calibration, and robustness. However, collecting pointwise labeling confidence for all…

Machine Learning · Computer Science 2023-10-10 Wei Wang , Lei Feng , Yuchen Jiang , Gang Niu , Min-Ling Zhang , Masashi Sugiyama

Learning from examples with noisy labels has attracted increasing attention recently. But, this paper will show that the commonly used CIFAR-based datasets and the accuracy evaluation metric used in the literature are both inappropriate in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yifan Zhou , Yifan Ge , Jianxin Wu

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

A similarity label indicates whether two instances belong to the same class while a class label shows the class of the instance. Without class labels, a multi-class classifier could be learned from similarity-labeled pairwise data by meta…

Machine Learning · Computer Science 2020-02-18 Songhua Wu , Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Nannan Wang , Haifeng Liu , Gang Niu

As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Linjuan Fan , Di Wen , Kunyu Peng , Kailun Yang , Jiaming Zhang , Ruiping Liu , Yufan Chen , Junwei Zheng , Jiamin Wu , Xudong Han , Rainer Stiefelhagen

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

Noisy labels threaten the robustness of few-shot learning (FSL) due to the inexact features in a new domain. CLIP, a large-scale vision-language model, performs well in FSL on image-text embedding similarities, but it is susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shizhuo Deng , Bowen Han , Jiaqi Chen , Hao Wang , Dongyue Chen , Tong Jia

Recent evolution in deep learning has proven its value for CT-based lung nodule classification. Most current techniques are intrinsically black-box systems, suffering from two generalizability issues in clinical practice. First,…

Image and Video Processing · Electrical Eng. & Systems 2022-02-28 Hanxiao Zhang , Liang Chen , Xiao Gu , Minghui Zhang , Yulei Qin , Feng Yao , Zhexin Wang , Yun Gu , Guang-Zhong Yang

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Point cloud segmentation is a fundamental task in 3D. Despite recent progress on point cloud segmentation with the power of deep networks, current deep learning methods based on the clean label assumptions may fail with noisy labels. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Shuquan Ye , Dongdong Chen , Songfang Han , Jing Liao

Curriculum learning can improve neural network training by guiding the optimization to desirable optima. We propose a novel curriculum learning approach for image classification that adapts the loss function by changing the label…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Urun Dogan , Aniket Anand Deshmukh , Marcin Machura , Christian Igel

Learning from noisy labels (LNL) is a challenge that arises in many real-world scenarios where collected training data can contain incorrect or corrupted labels. Most existing solutions identify noisy labels and adopt active learning to…

Machine Learning · Computer Science 2025-04-07 Bo Yuan , Yulin Chen , Yin Zhang , Wei Jiang

One-hot labels do not represent soft decision boundaries among concepts, and hence, models trained on them are prone to overfitting. Using soft labels as targets provide regularization, but different soft labels might be optimal at…

Machine Learning · Computer Science 2020-09-22 Nidhi Vyas , Shreyas Saxena , Thomas Voice

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Deep learning has achieved excellent performance in various computer vision tasks, but requires a lot of training examples with clean labels. It is easy to collect a dataset with noisy labels, but such noise makes networks overfit seriously…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Kun Yi , Guo-Hua Wang , Jianxin Wu

Label noise in real-world datasets encodes wrong correlation patterns and impairs the generalization of deep neural networks (DNNs). It is critical to find efficient ways to detect corrupted patterns. Current methods primarily focus on…

Machine Learning · Computer Science 2022-06-22 Zhaowei Zhu , Zihao Dong , Yang Liu

Learning from corrupted labels is very common in real-world machine-learning applications. Memorizing such noisy labels could affect the learning of the model, leading to sub-optimal performances. In this work, we propose a novel framework…

Machine Learning · Computer Science 2023-12-20 Yu Wang , Xin Xin , Zaiqiao Meng , Joemon Jose , Fuli Feng