English
Related papers

Related papers: Knockoffs-SPR: Clean Sample Selection in Learning …

200 papers

Noisy labels composed of correct and corrupted ones are pervasive in practice. They might significantly deteriorate the performance of convolutional neural networks (CNNs), because CNNs are easily overfitted on corrupted labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Xiaoshuang Shi , Zhenhua Guo , Kang Li , Yun Liang , Xiaofeng Zhu

The deep learning models used for speaker verification rely heavily on large amounts of data and correct labeling. However, noisy (incorrect) labels often occur, which degrades the performance of the system. In this paper, we propose a…

Sound · Computer Science 2026-04-29 Zhihua Fang , Liang He , Hanhan Ma , Xiaochen Guo , Lin Li

Despite the success of the carefully-annotated benchmarks, the effectiveness of existing graph neural networks (GNNs) can be considerably impaired in practice when the real-world graph data is noisily labeled. Previous explorations in…

Machine Learning · Computer Science 2024-08-30 Yuhao Wu , Jiangchao Yao , Xiaobo Xia , Jun Yu , Ruxin Wang , Bo Han , Tongliang Liu

Partial-label learning (PLL) is an important weakly supervised learning problem, which allows each training example to have a candidate label set instead of a single ground-truth label. Identification-based methods have been widely explored…

Machine Learning · Computer Science 2024-03-28 Shiyu Tian , Hongxin Wei , Yiqun Wang , Lei Feng

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

We focus on the challenging problem of learning an unbiased classifier from a large number of potentially relevant but noisily labeled web images given only a few clean labeled images. This problem is particularly practical because it…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chao Liang , Linchao Zhu , Zongxin Yang , Wei Chen , Yi Yang

Learning deep neural network (DNN) classifier with noisy labels is a challenging task because the DNN can easily over-fit on these noisy labels due to its high capability. In this paper, we present a very simple but effective training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Wei Hu , QiHao Zhao , Yangyu Huang , Fan Zhang

Regularization is essential for avoiding over-fitting to training data in network optimization, leading to better generalization of the trained networks. The label noise provides a strong implicit regularization by replacing the target…

Machine Learning · Computer Science 2022-05-04 Kensuke Nakamura , Bong-Soo Sohn , Kyoung-Jae Won , Byung-Woo Hong

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

Deep neural networks have achieved remarkable success in a wide variety of natural image and medical image computing tasks. However, these achievements indispensably rely on accurately annotated training data. If encountering some…

Image and Video Processing · Electrical Eng. & Systems 2022-05-11 Cheng Xue , Lequan Yu , Pengfei Chen , Qi Dou , Pheng-Ann Heng

It is a strong prerequisite to access source data freely in many existing unsupervised domain adaptation approaches. However, source data is agnostic in many practical scenarios due to the constraints of expensive data transmission and data…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Weijie Chen , Luojun Lin , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang , Wenqi Ren

Scalable oversight studies methods of training and evaluating AI systems in domains where human judgment is unreliable or expensive, such as scientific research and software engineering in complex codebases. Most work in this area has…

Machine Learning · Computer Science 2024-10-22 Alex Mallen , Nora Belrose

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

Machine Learning · Computer Science 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Consistency regularization-based methods are prevalent in semi-supervised learning (SSL) algorithms due to their exceptional performance. However, they mainly depend on domain-specific data augmentations, which are not usable in domains…

Machine Learning · Computer Science 2023-09-29 Matin Moezzi

Deep Learning, particularly Convolutional Neural Networks (CNN), has been successful in computer vision tasks and medical image analysis. However, modern CNNs can be overconfident, making them difficult to deploy in real-world scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Somenath Kuiry , Alaka Das , Mita Nasipuri , Nibaran Das

Parameter-efficient fine-tuning (PEFT) large language models (LLMs) have shown impressive performance in various downstream tasks. However, in many real-world scenarios, the collected training data inevitably contains noisy labels. To learn…

Computation and Language · Computer Science 2025-10-14 Bo Yuan , Yulin Chen , Yin Zhang

Learning from Noisy Labels (LNL) remains a fundamental challenge in deep learning because real-world datasets often contain corrupted annotations. Most existing methods rely on label correction or sample selection mechanisms. In contrast,…

Machine Learning · Computer Science 2026-05-29 Jiayu Xu , Junbiao Pang

Learning from positive and unlabeled data is known as positive-unlabeled (PU) learning in literature and has attracted much attention in recent years. One common approach in PU learning is to sample a set of pseudo-negatives from the…

Machine Learning · Computer Science 2023-08-02 Zhangchi Zhu , Lu Wang , Pu Zhao , Chao Du , Wei Zhang , Hang Dong , Bo Qiao , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Training modern neural networks is an inherently noisy process that can lead to high \emph{prediction churn} -- disagreements between re-trainings of the same model due to factors such as randomization in the parameter initialization and…

Machine Learning · Computer Science 2021-06-15 Dara Bahri , Heinrich Jiang

The standard empirical risk minimization (ERM) can underperform on certain minority groups (i.e., waterbirds in lands or landbirds in water) due to the spurious correlation between the input and its label. Several studies have improved the…

Machine Learning · Computer Science 2022-12-15 Dongpin Oh , Dae Lee , Jeunghyun Byun , Bonggun Shin