English
Related papers

Related papers: Confidence Scores Make Instance-dependent Label-no…

200 papers

Semi-supervised learning (SSL) has been a fundamental challenge in machine learning for decades. The primary family of SSL algorithms, known as pseudo-labeling, involves assigning pseudo-labels to confident unlabeled instances and…

Machine Learning · Computer Science 2023-10-31 Muyang Li , Runze Wu , Haoyu Liu , Jun Yu , Xun Yang , Bo Han , Tongliang Liu

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

Machine Learning · Computer Science 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect…

Machine Learning · Computer Science 2021-10-27 Ning Xu , Congyu Qiao , Xin Geng , Min-Ling Zhang

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid

In this paper, we consider a new low-quality label learning problem: learning time series detection models from temporally imprecise labels. In this problem, the data consist of a set of input time series, and supervision is provided by a…

Machine Learning · Statistics 2017-04-14 Roy J. Adams , Benjamin M. Marlin

Statistically consistent methods based on the noise transition matrix ($T$) offer a theoretically grounded solution to Learning with Noisy Labels (LNL), with guarantees of convergence to the optimal clean-data classifier. In practice,…

Machine Learning · Computer Science 2026-03-16 Chen Feng , Zhuo Zhi , Zhao Huang , Jiawei Ge , Ling Xiao , Nicu Sebe , Georgios Tzimiropoulos , Ioannis Patras

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

Investigation of machine learning algorithms robust to changes between the training and test distributions is an active area of research. In this paper we explore a special type of dataset shift which we call class-dependent domain shift.…

Machine Learning · Computer Science 2020-07-13 Tigran Galstyan , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Numerous studies have shown that label noise can lead to poor generalization performance, negatively affecting classification accuracy. Therefore, understanding the effectiveness of classifiers trained using deep neural networks in the…

Machine Learning · Computer Science 2026-03-10 Haixia Liu , Boxiao Li , Can Yang , Yang Wang

Label noise in the sense of incorrect labels is present in many real-world data sets and is known to severely limit the generalizability of deep learning models. In the field of remote sensing, however, automated treatment of label noise in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Felix Kröber , Genc Hoxha , Ribana Roscher

Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a…

Machine Learning · Computer Science 2024-05-22 Coby Penso , Jacob Goldberger

With the development of computational pathology, deep learning methods for Gleason grading through whole slide images (WSIs) have excellent prospects. Since the size of WSIs is extremely large, the image label usually contains only…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Hao Bian , Zhuchen Shao , Yang Chen , Yifeng Wang , Haoqian Wang , Jian Zhang , Yongbing Zhang

Deep-learning-based image classification frameworks often suffer from the noisy label problem caused by the inter-observer variation. Recent studies employed learning-to-learn paradigms (e.g., Co-teaching and JoCoR) to filter the samples…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Ziqi Zhang , Yuexiang Li , Hongxin Wei , Kai Ma , Tao Xu , Yefeng Zheng

Real-world data inevitably contains noisy labels, which induce the poor generalization of deep neural networks. It is known that the network typically begins to rapidly memorize false-labeled samples after a certain point of training. Thus,…

Machine Learning · Computer Science 2021-06-08 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Deep neural networks have been demonstrated to be vulnerable to adversarial noise, promoting the development of defense against adversarial attacks. Motivated by the fact that adversarial noise contains well-generalizing features and that…

Machine Learning · Computer Science 2022-07-19 Dawei Zhou , Nannan Wang , Bo Han , Tongliang Liu

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

Machine Learning · Statistics 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang

Recently, many self-supervised learning methods for image reconstruction have been proposed that can learn from noisy data alone, bypassing the need for ground-truth references. Most existing methods cluster around two classes: i) Stein's…

Machine Learning · Statistics 2025-02-12 Julián Tachella , Mike Davies , Laurent Jacques

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

The paradigm of learning from automatic annotations driven by pre-trained experts and Foundation Models dominates data-hungry applications. However, it introduces a critical challenge: model-induced label noise. Unlike stochastic noise in…

Machine Learning · Computer Science 2026-05-18 Dayong Ren