中文
相关论文

相关论文: Optimized Gradient Clipping for Noisy Label Learni…

200 篇论文

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

机器学习 · 计算机科学 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Maycon R. S. Pereira , Filipe R. Cordeiro

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

机器学习 · 计算机科学 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

统计方法学 · 统计学 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

We study the robustness to symmetric label noise of GNNs training procedures. By combining the nonlinear neural message-passing models (e.g. Graph Isomorphism Networks, GraphSAGE, etc.) with loss correction methods, we present a…

机器学习 · 计算机科学 2019-05-07 Hoang NT , Choong Jun Jin , Tsuyoshi Murata

In distributed training of deep neural networks, people usually run Stochastic Gradient Descent (SGD) or its variants on each machine and communicate with other machines periodically. However, SGD might converge slowly in training some deep…

机器学习 · 计算机科学 2022-10-14 Mingrui Liu , Zhenxun Zhuang , Yunwei Lei , Chunyang Liao

Training deep neural networks on real-world datasets is often hampered by the presence of noisy labels, which can be memorized by over-parameterized models, leading to significant degradation in generalization performance. While existing…

机器学习 · 计算机科学 2025-12-18 Jianchao Wang , Qingfeng Li , Pengcheng Zheng , Xiaorong Pu , Yazhou Ren

Node classification on graphs is a significant task with a wide range of applications, including social analysis and anomaly detection. Even though graph neural networks (GNNs) have produced promising results on this task, current…

机器学习 · 计算机科学 2023-06-16 Jingyang Yuan , Xiao Luo , Yifang Qin , Yusheng Zhao , Wei Ju , Ming Zhang

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

机器学习 · 计算机科学 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

Noisy labels are inevitable yet problematic in machine learning society. It ruins the generalization of a classifier by making the classifier over-fitted to noisy labels. Existing methods on noisy label have focused on modifying the…

机器学习 · 计算机科学 2022-05-27 HeeSun Bae , Seungjae Shin , Byeonghu Na , JoonHo Jang , Kyungwoo Song , Il-Chul Moon

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

机器学习 · 计算机科学 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte

We study the trade-offs between convergence rate and robustness to gradient errors in designing a first-order algorithm. We focus on gradient descent (GD) and accelerated gradient (AG) methods for minimizing strongly convex functions when…

最优化与控制 · 数学 2019-11-07 Necdet Serhat Aybat , Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar

Video anomaly detection under weak labels is formulated as a typical multiple-instance learning problem in previous works. In this paper, we provide a new perspective, i.e., a supervised learning task under noisy labels. In such a…

计算机视觉与模式识别 · 计算机科学 2019-03-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Shan Liu , Thomas H. Li , Ge Li

Graph Neural Networks (GNNs) have seen significant success in tasks such as node classification, largely contingent upon the availability of sufficient labeled nodes. Yet, the excessive cost of labeling large-scale graphs led to a focus on…

机器学习 · 计算机科学 2024-02-06 Hongliang Chi , Cong Qi , Suhang Wang , Yao Ma

Given data with noisy labels, over-parameterized deep networks can gradually memorize the data, and fit everything in the end. Although equipped with corrections for noisy labels, many learning methods in this area still suffer overfitting…

机器学习 · 计算机科学 2020-10-19 Bo Han , Gang Niu , Xingrui Yu , Quanming Yao , Miao Xu , Ivor Tsang , Masashi Sugiyama

Learning with noisy labels has aroused much research interest since data annotations, especially for large-scale datasets, may be inevitably imperfect. Recent approaches resort to a semi-supervised learning problem by dividing training…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Kai Wang , Xiangyu Peng , Shuo Yang , Jianfei Yang , Zheng Zhu , Xinchao Wang , Yang You

Recently, the study of heavy-tailed noises in first-order nonconvex stochastic optimization has gotten a lot of attention since it was recognized as a more realistic condition as suggested by many empirical observations. Specifically, the…

最优化与控制 · 数学 2025-05-30 Zijian Liu , Zhengyuan Zhou