中文
相关论文

相关论文: How Does Label Noise Gradient Descent Improve Gene…

200 篇论文

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

机器学习 · 计算机科学 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

The generalization mystery in deep learning is the following: Why do over-parameterized neural networks trained with gradient descent (GD) generalize well on real datasets even though they are capable of fitting random datasets of…

机器学习 · 计算机科学 2022-06-07 Satrajit Chatterjee , Piotr Zielinski

In deep learning (DL) systems, label noise in training datasets often degrades model performance, as models may learn incorrect patterns from mislabeled data. The area of Learning with Noisy Labels (LNL) has introduced methods to…

机器学习 · 计算机科学 2024-12-03 Gordon Lim , Stefan Larson , Kevin Leach

Training deep neural networks with noisy labels remains a significant challenge, often leading to degraded performance. Existing methods for handling label noise typically rely on either transition matrix, noise detection, or meta-learning…

机器学习 · 计算机科学 2026-03-17 Zhanhui Lin , Yanlin Liu , Sanping Zhou

Node representation learning on attributed graphs -- whose nodes are associated with rich attributes (e.g., texts and protein sequences) -- plays a crucial role in many important downstream tasks. To encode the attributes and graph…

机器学习 · 计算机科学 2025-06-04 Zhihao Shi , Jie Wang , Fanghua Lu , Hanzhu Chen , Defu Lian , Zheng Wang , Jieping Ye , Feng Wu

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

机器学习 · 计算机科学 2022-12-06 Deep Patel , P. S. Sastry

Recent advances in deep learning have relied on large, labelled datasets to train high-capacity models. However, collecting large datasets in a time- and cost-efficient manner often results in label noise. We present a method for learning…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Ahmet Iscen , Jack Valmadre , Anurag Arnab , Cordelia Schmid

Graph neural networks based on message-passing mechanisms have achieved advanced results in graph classification tasks. However, their generalization performance degrades when noisy labels are present in the training data. Most existing…

机器学习 · 计算机科学 2024-06-12 De Li , Xianxian Li , Zeming Gan , Qiyu Li , Bin Qu , Jinyan Wang

Given data with noisy labels, over-parameterized deep networks can gradually memorize the data, and fit everything in the end. Although equipped with corrections for noisy labels, many learning methods in this area still suffer overfitting…

机器学习 · 计算机科学 2020-10-19 Bo Han , Gang Niu , Xingrui Yu , Quanming Yao , Miao Xu , Ivor Tsang , Masashi Sugiyama

Although deep face recognition benefits significantly from large-scale training data, a current bottleneck is the labelling cost. A feasible solution to this problem is semi-supervised learning, exploiting a small portion of labelled data…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Yuchi Liu , Hailin Shi , Hang Du , Rui Zhu , Jun Wang , Liang Zheng , Tao Mei

Deep neural networks (DNNs) have been widely applied in medical image classification and achieve remarkable classification performance. These achievements heavily depend on large-scale accurately annotated training data. However, label…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Hongyang Jiang , Mengdi Gao , Yan Hu , Qiushi Ren , Zhaoheng Xie , Jiang Liu

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

音频与语音处理 · 电气工程与系统科学 2020-09-25 Sebastian Braun , Ivan Tashev

In this work, we propose a simple yet effective meta-learning algorithm in semi-supervised learning. We notice that most existing consistency-based approaches suffer from overfitting and limited model generalization ability, especially when…

机器学习 · 计算机科学 2021-03-18 Xin-Yu Zhang , Taihong Xiao , Haolin Jia , Ming-Ming Cheng , Ming-Hsuan Yang

Gradient regularization, as described in \citet{barrett2021implicit}, is a highly effective technique for promoting flat minima during gradient descent. Empirical evidence suggests that this regularization technique can significantly…

机器学习 · 统计学 2023-04-03 Xuran Meng , Yuan Cao , Difan Zou

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Collecting labeled data to train deep neural networks is costly and even impractical for many tasks. Thus, research effort has been focused in automatically curated datasets or unsupervised and weakly supervised learning. The common problem…

机器学习 · 计算机科学 2019-01-03 Nam Le , Jean-Marc Odobez

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

机器学习 · 计算机科学 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Görkem Algan , İlkay Ulusoy