中文
相关论文

相关论文: Feature Noise Boosts DNN Generalization under Labe…

200 篇论文

Graph neural networks based on message-passing mechanisms have achieved advanced results in graph classification tasks. However, their generalization performance degrades when noisy labels are present in the training data. Most existing…

机器学习 · 计算机科学 2024-06-12 De Li , Xianxian Li , Zeming Gan , Qiyu Li , Bin Qu , Jinyan Wang

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

机器学习 · 统计学 2022-05-13 Amanda Olmin , Fredrik Lindsten

Generalizable gaze estimation methods have garnered increasing attention due to their critical importance in real-world applications and have achieved significant progress. However, they often overlook the effect of label noise, arising…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yanming Peng , Shijing Wang , Yaping Huang , Yi Tian

Graph Neural Networks (GNNs) have become widely-used models for semi-supervised learning. However, the robustness of GNNs in the presence of label noise remains a largely under-explored problem. In this paper, we consider an important yet…

机器学习 · 计算机科学 2023-02-28 Siyi Qian , Haochao Ying , Renjun Hu , Jingbo Zhou , Jintai Chen , Danny Z. Chen , Jian Wu

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Deep Neural Networks require large amounts of labeled data for their training. Collecting this data at scale inevitably causes label noise.Hence,the need to develop learning algorithms that are robust to label noise. In recent years, k…

机器学习 · 计算机科学 2021-07-22 Itzik Mizrahi , Shai Avidan

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

机器学习 · 计算机科学 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

机器学习 · 计算机科学 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

The acoustic variability of noisy and reverberant speech mixtures is influenced by multiple factors, such as the spectro-temporal characteristics of the target speaker and the interfering noise, the signal-to-noise ratio (SNR) and the room…

音频与语音处理 · 电气工程与系统科学 2023-11-09 Philippe Gonzalez , Tommy Sonne Alstrøm , Tobias May

Despite the rapid development of machine learning algorithms for domain generalization (DG), there is no clear empirical evidence that the existing DG algorithms outperform the classic empirical risk minimization (ERM) across standard…

机器学习 · 计算机科学 2024-03-19 Rui Qiao , Bryan Kian Hsiang Low

This paper explores the connection between learning trajectories of Deep Neural Networks (DNNs) and their generalization capabilities when optimized using (stochastic) gradient descent algorithms. Instead of concentrating solely on the…

机器学习 · 计算机科学 2023-11-01 Jingwen Fu , Zhizheng Zhang , Dacheng Yin , Yan Lu , Nanning Zheng

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

机器学习 · 计算机科学 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Label smoothing is commonly used in training deep learning models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both predictive performance and model calibration. In…

机器学习 · 计算机科学 2020-03-06 Michal Lukasik , Srinadh Bhojanapalli , Aditya Krishna Menon , Sanjiv Kumar

Deep neural networks (DNNs) have achieved tremendous success in a variety of applications across many disciplines. Yet, their superior performance comes with the expensive cost of requiring correctly annotated large-scale datasets.…

机器学习 · 计算机科学 2018-12-03 Zhilu Zhang , Mert R. Sabuncu

There is an emerging trend to leverage noisy image datasets in many visual recognition tasks. However, the label noise among the datasets severely degenerates the \mbox{performance of deep} learning approaches. Recently, one mainstream is…

计算机视觉与模式识别 · 计算机科学 2017-11-03 Jiangchao Yao , Jiajie Wang , Ivor Tsang , Ya Zhang , Jun Sun , Chengqi Zhang , Rui Zhang

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

机器学习 · 计算机科学 2021-07-23 Louis Mahon , Thomas Lukasiewicz

Recently, over-parameterized deep networks, with increasingly more network parameters than training samples, have dominated the performances of modern machine learning. However, when the training data is corrupted, it has been well-known…

机器学习 · 计算机科学 2022-08-04 Sheng Liu , Zhihui Zhu , Qing Qu , Chong You

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

机器学习 · 计算机科学 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

机器学习 · 统计学 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and the uniform distribution over labels. Smoothing the labels…

机器学习 · 计算机科学 2020-06-12 Rafael Müller , Simon Kornblith , Geoffrey Hinton