中文
相关论文

相关论文: On the Robustness of Monte Carlo Dropout Trained w…

200 篇论文

Label noise presents a real challenge for supervised learning algorithms. Consequently, mitigating label noise has attracted immense research in recent years. Noise robust losses is one of the more promising approaches for dealing with…

机器学习 · 计算机科学 2021-04-27 Neta Shoham , Tomer Avidor , Nadav Israel

Collecting labeled data to train deep neural networks is costly and even impractical for many tasks. Thus, research effort has been focused in automatically curated datasets or unsupervised and weakly supervised learning. The common problem…

机器学习 · 计算机科学 2019-01-03 Nam Le , Jean-Marc Odobez

As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they…

机器学习 · 计算机科学 2022-11-30 Jongwoo Ko , Bongsoo Yi , Se-Young Yun

Deep neural networks (DNN) have been successfully applied to music classification including music tagging. However, there are several open questions regarding the training, evaluation, and analysis of DNNs. In this article, we investigate…

信息检索 · 计算机科学 2017-11-15 Keunwoo Choi , George Fazekas , Kyunghyun Cho , Mark Sandler

Label noise is a significant obstacle in deep learning model training. It can have a considerable impact on the performance of image classification models, particularly deep neural networks, which are especially susceptible because they…

机器学习 · 计算机科学 2023-04-25 Pengwei Yang , Chongyangzi Teng , Jack George Mangos

In the presence of noisy or incorrect labels, neural networks have the undesirable tendency to memorize information about the noise. Standard regularization techniques such as dropout, weight decay or data augmentation sometimes help, but…

机器学习 · 计算机科学 2020-11-23 Hrayr Harutyunyan , Kyle Reing , Greg Ver Steeg , Aram Galstyan

Partly due to the use of exhaustive-annotated data, deep networks have achieved impressive performance on medical image segmentation. Medical imaging data paired with noisy annotation are, however, ubiquitous, but little is known about the…

图像与视频处理 · 电气工程与系统科学 2020-03-16 Shaode Yu , Erlei Zhang , Junjie Wu , Hang Yu , Zi Yang , Lin Ma , Mingli Chen , Xuejun Gu , Weiguo Lu

Deep neural networks (DNNs) have achieved tremendous success in a variety of applications across many disciplines. Yet, their superior performance comes with the expensive cost of requiring correctly annotated large-scale datasets.…

机器学习 · 计算机科学 2018-12-03 Zhilu Zhang , Mert R. Sabuncu

Deep learning with noisy labels presents significant challenges. In this work, we theoretically characterize the role of label noise from a feature learning perspective. Specifically, we consider a signal-noise data distribution, where each…

机器学习 · 统计学 2025-05-27 Andi Han , Wei Huang , Zhanpeng Zhou , Gang Niu , Wuyang Chen , Junchi Yan , Akiko Takeda , Taiji Suzuki

Highly over-parameterized models can simultaneously memorize noisy labels and generalize well, yet how these behaviors coexist remains poorly understood. In this work, we investigate the underlying mechanisms of this coexistence using…

机器学习 · 计算机科学 2026-05-19 Linyu Liu , Pinyan Lu

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

机器学习 · 计算机科学 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Due to the memorization effect in Deep Neural Networks (DNNs), training with noisy labels usually results in inferior model performance. Existing state-of-the-art methods primarily adopt a sample selection strategy, which selects small-loss…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Yazhou Yao , Zeren Sun , Chuanyi Zhang , Fumin Shen , Qi Wu , Jian Zhang , Zhenmin Tang

Supervised training of deep learning models requires large labeled datasets. There is a growing interest in obtaining such datasets for medical image analysis applications. However, the impact of label noise has not received sufficient…

计算机视觉与模式识别 · 计算机科学 2020-03-24 Davood Karimi , Haoran Dou , Simon K. Warfield , Ali Gholipour

Large-scale datasets may contain significant proportions of noisy (incorrect) class labels, and it is well-known that modern deep neural networks (DNNs) poorly generalize from such noisy training datasets. To mitigate the issue, we propose…

机器学习 · 统计学 2019-05-15 Kimin Lee , Sukmin Yun , Kibok Lee , Honglak Lee , Bo Li , Jinwoo Shin

Label noise poses a serious threat to deep neural networks (DNNs). Employing robust loss functions which reconcile fitting ability with robustness is a simple but effective strategy to handle this problem. However, the widely-used static…

机器学习 · 计算机科学 2023-08-08 Xiu-Chuan Li , Xiaobo Xia , Fei Zhu , Tongliang Liu , Xu-Yao Zhang , Cheng-Lin Liu

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

机器学习 · 计算机科学 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

In this work, we propose the use of dropouts as a Bayesian estimator for increasing the generalizability of a deep neural network (DNN) for speech enhancement. By using Monte Carlo (MC) dropout, we show that the DNN performs better…

音频与语音处理 · 电气工程与系统科学 2018-06-05 Nazreen P M , A G Ramakrishnan

Despite the rapid development of machine learning algorithms for domain generalization (DG), there is no clear empirical evidence that the existing DG algorithms outperform the classic empirical risk minimization (ERM) across standard…

机器学习 · 计算机科学 2024-03-19 Rui Qiao , Bryan Kian Hsiang Low

The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Chang Liu , Han Yu , Boyang Li , Zhiqi Shen , Zhanning Gao , Peiran Ren , Xuansong Xie , Lizhen Cui , Chunyan Miao