中文
相关论文

相关论文: On the Robustness of Monte Carlo Dropout Trained w…

200 篇论文

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

机器学习 · 计算机科学 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

The notion of neural collapse refers to several emergent phenomena that have been empirically observed across various canonical classification problems. During the terminal phase of training a deep neural network, the feature embedding of…

机器学习 · 计算机科学 2023-04-05 Duc Anh Nguyen , Ron Levie , Julian Lienen , Gitta Kutyniok , Eyke Hüllermeier

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

机器学习 · 计算机科学 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

We propose a novel framework to perform classification via deep learning in the presence of noisy annotations. When trained on noisy labels, deep neural networks have been observed to first fit the training data with clean labels during an…

机器学习 · 计算机科学 2020-10-26 Sheng Liu , Jonathan Niles-Weed , Narges Razavian , Carlos Fernandez-Granda

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

机器学习 · 计算机科学 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

We show when maximizing a properly defined $f$-divergence measure with respect to a classifier's predictions and the supervised labels is robust with label noise. Leveraging its variational form, we derive a nice decoupling property for a…

机器学习 · 计算机科学 2021-08-20 Jiaheng Wei , Yang Liu

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

机器学习 · 计算机科学 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

Deep neural network models are robust to a limited amount of label noise, but their ability to memorise noisy labels in high noise rate problems is still an open issue. The most competitive noisy-label learning algorithms rely on a 2-stage…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Filipe R. Cordeiro , Ragav Sachdeva , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

机器学习 · 计算机科学 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

机器学习 · 计算机科学 2022-12-06 Deep Patel , P. S. Sastry

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

机器学习 · 计算机科学 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Learning with noisy labels is a practically challenging problem in weakly supervised learning. In the existing literature, open-set noises are always considered to be poisonous for generalization, similar to closed-set noises. In this…

机器学习 · 计算机科学 2021-11-22 Hongxin Wei , Lue Tao , Renchunzi Xie , Bo An

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

机器学习 · 计算机科学 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Dropout is conventionally used during the training phase as regularization method and for quantifying uncertainty in deep learning. We propose to use dropout during training as well as inference steps, and average multiple predictions to…

图像与视频处理 · 电气工程与系统科学 2023-11-07 Mehmet Yigit Avci , Ziyu Li , Qiuyun Fan , Susie Huang , Berkin Bilgic , Qiyuan Tian

Noisy labels are inevitable in real-world scenarios. Due to the strong capacity of deep neural networks to memorize corrupted labels, these noisy labels can cause significant performance degradation. Existing research on mitigating the…

机器学习 · 计算机科学 2025-10-02 Xinlei Zhang , Fan Liu , Chuanyi Zhang , Fan Cheng , Yuhui Zheng

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

计算与语言 · 计算机科学 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow