中文
相关论文

相关论文: Cross Entropy versus Label Smoothing: A Neural Col…

200 篇论文

Label smoothing -- using softened labels instead of hard ones -- is a widely adopted regularization method for deep learning, showing diverse benefits such as enhanced generalization and calibration. Its implications for preserving model…

机器学习 · 计算机科学 2024-07-09 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper,…

计算机视觉与模式识别 · 计算机科学 2020-05-05 Zhuolin Jiang , Jan Silovsky , Man-Hung Siu , William Hartmann , Herbert Gish , Sancar Adali

In semantic segmentation, training data down-sampling is commonly performed due to limited resources, the need to adapt image size to the model input, or improve data augmentation. This down-sampling typically employs different strategies…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Roberto Alcover-Couso , Marcos Escudero-Vinolo , Juan C. SanMiguel , Jose M. Martinez

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by label noise, that is, a small amount of incorrectly labeled nodes…

机器学习 · 计算机科学 2024-11-19 Rui Zhao , Bin Shi , Zhiming Liang , Jianfei Ruan , Bo Dong , Lu Lin

We approach the problem of improving robustness of deep learning algorithms in the presence of label noise. Building upon existing label correction and co-teaching methods, we propose a novel training procedure to mitigate the memorization…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Jihye Kim , Aristide Baratin , Yan Zhang , Simon Lacoste-Julien

Deep convolutional neural networks (DCNNs) have contributed many breakthroughs in segmentation tasks, especially in the field of medical imaging. However, \textit{domain shift} and \textit{corrupted annotations}, which are two common…

计算机视觉与模式识别 · 计算机科学 2020-06-22 Qinming Zhang , Luyan Liu , Kai Ma , Cheng Zhuo , Yefeng Zheng

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely on labeled data, can enhance robustness against noisy labels.…

图像与视频处理 · 电气工程与系统科学 2024-01-17 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian Linte

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which -- when finetuned for…

机器学习 · 计算机科学 2025-08-15 Yuhan Xie , William Cappelletti , Mahsa Shoaran , Pascal Frossard

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

机器学习 · 计算机科学 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

机器学习 · 计算机科学 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz

Automatic annotation of large-scale datasets can introduce noisy training data labels, which adversely affect the learning process of deep neural networks (DNNs). Consequently, Noisy Labels Learning (NLL) has become a critical research…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Maria Marrium , Arif Mahmood , Mohammed Bennamoun

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

计算机视觉与模式识别 · 计算机科学 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Graph classification is a critical research problem in many applications from different domains. In order to learn a graph classification model, the most widely used supervision component is an output layer together with classification loss…

机器学习 · 计算机科学 2021-01-15 Yuxiang Ren , Jiyang Bai , Jiawei Zhang

In deep learning (DL) systems, label noise in training datasets often degrades model performance, as models may learn incorrect patterns from mislabeled data. The area of Learning with Noisy Labels (LNL) has introduced methods to…

机器学习 · 计算机科学 2024-12-03 Gordon Lim , Stefan Larson , Kevin Leach

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Yangdi Lu , Wenbo He

The robustness of machine learning models can be compromised by spurious correlations between non-causal features in the input data and target labels. A common way to test for such correlations is to train on data where the label is…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Akshit Achara , Yovin Yathathugoda , Nick Byrne , Michela Antonelli , Esther Puyol Anton , Alexander Hammers , Andrew P. King

Current methods focusing on medical image segmentation suffer from incorrect annotations, which is known as the noisy label issue. Most medical image segmentation with noisy labels methods utilize either noise transition matrix,…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zicheng Wang , Zhen Zhao , Erjian Guo , Luping Zhou