English
Related papers

Related papers: DiscrimLoss: A Universal Loss for Hard Samples and…

200 papers

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

Machine Learning · Computer Science 2024-09-25 Sjoerd de Vries , Dirk Thierens

Diffusion models learn to restore noisy data, which is corrupted with different levels of noise, by optimizing the weighted sum of the corresponding loss terms, i.e., denoising score matching loss. In this paper, we show that restoring data…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Jooyoung Choi , Jungbeom Lee , Chaehun Shin , Sungwon Kim , Hyunwoo Kim , Sungroh Yoon

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

Machine Learning · Computer Science 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

Machine Learning · Computer Science 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Supervised learning, especially supervised deep learning, requires large amounts of labeled data. One approach to collect large amounts of labeled data is by using a crowdsourcing platform where numerous workers perform the annotation…

Machine Learning · Computer Science 2023-08-22 Kosuke Yoshimura , Hisashi Kashima

Many time series classification tasks, where labels vary over time, are affected by label noise that also varies over time. Such noise can cause label quality to improve, worsen, or periodically change over time. We first propose and…

Machine Learning · Computer Science 2025-03-18 Sujay Nagaraj , Walter Gerych , Sana Tonekaboni , Anna Goldenberg , Berk Ustun , Thomas Hartvigsen

Label noise, which refers to the mislabeling of instances in a dataset, can significantly impair classifier performance, increase model complexity, and affect feature selection. While most research has concentrated on deep neural networks…

Machine Learning · Computer Science 2025-01-07 Anita Eisenbürger , Daniel Otten , Anselm Hudde , Frank Hopfgartner

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

Machine Learning · Computer Science 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

The performance of deep segmentation models often degrades due to distribution shifts in image intensities between the training and test data sets. This is particularly pronounced in multi-centre studies involving data acquired using…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Zhendong Liu , Van Manh , Xin Yang , Xiaoqiong Huang , Karim Lekadir , Víctor Campello , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better accuracy. These advances come with practical challenges: for…

Machine Learning · Computer Science 2019-03-05 Jasmine Collins , Johannes Balle , Jonathon Shlens

Label noise and ambiguities between similar classes are challenging problems in developing new models and annotating new data for semantic segmentation. In this paper, we propose Compensation Learning in Semantic Segmentation, a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Timo Kaiser , Christoph Reinders , Bodo Rosenhahn

Recent deep networks are capable of memorizing the entire data even when the labels are completely random. To overcome the overfitting on corrupted labels, we propose a novel technique of learning another neural network, called MentorNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Lu Jiang , Zhengyuan Zhou , Thomas Leung , Li-Jia Li , Li Fei-Fei

The prevalence of noisy labels in real-world datasets poses a significant impediment to the effective deployment of deep learning models. While meta-learning strategies have emerged as a promising approach for addressing this challenge,…

Machine Learning · Computer Science 2025-02-12 Mengyang Li

Deep neural networks trained with standard cross-entropy loss memorize noisy labels, which degrades their performance. Most research to mitigate this memorization proposes new robust classification loss functions. Conversely, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Labeled data is a fundamental component in training supervised deep learning models for computer vision tasks. However, the labeling process, especially for ordinal image classification where class boundaries are often ambiguous, is prone…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Alireza Sedighi Moghaddam , Mohammad Reza Mohammadi

We investigate the problem of classification in the presence of unknown class-conditional label noise in which the labels observed by the learner have been corrupted with some unknown class dependent probability. In order to obtain finite…

Machine Learning · Statistics 2019-06-11 Henry W J Reeve , Ata Kaban

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang