中文
相关论文

相关论文: Hard Samples, Bad Labels: Robust Loss Functions Th…

200 篇论文

Training deep networks with noisy labels leads to poor generalization and degraded accuracy due to overfitting to label noise. Existing approaches for learning with noisy labels often rely on the availability of a clean subset of data. By…

机器学习 · 计算机科学 2025-11-27 David Szczecina , Nicholas Pellegrino , Paul Fieguth

Corrupted labels and class imbalance are commonly encountered in practically collected training data, which easily leads to over-fitting of deep neural networks (DNNs). Existing approaches alleviate these issues by adopting a sample…

机器学习 · 计算机科学 2022-01-05 Shenwang Jiang , Jianan Li , Ying Wang , Bo Huang , Zhang Zhang , Tingfa Xu

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

机器学习 · 计算机科学 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

Labeling bias arises during data collection due to resource limitations or unconscious bias, leading to unequal label error rates across subgroups or misrepresentation of subgroup prevalence. Most fairness constraints assume training labels…

机器学习 · 计算机科学 2026-02-24 Frida Jørgensen , Nina Weng , Siavash Bigdeli

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

The cost and scarcity of fully supervised labels in statistical machine learning encourage using partially labeled data for model validation as a cheaper and more accessible alternative. Effectively collecting and leveraging weakly…

机器学习 · 统计学 2022-06-16 Maxime Cauchois , John Duchi

Mislabeled examples are ubiquitous in real-world machine learning datasets, advocating the development of techniques for automatic detection. We show that most mislabeled detection methods can be viewed as probing trained machine learning…

机器学习 · 计算机科学 2024-10-22 Thomas George , Pierre Nodet , Alexis Bondu , Vincent Lemaire

Deep metric learning has yielded impressive results in tasks such as clustering and image retrieval by leveraging neural networks to obtain highly discriminative feature embeddings, which can be used to group samples into different classes.…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Ismail Elezi , Sebastiano Vascon , Alessandro Torcinovich , Marcello Pelillo , Laura Leal-Taixe

Datasets typically contain inaccuracies due to human error and societal biases, and these inaccuracies can affect the outcomes of models trained on such datasets. We present a technique for certifying whether linear regression models are…

机器学习 · 计算机科学 2022-06-09 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

In the surface defect detection, there are some suspicious regions that cannot be uniquely classified as abnormal or normal. The annotating of suspicious regions is easily affected by factors such as workers' emotional fluctuations and…

计算机视觉与模式识别 · 计算机科学 2023-01-26 Tongzhi Niu , Bin Li , Kai Li , Yufeng Lin , Yuwei Li , Weifeng Li , Zhenrong Wang

Deep learning has become the method of choice in many application domains of machine learning in recent years, especially for multi-class classification tasks. The most common loss function used in this context is the cross-entropy loss,…

机器学习 · 计算机科学 2017-04-21 Yehezkel S. Resheff , Amit Mandelbaum , Daphna Weinshall

Active learning is a learning strategy whereby the machine learning algorithm actively identifies and labels data points to optimize its learning. This strategy is particularly effective in domains where an abundance of unlabeled data…

机器学习 · 计算机科学 2024-03-05 Zan-Kai Chong , Hiroyuki Ohsaki , Bryan Ng

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

机器学习 · 计算机科学 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

In contrast to the standard classification paradigm where the true class is given to each training pattern, complementary-label learning only uses training patterns each equipped with a complementary label, which only specifies one of the…

机器学习 · 统计学 2019-11-20 Takashi Ishida , Gang Niu , Aditya Krishna Menon , Masashi Sugiyama

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

机器学习 · 统计学 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

In Multi-Label Learning (MLL), it is extremely challenging to accurately annotate every appearing object due to expensive costs and limited knowledge. When facing such a challenge, a more practical and cheaper alternative should be Single…

机器学习 · 计算机科学 2024-06-11 Xiang Li , Xinrui Wang , Songcan Chen

Supervised learning usually requires a large amount of labelled data. However, attaining ground-truth labels is costly for many tasks. Alternatively, weakly supervised methods learn with cheap weak signals that only approximately label some…

机器学习 · 计算机科学 2024-11-26 You Lu , Wenzhuo Song , Chidubem Arachie , Bert Huang

We investigate the problem of machine learning with mislabeled training data. We try to make the effects of mislabeled training better understood through analysis of the basic model and equations that characterize the problem. This includes…

机器学习 · 计算机科学 2019-09-23 Herbert Gish , Jan Silovsky , Man-Ling Sung , Man-Hung Siu , William Hartmann , Zhuolin Jiang

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

机器学习 · 计算机科学 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…