中文
相关论文

相关论文: A Curriculum View of Robust Loss Functions

200 篇论文

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

机器学习 · 统计学 2022-05-13 Amanda Olmin , Fredrik Lindsten

Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the symmetric condition is…

机器学习 · 计算机科学 2021-06-08 Xiong Zhou , Xianming Liu , Junjun Jiang , Xin Gao , Xiangyang Ji

We consider training decision trees using noisily labeled data, focusing on loss functions that can lead to robust learning algorithms. Our contributions are threefold. First, we offer novel theoretical insights on the robustness of many…

机器学习 · 计算机科学 2024-01-24 Jonathan Wilton , Nan Ye

We present a "learning to learn" approach for automatically constructing white-box classification loss functions that are robust to label noise in the training data. We parameterize a flexible family of loss functions using Taylor…

机器学习 · 计算机科学 2021-03-02 Boyan Gao , Henry Gouk , Timothy M. Hospedales

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

机器学习 · 统计学 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

Incorrectly labelled training data are frustratingly ubiquitous in both benchmark and specially curated datasets. Such mislabelling clearly adversely affects the performance and generalizability of models trained through supervised learning…

机器学习 · 计算机科学 2025-11-27 Nicholas Pellegrino , David Szczecina , Paul Fieguth

Label noise and class imbalance commonly coexist in real-world data. Previous works for robust learning, however, usually address either one type of the data biases and underperform when facing them both. To mitigate this gap, this work…

机器学习 · 计算机科学 2023-09-06 Shenwang Jiang , Jianan Li , Jizhou Zhang , Ying Wang , Tingfa Xu

Deep neural networks (DNNs) have great expressive power, which can even memorize samples with wrong labels. It is vitally important to reiterate robustness and generalization in DNNs against label corruption. To this end, this paper studies…

机器学习 · 计算机科学 2020-02-24 Yueming Lyu , Ivor W. Tsang

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

机器学习 · 计算机科学 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Large annotated datasets inevitably contain noisy labels, which poses a major challenge for training deep neural networks as they easily memorize the labels. Noise-robust loss functions have emerged as a notable strategy to counteract this…

机器学习 · 计算机科学 2025-01-28 Max Staats , Matthias Thamm , Bernd Rosenow

The loss function is crucial to machine learning, especially in supervised learning frameworks. It is a fundamental component that controls the behavior and general efficacy of learning algorithms. However, despite their widespread use,…

机器学习 · 计算机科学 2026-02-09 Soumi Mahato , Lineesh M. C

Label noise presents a real challenge for supervised learning algorithms. Consequently, mitigating label noise has attracted immense research in recent years. Noise robust losses is one of the more promising approaches for dealing with…

机器学习 · 计算机科学 2021-04-27 Neta Shoham , Tomer Avidor , Nadav Israel

The real-world data is often susceptible to label noise, which might constrict the effectiveness of the existing state of the art algorithms for ordinal regression. Existing works on ordinal regression do not take label noise into account.…

机器学习 · 计算机科学 2020-01-28 Bhanu Garg , Naresh Manwani

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

机器学习 · 计算机科学 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

机器学习 · 计算机科学 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Training neural network classifiers on datasets with label noise poses a risk of overfitting them to the noisy labels. To address this issue, researchers have explored alternative loss functions that aim to be more robust. The…

机器学习 · 计算机科学 2024-08-23 William Toner , Amos Storkey

Label-noise or curated unlabeled data is used to compensate for the assumption of clean labeled data in training the conditional generative adversarial network; however, satisfying such an extended assumption is occasionally laborious or…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Kai Katsumata , Duc Minh Vo , Tatsuya Harada , Hideki Nakayama

Robust loss functions are essential for training accurate deep neural networks (DNNs) in the presence of noisy (incorrect) labels. It has been shown that the commonly used Cross Entropy (CE) loss is not robust to noisy labels. Whilst new…

机器学习 · 计算机科学 2020-06-25 Xingjun Ma , Hanxun Huang , Yisen Wang , Simone Romano , Sarah Erfani , James Bailey

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

机器学习 · 统计学 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone
‹ 上一页 1 2 3 10 下一页 ›