中文
相关论文

相关论文: Do We Need to Penalize Variance of Losses for Lear…

200 篇论文

Deep neural networks are susceptible to label noise. Existing methods to improve robustness, such as meta-learning and regularization, usually require significant change to the network architecture or careful tuning of the optimization…

机器学习 · 计算机科学 2022-05-31 Li Chen , Ningyuan Huang , Cong Mu , Hayden S. Helm , Kate Lytvynets , Weiwei Yang , Carey E. Priebe

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

机器学习 · 计算机科学 2024-01-26 Julian Lienen , Eyke Hüllermeier

Designing robust loss functions is popular in learning with noisy labels while existing designs did not explicitly consider the overfitting property of deep neural networks (DNNs). As a result, applying these losses may still suffer from…

机器学习 · 计算机科学 2022-05-27 Hao Cheng , Zhaowei Zhu , Xing Sun , Yang Liu

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Mislabeled samples are ubiquitous in real-world datasets as rule-based or expert labeling is usually based on incorrect assumptions or subject to biased opinions. Neural networks can "memorize" these mislabeled samples and, as a result,…

机器学习 · 计算机科学 2021-11-24 Katharina Rombach , Gabriel Michau , Olga Fink

Collecting labeled data to train deep neural networks is costly and even impractical for many tasks. Thus, research effort has been focused in automatically curated datasets or unsupervised and weakly supervised learning. The common problem…

机器学习 · 计算机科学 2019-01-03 Nam Le , Jean-Marc Odobez

In this paper, we answer the question of when inserting label noise (less informative labels) can instead return us more accurate and fair models. We are primarily inspired by three observations: 1) In contrast to reducing label noise…

机器学习 · 计算机科学 2021-11-09 Yang Liu , Jialu Wang

Label noise may affect the generalization of classifiers, and the effective learning of main patterns from samples with noisy labels is an important challenge. Recent studies have shown that deep neural networks tend to prioritize the…

机器学习 · 计算机科学 2019-12-06 Yi Sun , Yan Tian , Yiping Xu , Jianxiang Li

Label noise has been broadly observed in real-world datasets. To mitigate the negative impact of overfitting to label noise for deep models, effective strategies (\textit{e.g.}, re-weighting, or loss rectification) have been broadly applied…

机器学习 · 计算机科学 2026-03-19 Haoliang Sun , Qi Wei , Lei Feng , Yupeng Hu , Fan Liu , Hehe Fan , Yilong Yin

Many weakly supervised classification methods employ a noise transition matrix to capture the class-conditional label corruption. To estimate the transition matrix from noisy data, existing methods often need to estimate the noisy…

机器学习 · 统计学 2021-06-15 Yivan Zhang , Gang Niu , Masashi Sugiyama

The monotonic ordinal classification has increased the interest of researchers and practitioners within machine learning community in the last years. In real applications, the problems with monotonicity constraints are very frequent. To…

人工智能 · 计算机科学 2018-10-23 José-Ramón Cano , Julián Luengo , Salvador García

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

机器学习 · 统计学 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

We propose a novel framework to perform classification via deep learning in the presence of noisy annotations. When trained on noisy labels, deep neural networks have been observed to first fit the training data with clean labels during an…

机器学习 · 计算机科学 2020-10-26 Sheng Liu , Jonathan Niles-Weed , Narges Razavian , Carlos Fernandez-Granda

A widely used algorithm for transfer learning is fine-tuning, where a pre-trained model is fine-tuned on a target task with a small amount of labeled data. When the capacity of the pre-trained model is significantly larger than the size of…

机器学习 · 计算机科学 2025-08-15 Dongyue Li , Hongyang R. Zhang

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

机器学习 · 计算机科学 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao