中文
相关论文

相关论文: Efficient Bilevel Optimization for Meta Label Corr…

200 篇论文

Deep learning methods have achieved promising performance in many areas, but they are still struggling with noisy-labeled images during the training process. Considering that the annotation quality indispensably relies on great expertise,…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Haidong Zhu , Jialin Shi , Ji Wu

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

机器学习 · 计算机科学 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy…

机器学习 · 计算机科学 2022-03-11 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Deep learning with noisy labels is practically challenging, as the capacity of deep models is so high that they can totally memorize these noisy labels sooner or later during training. Nonetheless, recent studies on the memorization effects…

机器学习 · 计算机科学 2018-10-31 Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor Tsang , Masashi Sugiyama

To train robust deep neural networks (DNNs), we systematically study several target modification approaches, which include output regularisation, self and non-self label correction (LC). Two key issues are discovered: (1) Self LC is the…

机器学习 · 计算机科学 2021-06-03 Xinshao Wang , Yang Hua , Elyor Kodirov , David A. Clifton , Neil M. Robertson

Label noise refers to incorrect labels in a dataset caused by human errors or collection defects, which is common in real-world applications and can significantly reduce the accuracy of models. This report explores how to estimate noise…

机器学习 · 计算机科学 2025-01-03 Haixu Liu , Zerui Tao , Naihui Zhang , Sixing Liu

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

机器学习 · 计算机科学 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

In deep learning (DL) systems, label noise in training datasets often degrades model performance, as models may learn incorrect patterns from mislabeled data. The area of Learning with Noisy Labels (LNL) has introduced methods to…

机器学习 · 计算机科学 2024-12-03 Gordon Lim , Stefan Larson , Kevin Leach

Deep Metric Learning (DML) plays a critical role in various machine learning tasks. However, most existing deep metric learning methods with binary similarity are sensitive to noisy labels, which are widely present in real-world data. Since…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Jiexi Yan , Lei Luo , Cheng Deng , Heng Huang

Previous graph neural networks (GNNs) usually assume that the graph data is with clean labels for representation learning, but it is not true in real applications. In this paper, we propose a new multi-teacher distillation method based on…

机器学习 · 计算机科学 2024-05-09 Yujing Liu , Zongqian Wu , Zhengyu Lu , Ci Nie , Guoqiu Wen , Ping Hu , Xiaofeng Zhu

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily overfit the label…

计算与语言 · 计算机科学 2023-06-14 Yuchen Zhuang , Yue Yu , Lingkai Kong , Xiang Chen , Chao Zhang

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

We propose a novel sample selection method for image classification in the presence of noisy labels. Existing methods typically consider small-loss samples as correctly labeled. However, some correctly labeled samples are inherently…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Weiran Pan , Wei Wei , Feida Zhu , Yong Deng

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

机器学习 · 计算机科学 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

The high capacity of deep learning models to learn complex patterns poses a significant challenge when confronted with label noise. The inability to differentiate clean and noisy labels ultimately results in poor generalization. We approach…

机器学习 · 计算机科学 2023-11-27 Eugene Kim

Active noise control typically employs adaptive filtering to generate secondary noise, where the least mean square algorithm is the most widely used. However, traditional updating rules are linear and exhibit limited effectiveness in…

音频与语音处理 · 电气工程与系统科学 2024-12-30 Pengxing Feng , Hing Cheung So

Pre-training on large-scale datasets and then fine-tuning on downstream tasks have become a standard practice in deep learning. However, pre-training data often contain label noise that may adversely affect the generalization of the model.…

机器学习 · 计算机科学 2024-03-12 Hao Chen , Jindong Wang , Ankit Shah , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj