中文
相关论文

相关论文: Understanding and Mitigating the Label Noise in Pr…

200 篇论文

As sound event classification moves towards larger datasets, issues of label noise become inevitable. Web sites can supply large volumes of user-contributed audio and metadata, but inferring labels from this metadata introduces errors due…

Pre-training has been widely adopted in deep learning to improve model performance, especially when the training data for a target task is limited. In our work, we seek to understand the implications of this training strategy on the…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Vivek Ramanujan , Thao Nguyen , Sewoong Oh , Ludwig Schmidt , Ali Farhadi

Mislabeled samples are ubiquitous in real-world datasets as rule-based or expert labeling is usually based on incorrect assumptions or subject to biased opinions. Neural networks can "memorize" these mislabeled samples and, as a result,…

机器学习 · 计算机科学 2021-11-24 Katharina Rombach , Gabriel Michau , Olga Fink

Deep learning methods have achieved promising performance in many areas, but they are still struggling with noisy-labeled images during the training process. Considering that the annotation quality indispensably relies on great expertise,…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Haidong Zhu , Jialin Shi , Ji Wu

With the proliferation of algorithmic decision-making, increased scrutiny has been placed on these systems. This paper explores the relationship between the quality of the training data and the overall fairness of the models trained with…

计算机视觉与模式识别 · 计算机科学 2023-05-03 Aki Barry , Lei Han , Gianluca Demartini

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

机器学习 · 计算机科学 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Label noise is a significant obstacle in deep learning model training. It can have a considerable impact on the performance of image classification models, particularly deep neural networks, which are especially susceptible because they…

机器学习 · 计算机科学 2023-04-25 Pengwei Yang , Chongyangzi Teng , Jack George Mangos

We show that label noise exists in adversarial training. Such label noise is due to the mismatch between the true label distribution of adversarial examples and the label inherited from clean examples - the true label distribution is…

机器学习 · 计算机科学 2023-10-17 Chengyu Dong , Liyuan Liu , Jingbo Shang

One crucial factor behind the success of deep learning lies in the implicit bias induced by noise inherent in gradient-based training algorithms. Motivated by empirical observations that training with noisy labels improves model…

机器学习 · 计算机科学 2026-03-12 Tongcheng Zhang , Zhanpeng Zhou , Mingze Wang , Andi Han , Wei Huang , Taiji Suzuki , Junchi Yan

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

计算机视觉与模式识别 · 计算机科学 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

机器学习 · 计算机科学 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

计算机视觉与模式识别 · 计算机科学 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

计算机视觉与模式识别 · 计算机科学 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

信息检索 · 计算机科学 2022-08-18 Dany Haddad

In low-resource settings, the performance of supervised labeling models can be improved with automatically annotated or distantly supervised data, which is cheap to create but often noisy. Previous works have shown that significant…

计算与语言 · 计算机科学 2019-11-06 Lukas Lange , Michael A. Hedderich , Dietrich Klakow

Deep neural networks (DNNs) have been widely applied in medical image classification and achieve remarkable classification performance. These achievements heavily depend on large-scale accurately annotated training data. However, label…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Hongyang Jiang , Mengdi Gao , Yan Hu , Qiushi Ren , Zhaoheng Xie , Jiang Liu

Training neural network classifiers on datasets contaminated with noisy labels significantly increases the risk of overfitting. Thus, effectively implementing Early Stopping in noisy label environments is crucial. Under ideal circumstances,…

机器学习 · 计算机科学 2024-09-12 William Toner , Amos Storkey

Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper,…

计算机视觉与模式识别 · 计算机科学 2020-05-05 Zhuolin Jiang , Jan Silovsky , Man-Hung Siu , William Hartmann , Herbert Gish , Sancar Adali

In many domains, collecting sufficient labeled training data for supervised machine learning requires easily accessible but noisy sources, such as crowdsourcing services or tagged Web data. Noisy labels occur frequently in data sets…

机器学习 · 计算机科学 2018-11-16 Matthew Klawonn , Eric Heim , James Hendler

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

机器学习 · 计算机科学 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama