中文
相关论文

相关论文: Variational Learning Induces Adaptive Label Smooth…

200 篇论文

Noisy labels can impair the performance of deep neural networks. To tackle this problem, in this paper, we propose a new method for filtering label noise. Unlike most existing methods relying on the posterior probability of a noisy…

计算机视觉与模式识别 · 计算机科学 2022-01-31 Pengxiang Wu , Songzhu Zheng , Mayank Goswami , Dimitris Metaxas , Chao Chen

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

Recent advances in deep learning significantly boost the performance of salient object detection (SOD) at the expense of labeling larger-scale per-pixel annotations. To relieve the burden of labor-intensive labeling, deep unsupervised SOD…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Pengxiang Yan , Ziyi Wu , Mengmeng Liu , Kun Zeng , Liang Lin , Guanbin Li

Datasets with noisy labels are a common occurrence in practical applications of classification methods. We propose a simple probabilistic method for training deep classifiers under input-dependent (heteroscedastic) label noise. We assume an…

机器学习 · 计算机科学 2020-11-16 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

Ordinary stochastic neural networks mostly rely on the expected values of their weights to make predictions, whereas the induced noise is mostly used to capture the uncertainty, prevent overfitting and slightly boost the performance through…

机器学习 · 统计学 2019-02-19 Kirill Neklyudov , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

机器学习 · 计算机科学 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Yangdi Lu , Wenbo He

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

Because deep learning is vulnerable to noisy labels, sample selection techniques, which train networks with only clean labeled data, have attracted a great attention. However, if the labels are dominantly corrupted by few classes, these…

机器学习 · 计算机科学 2021-07-16 Kyeongbo Kong , Junggi Lee , Youngchul Kwak , Young-Rae Cho , Seong-Eun Kim , Woo-Jin Song

We show when maximizing a properly defined $f$-divergence measure with respect to a classifier's predictions and the supervised labels is robust with label noise. Leveraging its variational form, we derive a nice decoupling property for a…

机器学习 · 计算机科学 2021-08-20 Jiaheng Wei , Yang Liu

Previous research has shown that constraining the gradient of loss function with respect to model-predicted probabilities can enhance the model robustness against noisy labels. These methods typically specify a fixed optimal threshold for…

机器学习 · 计算机科学 2024-12-24 Xichen Ye , Yifan Wu , Weizhong Zhang , Xiaoqiang Li , Yifan Chen , Cheng Jin

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Recent studies indicate that current adversarial attack methods are flawed and easy to fail when encountering some deliberately designed defense. Sometimes even a slight modification in the model details will invalidate the attack. We find…

计算机视觉与模式识别 · 计算机科学 2020-09-18 Chaohao Fu , Hongbin Chen , Na Ruan , Weijia Jia

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

机器学习 · 计算机科学 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Extreme classification tasks are multi-label tasks with an extremely large number of labels (tags). These tasks are hard because the label space is usually (i) very large, e.g. thousands or millions of labels, (ii) very sparse, i.e. very…

机器学习 · 计算机科学 2020-12-04 Elham J. Barezi , Iacer Calixto , Kyunghyun Cho , Pascale Fung

We consider online prediction of a binary sequence with expert advice. For this setting, we devise label-efficient forecasting algorithms, which use a selective sampling scheme that enables collecting much fewer labels than standard…

机器学习 · 统计学 2023-10-23 Rui M. Castro , Fredrik Hellström , Tim van Erven

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

Learning and decision-making in domains with naturally high noise-to-signal ratio, such as Finance or Healthcare, is often challenging, while the stakes are very high. In this paper, we study the problem of learning and acting under a…

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

机器学习 · 计算机科学 2024-01-26 Julian Lienen , Eyke Hüllermeier