中文
相关论文

相关论文: Learning Soft Labels via Meta Learning

200 篇论文

Modern neural networks have the capacity to overfit noisy labels frequently found in real-world datasets. Although great progress has been made, existing techniques are limited in providing theoretical guarantees for the performance of the…

机器学习 · 计算机科学 2020-11-17 Baharan Mirzasoleiman , Kaidi Cao , Jure Leskovec

Supervised learning usually requires a large amount of labelled data. However, attaining ground-truth labels is costly for many tasks. Alternatively, weakly supervised methods learn with cheap weak signals that only approximately label some…

机器学习 · 计算机科学 2024-11-26 You Lu , Wenzhuo Song , Chidubem Arachie , Bert Huang

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

信息检索 · 计算机科学 2022-08-18 Dany Haddad

Recent information extraction approaches have relied on training deep neural models. However, such models can easily overfit noisy labels and suffer from performance degradation. While it is very costly to filter noisy labels in large…

计算与语言 · 计算机科学 2022-01-24 Wenxuan Zhou , Muhao Chen

Sequential recommenders that are trained on implicit feedback are usually learned as a multi-class classification task through softmax-based loss functions on one-hot class labels. However, one-hot training labels are sparse and may lead to…

信息检索 · 计算机科学 2023-11-07 Shiguang Wu , Xin Xin , Pengjie Ren , Zhumin Chen , Jun Ma , Maarten de Rijke , Zhaochun Ren

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

机器学习 · 计算机科学 2020-12-17 Hideitsu Hino

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

计算与语言 · 计算机科学 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Distilling knowledge from a large teacher model to a lightweight one is a widely successful approach for generating compact, powerful models in the semi-supervised learning setting where a limited amount of labeled data is available. In…

机器学习 · 计算机科学 2023-02-07 Cenk Baykal , Khoa Trinh , Fotis Iliopoulos , Gaurav Menghani , Erik Vee

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

机器学习 · 计算机科学 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

机器学习 · 计算机科学 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

机器学习 · 计算机科学 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which…

机器学习 · 计算机科学 2023-08-29 Suqin Yuan , Lei Feng , Tongliang Liu

We consider the problem of learning when obtaining the training labels is costly, which is usually tackled in the literature using active-learning techniques. These approaches provide strategies to choose the examples to label before or…

机器学习 · 计算机科学 2017-07-18 Gabriella Contardo , Ludovic Denoyer , Thierry Artieres

Deep neural networks have been shown to easily overfit to biased training data with label noise or class imbalance. Meta-learning algorithms are commonly designed to alleviate this issue in the form of sample reweighting, by learning a meta…

机器学习 · 计算机科学 2020-12-11 Hongxin Wei , Lei Feng , Rundong Wang , Bo An

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

机器学习 · 计算机科学 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Deep neural networks have been shown to be very powerful modeling tools for many supervised learning tasks involving complex input patterns. However, they can also easily overfit to training set biases and label noises. In addition to…

机器学习 · 计算机科学 2019-05-07 Mengye Ren , Wenyuan Zeng , Bin Yang , Raquel Urtasun

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

机器学习 · 计算机科学 2021-10-05 Erik Englesson , Hossein Azizpour