English
Related papers

Related papers: Learning under noisy supervision is governed by a …

200 papers

Deep learning with noisy labels presents significant challenges. In this work, we theoretically characterize the role of label noise from a feature learning perspective. Specifically, we consider a signal-noise data distribution, where each…

Machine Learning · Statistics 2025-05-27 Andi Han , Wei Huang , Zhanpeng Zhou , Gang Niu , Wuyang Chen , Junchi Yan , Akiko Takeda , Taiji Suzuki

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

Machine Learning · Computer Science 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

Learning and decision-making in domains with naturally high noise-to-signal ratio, such as Finance or Healthcare, is often challenging, while the stakes are very high. In this paper, we study the problem of learning and acting under a…

Machine Learning · Computer Science 2023-09-26 Yikai Zhang , Songzhu Zheng , Mina Dalirrooyfard , Pengxiang Wu , Anderson Schneider , Anant Raj , Yuriy Nevmyvaka , Chao Chen

Optimization plays a key role in the training of deep neural networks. Deciding when to stop training can have a substantial impact on the performance of the network during inference. Under certain conditions, the generalization error can…

Machine Learning · Computer Science 2021-09-20 Florian Dubost , Erin Hong , Max Pike , Siddharth Sharma , Siyi Tang , Nandita Bhaskhar , Christopher Lee-Messer , Daniel Rubin

We analyze the dynamics of the Learning-Without-Recall model with Gaussian priors in a dynamic social network. Agents seeking to learn the state of the world, the "truth", exchange signals about their current beliefs across a changing…

Optimization and Control · Mathematics 2016-09-21 Chu Wang , Bernard Chazelle

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy…

Machine Learning · Computer Science 2022-03-11 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

Learning with noisy labels remains challenging because over-parameterized networks memorize corrupted supervision. Meta-learning-based sample reweighting mitigates this by using a small clean subset to guide training, yet its behavior and…

Machine Learning · Computer Science 2025-10-15 Yiming Zhang , Chester Holtz , Gal Mishne , Alex Cloninger

Many recent studies endeavor to improve open-source language models through imitation learning, and re-training on the synthetic instruction data from state-of-the-art proprietary models like ChatGPT and GPT-4. However, the innate nature of…

Computation and Language · Computer Science 2024-04-16 Hyunsoo Cho

Label noise may affect the generalization of classifiers, and the effective learning of main patterns from samples with noisy labels is an important challenge. Recent studies have shown that deep neural networks tend to prioritize the…

Machine Learning · Computer Science 2019-12-06 Yi Sun , Yan Tian , Yiping Xu , Jianxiang Li

Noisy labels are very common in real-world training data, which lead to poor generalization on test data because of overfitting to the noisy labels. In this paper, we claim that such overfitting can be avoided by "early stopping" training a…

Machine Learning · Computer Science 2020-09-09 Hwanjun Song , Minseok Kim , Dongmin Park , Jae-Gil Lee

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

Machine Learning · Computer Science 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

Machine Learning · Computer Science 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

For high-resource languages like English, text classification is a well-studied task. The performance of modern NLP models easily achieves an accuracy of more than 90% in many standard datasets for text classification in English (Xie et…

Computation and Language · Computer Science 2022-06-06 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

The label noise transition matrix $T$, reflecting the probabilities that true labels flip into noisy ones, is of vital importance to model label noise and design statistically consistent classifiers. The traditional transition matrix is…

Machine Learning · Computer Science 2020-12-03 Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Jiankang Deng , Jiatong Li , Yinian Mao

Learning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise. However, in real-world…

Machine Learning · Computer Science 2025-01-22 Linchao Pan , Can Gao , Jie Zhou , Jinbao Wang

Recent studies on learning with noisy labels have shown remarkable performance by exploiting a small clean dataset. In particular, model agnostic meta-learning-based label correction methods further improve performance by correcting noisy…

Machine Learning · Computer Science 2022-07-13 Seong Min Kye , Kwanghee Choi , Joonyoung Yi , Buru Chang