English
Related papers

Related papers: Improving group robustness under noisy labels usin…

200 papers

Standard empirical risk minimization (ERM) models may prioritize learning spurious correlations between spurious features and true labels, leading to poor accuracy on groups where these correlations do not hold. Mitigating this issue often…

Machine Learning · Computer Science 2024-06-05 Yujin Han , Difan Zou

Imperfect labels are ubiquitous in real-world datasets and seriously harm the model performance. Several recent effective methods for handling noisy labels have two key steps: 1) dividing samples into cleanly labeled and wrongly labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Wenkai Chen , Chuang Zhu , Yi Chen , Mengting Li , Tiejun Huang

Labeling real-world datasets is time consuming but indispensable for supervised machine learning models. A common solution is to distribute the labeling task across a large number of non-expert workers via crowd-sourcing. Due to the varying…

Machine Learning · Computer Science 2020-11-16 Taraneh Younesian , Chi Hong , Amirmasoud Ghiassi , Robert Birke , Lydia Y. Chen

Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature…

Machine Learning · Computer Science 2023-10-31 Christos Tsirigotis , Joao Monteiro , Pau Rodriguez , David Vazquez , Aaron Courville

Empirical Risk Minimization (ERM) is fragile in scenarios with insufficient labeled samples. A vanilla extension of ERM to unlabeled samples is Entropy Minimization (EntMin), which employs the soft-labels of unlabeled samples to guide their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yulong Zhang , Yuan Yao , Shuhao Chen , Pengrong Jin , Yu Zhang , Jian Jin , Jiangang Lu

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

Machine Learning · Statistics 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

Machine Learning · Computer Science 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

It is well-known that training neural networks for image classification with empirical risk minimization (ERM) makes them vulnerable to relying on spurious attributes instead of causal ones for prediction. Previously, deep feature…

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

We propose the Uncertainty Contrastive Framework (UCF), a Positive-Unlabeled (PU) representation learning framework that integrates uncertainty-aware contrastive loss, adaptive temperature scaling, and a self-attention-guided LSTM encoder…

Machine Learning · Computer Science 2025-12-11 Elias Hossain , Umesh Biswas , Charan Gudla , Sai Phani Parsa

Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models…

Machine Learning · Computer Science 2026-03-03 Subeen Park , Joowang Kim , Hakyung Lee , Sunjae Yoo , Kyungwoo Song

Label noise poses a significant challenge in Earth Observation (EO), often degrading the performance and reliability of supervised Machine Learning (ML) models. Yet, given the critical nature of several EO applications, developing robust…

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

We present a novel approach to learn binary classifiers when only positive and unlabeled instances are available (PU learning). This problem is routinely cast as a supervised task with label noise in the negative set. We use an ensemble of…

Machine Learning · Statistics 2015-02-13 Marc Claesen , Frank De Smet , Johan A. K. Suykens , Bart De Moor

Predictive performance of machine learning models trained with empirical risk minimization (ERM) can degrade considerably under distribution shifts. The presence of spurious correlations in training datasets leads ERM-trained models to…

Machine Learning · Computer Science 2023-02-08 Simon Roburin , Charles Corbière , Gilles Puy , Nicolas Thome , Matthieu Aubry , Renaud Marlet , Patrick Pérez

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously…

Machine Learning · Computer Science 2025-06-19 Guangtao Zheng , Wenqian Ye , Aidong Zhang
‹ Prev 1 2 3 10 Next ›