English
Related papers

Related papers: Improving Group Robustness on Spurious Correlation…

200 papers

Fine-tuning a pretrained language model on a curated dataset can produce spurious correlations between the fine-tuning task and unintended latent factors -- such as misaligned personas or political slant -- that the curation procedure has…

Machine Learning · Statistics 2026-05-28 Ciarán M. Gilligan-Lee , Joseph Egan , Yuchen Zhu , Michael O'Riordan

Accurate Remaining Useful Life (RUL) prediction without labeled target domain data is a critical challenge, and domain adaptation (DA) has been widely adopted to address it by transferring knowledge from a labeled source domain to an…

Machine Learning · Computer Science 2026-03-18 Yubo Hou , Mohamed Ragab , Yucheng Wang , Min Wu , Abdulla Alseiari , Chee-Keong Kwoh , Xiaoli Li , Zhenghua Chen

The paradigm of worst-group loss minimization has shown its promise in avoiding to learn spurious correlations, but requires costly additional supervision on spurious attributes. To resolve this, recent works focus on developing weaker…

Machine Learning · Computer Science 2022-04-06 Junhyun Nam , Jaehyung Kim , Jaeho Lee , Jinwoo Shin

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Deep neural networks trained via empirical risk minimisation often exhibit significant performance disparities across groups, particularly when group and task labels are spuriously correlated (e.g., "grassy background" and "cows"). Existing…

The standard empirical risk minimization (ERM) can underperform on certain minority groups (i.e., waterbirds in lands or landbirds in water) due to the spurious correlation between the input and its label. Several studies have improved the…

Machine Learning · Computer Science 2022-12-15 Dongpin Oh , Dae Lee , Jeunghyun Byun , Bonggun Shin

Out-of-distribution generalization of machine learning models remains challenging since the models are inherently bound to the training data distribution. This especially manifests, when the learned models rely on spurious correlations.…

Machine Learning · Computer Science 2025-02-27 Martin Surner , Abdelmajid Khelil , Ludwig Bothmann

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

Neural networks trained with (stochastic) gradient descent have an inductive bias towards learning simpler solutions. This makes them highly prone to learning spurious correlations in the training data, that may not hold at test time. In…

Machine Learning · Computer Science 2024-03-08 Yu Yang , Eric Gan , Gintare Karolina Dziugaite , Baharan Mirzasoleiman

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

Models driven by spurious correlations often yield poor generalization performance. We propose the counterfactual (CF) alignment method to detect and quantify spurious correlations of black box classifiers. Our methodology is based on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Joseph Paul Cohen , Louis Blankemeier , Akshay Chaudhari

Convolutional Neural Networks (CNNs) have proven to be state-of-the-art models for supervised computer vision tasks, such as image classification. However, large labeled data sets are generally needed for the training and validation of such…

Machine Learning · Computer Science 2020-10-28 Patrick Hemmer , Niklas Kühl , Jakob Schöffer

Deterministic neural nets have been shown to learn effective predictors on a wide range of machine learning problems. However, as the standard approach is to train the network to minimize a prediction loss, the resultant model remains…

Machine Learning · Computer Science 2018-11-02 Murat Sensoy , Lance Kaplan , Melih Kandemir

Learning a fair predictive model is crucial to mitigate biased decisions against minority groups in high-stakes applications. A common approach to learn such a model involves solving an optimization problem that maximizes the predictive…

Machine Learning · Computer Science 2023-06-08 Abhin Shah , Maohao Shen , Jongha Jon Ryu , Subhro Das , Prasanna Sattigeri , Yuheng Bu , Gregory W. Wornell

Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub-population,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 Changjian Shui , Justin Szeto , Raghav Mehta , Douglas L. Arnold , Tal Arbel

Reliable uncertainty quantification remains a major obstacle to the deployment of deep learning models under distributional shift. Existing post-hoc approaches that retrofit pretrained models either inherit misplaced confidence or merely…

Machine Learning · Computer Science 2025-09-30 Charmaine Barker , Daniel Bethell , Simos Gerasimou

Deep neural networks often develop spurious bias, reliance on correlations between non-essential features and classes for predictions. For example, a model may identify objects based on frequently co-occurring backgrounds rather than…

Machine Learning · Computer Science 2025-06-02 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Conformal Prediction provides distribution-free prediction intervals with guaranteed coverage, but its reliance on a single global calibration threshold obscures the sources of uncertainty at the instance level. In particular, it conflates…

Most named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty, which is critical to the reliability of NER systems in open environments. Evidential deep learning (EDL) has…

Computation and Language · Computer Science 2023-05-30 Zhen Zhang , Mengting Hu , Shiwan Zhao , Minlie Huang , Haotian Wang , Lemao Liu , Zhirui Zhang , Zhe Liu , Bingzhe Wu

Despite recent advances in the accuracy of brain tumor segmentation, the results still suffer from low reliability and robustness. Uncertainty estimation is an efficient solution to this problem, as it provides a measure of confidence in…

Image and Video Processing · Electrical Eng. & Systems 2022-08-15 Hao Li , Yang Nan , Javier Del Ser , Guang Yang