English
Related papers

Related papers: Trained Models Tell Us How to Make Them Robust to …

200 papers

Neural networks produced by standard training are known to suffer from poor accuracy on rare subgroups despite achieving high accuracy on average, due to the correlations between certain spurious features and labels. Previous approaches…

Machine Learning · Computer Science 2024-04-10 Gaotang Li , Jiarui Liu , Wei Hu

The paradigm of worst-group loss minimization has shown its promise in avoiding to learn spurious correlations, but requires costly additional supervision on spurious attributes. To resolve this, recent works focus on developing weaker…

Machine Learning · Computer Science 2022-04-06 Junhyun Nam , Jaehyung Kim , Jaeho Lee , Jinwoo Shin

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze of the…

Machine Learning · Statistics 2022-03-08 Oren Yuval , Saharon Rosset

Deep learning models are known to often learn features that spuriously correlate with the class label during training but are irrelevant to the prediction task. Existing methods typically address this issue by annotating potential spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Weiwei Li , Junzhuo Liu , Yuanyuan Ren , Yuchen Zheng , Yahao Liu , Wen Li

A major challenge to out-of-distribution generalization is reliance on spurious features -- patterns that are predictive of the class label in the training data distribution, but not causally related to the target. Standard methods for…

Machine Learning · Computer Science 2023-06-21 Shikai Qiu , Andres Potapczynski , Pavel Izmailov , Andrew Gordon Wilson

Models trained with empirical risk minimization (ERM) are prone to be biased towards spurious correlations between target labels and bias attributes, which leads to poor performance on data groups lacking spurious correlations. It is…

Machine Learning · Computer Science 2024-12-23 Hyeonggeun Han , Sehwan Kim , Hyungjun Joo , Sangwoo Hong , Jungwoo Lee

Spurious correlations in training data often lead to robustness issues since models learn to use them as shortcuts. For example, when predicting whether an object is a cow, a model might learn to rely on its green background, so it would do…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Raghav Mehta , Vítor Albiero , Li Chen , Ivan Evtimov , Tamar Glaser , Zhiheng Li , Tal Hassner

To enhance group robustness to spurious correlations, prior work often relies on auxiliary group annotations and assumes identical sets of groups across training and test domains. To overcome these limitations, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chenruo Liu , Hongjun Liu , Zeyu Lai , Yiqiu Shen , Chen Zhao , Qi Lei

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage them for predictions,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Guangtao Zheng , Wenqian Ye , Aidong Zhang

While standard Empirical Risk Minimization (ERM) training is proven effective for image classification on in-distribution data, it fails to perform well on out-of-distribution samples. One of the main sources of distribution shift for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fahimeh Hosseini Noohdani , Parsa Hosseini , Aryan Yazdan Parast , Hamidreza Yaghoubi Araghi , Mahdieh Soleymani Baghshah

The standard empirical risk minimization (ERM) can underperform on certain minority groups (i.e., waterbirds in lands or landbirds in water) due to the spurious correlation between the input and its label. Several studies have improved the…

Machine Learning · Computer Science 2022-12-15 Dongpin Oh , Dae Lee , Jeunghyun Byun , Bonggun Shin

Shortcut mitigation strategies commonly rely on training data annotations, group-balanced held-out data or the presence of all groups, i.e., all combinations of (spurious) attributes and classes, in the training data. However, these…

Machine Learning · Computer Science 2026-05-14 Phuong Quynh Le , Jörg Schlötterer , Sari Sadiya , Gemma Roig , Christin Seifert

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

Machine Learning · Computer Science 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

Developing simple, sample-efficient learning algorithms for robust classification is a pressing issue in today's tech-dominated world, and current theoretical techniques requiring exponential sample complexity and complicated improper…

Machine Learning · Computer Science 2023-02-07 Robi Bhattacharjee , Max Hopkins , Akash Kumar , Hantao Yu , Kamalika Chaudhuri

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

Machine Learning · Computer Science 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Deep learning models can suffer from severe performance degradation when relying on spurious correlations between input features and labels, making the models perform well on training data but have poor prediction accuracy for minority…

Machine Learning · Computer Science 2025-02-17 Tao Wen , Zihan Wang , Quan Zhang , Qi Lei

The task of image segmentation is inherently noisy due to ambiguities regarding the exact location of boundaries between anatomical structures. We argue that this information can be extracted from the expert annotations at no extra cost,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mobarakol Islam , Ben Glocker

Reward models (RMs) are essential for aligning Large Language Models (LLMs) with human preferences. However, they often struggle with capturing complex human preferences and generalizing to unseen data. To address these challenges, we…

Computation and Language · Computer Science 2025-08-06 Anamika Lochab , Ruqi Zhang

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

Neural networks lack adversarial robustness, i.e., they are vulnerable to adversarial examples that through small perturbations to inputs cause incorrect predictions. Further, trust is undermined when models give miscalibrated predictions,…

Machine Learning · Computer Science 2021-12-15 Yao Qin , Xuezhi Wang , Alex Beutel , Ed H. Chi