English
Related papers

Related papers: Spurious Correlation-Aware Embedding Regularizatio…

200 papers

While deep learning has significantly advanced accident anticipation, the robustness of these safety-critical systems against real-world perturbations remains a major challenge. We reveal that state-of-the-art models like CRASH, despite…

Machine Learning · Computer Science 2026-04-03 Wenjing Wang , Wenxuan Wang , Songning Lai

Recent years have witnessed the great success of self-supervised learning (SSL) in recommendation systems. However, SSL recommender models are likely to suffer from spurious correlations, leading to poor generalization. To mitigate spurious…

Information Retrieval · Computer Science 2024-04-19 Xinyu Lin , Yiyan Xu , Wenjie Wang , Yang Zhang , Fuli Feng

Neural networks trained with (stochastic) gradient descent have an inductive bias towards learning simpler solutions. This makes them highly prone to learning spurious correlations in the training data, that may not hold at test time. In…

Machine Learning · Computer Science 2024-03-08 Yu Yang , Eric Gan , Gintare Karolina Dziugaite , Baharan Mirzasoleiman

Existing research often posits spurious features as easier to learn than core features in neural network optimization, but the impact of their relative simplicity remains under-explored. Moreover, studies mainly focus on end performance…

Machine Learning · Computer Science 2024-08-27 GuanWen Qiu , Da Kuang , Surbhi Goel

Distant supervision tackles the data bottleneck in NER by automatically generating training instances via dictionary matching. Unfortunately, the learning of DS-NER is severely dictionary-biased, which suffers from spurious correlations and…

Computation and Language · Computer Science 2021-06-18 Wenkai Zhang , Hongyu Lin , Xianpei Han , Le Sun

Current methods for detecting spurious correlations rely on analyzing dataset statistics or error patterns, leaving many harmful shortcuts invisible when counterexamples are absent. We introduce BEE (Bridging Explainability and Embeddings),…

Artificial Intelligence · Computer Science 2026-02-12 Cristian Daniel Păduraru , Antonio Bărbălau , Radu Filipescu , Andrei Liviu Nicolicioiu , Elena Burceanu

Deep neural networks are notoriously sensitive to spurious correlations - where a model learns a shortcut that fails out-of-distribution. Existing work on spurious correlations has often focused on incomplete correlations,leveraging access…

Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

Modern machine learning models are prone to over-reliance on spurious correlations, which can often lead to poor performance on minority groups. In this paper, we identify surprising and nuanced behavior of finetuned models on worst-group…

Machine Learning · Computer Science 2024-10-29 Tyler LaBonte , John C. Hill , Xinchen Zhang , Vidya Muthukumar , Abhishek Kumar

Ranking samples by fine-grained estimates of spuriosity (the degree to which spurious cues are present) has recently been shown to significantly benefit bias mitigation, over the traditional binary biased-\textit{vs}-unbiased partitioning…

Machine Learning · Computer Science 2025-01-31 Adarsh Kappiyath , Abhra Chaudhuri , Ajay Jaiswal , Ziquan Liu , Yunpeng Li , Xiatian Zhu , Lu Yin

Shortcut learning undermines model generalization to out-of-distribution data. While the literature attributes shortcuts to biases in superficial features, we show that imbalances in the semantic distribution of sample embeddings induce…

Machine Learning · Computer Science 2025-06-24 Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

While standard Empirical Risk Minimization (ERM) training is proven effective for image classification on in-distribution data, it fails to perform well on out-of-distribution samples. One of the main sources of distribution shift for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fahimeh Hosseini Noohdani , Parsa Hosseini , Aryan Yazdan Parast , Hamidreza Yaghoubi Araghi , Mahdieh Soleymani Baghshah

Recent advances in off-policy deep reinforcement learning (RL) have led to impressive success in complex tasks from visual observations. Experience replay improves sample-efficiency by reusing experiences from the past, and convolutional…

Machine Learning · Computer Science 2021-10-29 Lili Chen , Kimin Lee , Aravind Srinivas , Pieter Abbeel

Learning models have been shown to rely on spurious correlations between non-predictive features and the associated labels in the training data, with negative implications on robustness, bias and fairness. In this work, we provide a…

Machine Learning · Statistics 2025-05-29 Simone Bombari , Marco Mondelli

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Vision-language foundation models have exhibited remarkable success across a multitude of downstream tasks due to their scalability on extensive image-text paired data. However, these models also display significant limitations when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Huan Ma , Yan Zhu , Changqing Zhang , Peilin Zhao , Baoyuan Wu , Long-Kai Huang , Qinghua Hu , Bingzhe Wu

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

The rapid development of multimedia has provided a large amount of data with different distributions for visual tasks, forming different domains. Federated Learning (FL) can efficiently use this diverse data distributed on different client…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shuran Ma , Weiying Xie , Daixun Li , Haowei Li , Yunsong Li

Spurious correlations that lead models to correct predictions for the wrong reasons pose a critical challenge for robust real-world generalization. Existing research attributes this issue to group imbalance and addresses it by maximizing…

Machine Learning · Computer Science 2025-12-02 Miaoyun Zhao , Chenrong Li , Qiang Zhang

Machine learning models often rely on simple spurious features -- patterns in training data that correlate with targets but are not causally related to them, like image backgrounds in foreground classification. This reliance typically leads…

Machine Learning · Computer Science 2025-06-06 Chenyu You , Haocheng Dai , Yifei Min , Jasjeet S. Sekhon , Sarang Joshi , James S. Duncan