English
Related papers

Related papers: Spurious Correlation-Aware Embedding Regularizatio…

200 papers

Spurious correlations are everywhere. While humans often do not perceive them, neural networks are notorious for learning unwanted associations, also known as biases, instead of the underlying decision rule. As a result, practitioners are…

Machine Learning · Computer Science 2023-06-01 Moritz Vandenhirtz , Laura Manduchi , Ričards Marcinkevičs , Julia E. Vogt

Image restoration under diverse degradations remains challenging for unified all-in-one frameworks due to feature interference and insufficient expert specialization. We propose SLER-IR, a spherical layer-wise expert routing framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Peng Shurui , Xin Lin , Shi Luo , Jincen Ou , Dizhe Zhang , Lu Qi , Truong Nguyen , Chao Ren

While deep neural networks can achieve state-of-the-art performance in many tasks, these models are more fragile than they appear. They are prone to learning spurious correlations in their training data, leading to surprising failure cases.…

Machine Learning · Computer Science 2024-09-05 Jeff Mitchell , Jesús Martínez del Rincón , Niall McLaughlin

Face anti-spoofing (FAS) plays a crucial role in securing face recognition systems. Empirically, given an image, a model with more consistent output on different views of this image usually performs better, as shown in Fig.1. Motivated by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zezheng Wang , Zitong Yu , Xun Wang , Yunxiao Qin , Jiahong Li , Chenxu Zhao , Zhen Lei , Xin Liu , Size Li , Zhongyuan Wang

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

Computation and Language · Computer Science 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang

Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global distribution alignment without considering class information across domains. The neglect of class information, however, may lead to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Chao Chen , Zhihang Fu , Zhihong Chen , Zhaowei Cheng , Xinyu Jin , Xian-Sheng Hua

Among the most critical limitations of deep learning NLP models are their lack of interpretability, and their reliance on spurious correlations. Prior work proposed various approaches to interpreting the black-box models to unveil the…

Computation and Language · Computer Science 2021-10-08 Xiaochuang Han , Yulia Tsvetkov

Spurious correlations occur when a model learns unreliable features from the data and are a well-known drawback of data-driven learning. Although there are several algorithms proposed to mitigate it, we are yet to jointly derive the…

Machine Learning · Computer Science 2023-08-23 Gautam Sreekumar , Vishnu Naresh Boddeti

The Evidential Regression Network (ERN) represents a novel approach that integrates deep learning with Dempster-Shafer's theory to predict a target and quantify the associated uncertainty. Guided by the underlying theory, specific…

Machine Learning · Computer Science 2024-01-04 Kai Ye , Tiejin Chen , Hua Wei , Liang Zhan

Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature…

Machine Learning · Computer Science 2023-10-31 Christos Tsirigotis , Joao Monteiro , Pau Rodriguez , David Vazquez , Aaron Courville

We study zero-shot learning (ZSL) as a transfer learning problem, and focus on the two key aspects of ZSL, model effectiveness and model adaptation. For effective modeling, we adopt the boosting strategy to learn a zero-shot classifier from…

Machine Learning · Computer Science 2017-07-26 Te Pi , Xi Li , Zhongfei , Zhang

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

In many classification datasets, the task labels are spuriously correlated with some input attributes. Classifiers trained on such datasets often rely on these attributes for prediction, especially when the spurious correlation is high, and…

Machine Learning · Computer Science 2023-12-11 Abhinav Kumar , Amit Deshpande , Amit Sharma

Miscalibration in deep learning refers to there is a discrepancy between the predicted confidence and performance. This problem usually arises due to the overfitting problem, which is characterized by learning everything presented in the…

Machine Learning · Computer Science 2024-07-16 Zongbo Han , Yifeng Yang , Changqing Zhang , Linjun Zhang , Joey Tianyi Zhou , Qinghua Hu

Deep neural networks trained with Empirical Risk Minimization (ERM) perform well when both training and test data come from the same domain, but they often fail to generalize to out-of-distribution samples. In image classification, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Aryan Yazdan Parast , Basim Azam , Naveed Akhtar

Change detection is a key task in Earth observation applications. Recently, deep learning methods have demonstrated strong performance and widespread application. However, change detection faces data scarcity due to the labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Ziyu Zhou , Keyan Hu , Yutian Fang , Xiaoping Rui

In deep neural nets, lower level embedding layers account for a large portion of the total number of parameters. Tikhonov regularization, graph-based regularization, and hard parameter sharing are approaches that introduce explicit biases…

Machine Learning · Computer Science 2020-10-06 Liwei Wu , Shuqing Li , Cho-Jui Hsieh , James Sharpnack

Clustering single-cell RNA sequence (scRNA-seq) data poses statistical and computational challenges due to their high-dimensionality and data-sparsity, also known as `dropout' events. Recently, Regularized Auto-Encoder (RAE) based deep…

Machine Learning · Computer Science 2021-07-19 Arnab Kumar Mondal , Himanshu Asnani , Parag Singla , Prathosh AP

Deep neural networks can be unreliable in the real world especially when they heavily use {\it spurious} features for their predictions. Focusing on image classifications, we define {\it core features} as the set of visual features that are…

Machine Learning · Computer Science 2022-03-29 Sahil Singla , Soheil Feizi

Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real-world deployments. While much research attention has been placed on designing new out-of-distribution…

Machine Learning · Computer Science 2022-03-08 Yifei Ming , Hang Yin , Yixuan Li