English
Related papers

Related papers: Learning the Difference that Makes a Difference wi…

200 papers

Counterfactual explanations are widely used to interpret machine learning predictions by identifying minimal changes to input features that would alter a model's decision. However, most existing counterfactual methods have not been tested…

Machine Learning · Computer Science 2026-02-03 Leonidas Christodoulou , Chang Sun

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

Deep neural networks have been shown to learn and rely on spurious correlations present in the data that they are trained on. Reliance on such correlations can cause these networks to malfunction when deployed in the real world, where these…

Machine Learning · Computer Science 2025-05-20 Varun Mulchandani , Jung-Eun Kim

Deep learning models can perform well in complex medical imaging classification tasks, even when basing their conclusions on spurious correlations (i.e. confounders), should they be prevalent in the training dataset, rather than on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Amar Kumar , Nima Fathi , Raghav Mehta , Brennan Nichyporuk , Jean-Pierre R. Falet , Sotirios Tsaftaris , Tal Arbel

Current pre-trained language models have enabled remarkable improvements in downstream tasks, but it remains difficult to distinguish effects of statistical correlation from more systematic logical reasoning grounded on the understanding of…

Computation and Language · Computer Science 2023-05-29 Jiaxuan Li , Lang Yu , Allyson Ettinger

Linear residualization is a common practice for confounding adjustment in machine learning (ML) applications. Recently, causality-aware predictive modeling has been proposed as an alternative causality-inspired approach for adjusting for…

Machine Learning · Statistics 2020-11-10 Elias Chaibub Neto

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

Machine Learning · Computer Science 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

Machine Learning · Computer Science 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

Counterfactual data augmentation has recently emerged as a method to mitigate confounding biases in the training data. These biases, such as spurious correlations, arise due to various observed and unobserved confounding variables in the…

Machine Learning · Computer Science 2023-11-22 Abbavaram Gowtham Reddy , Saketh Bachu , Saloni Dash , Charchit Sharma , Amit Sharma , Vineeth N Balasubramanian

Researchers recently found out that sometimes language models achieve high accuracy on benchmark data set, but they can not generalize very well with even little changes to the original data set. This is sometimes due to data artifacts,…

Computation and Language · Computer Science 2024-01-26 Han Chen

Neural image classifiers can often learn to make predictions by overly relying on non-predictive features that are spuriously correlated with the class labels in the training data. This leads to poor performance in real-world atypical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Sakshi Singh , Sanjoy Chowdhury , Dinesh Manocha

In attempts to produce ML models less reliant on spurious patterns in NLP datasets, researchers have recently proposed curating counterfactually augmented data (CAD) via a human-in-the-loop process in which given some documents and their…

Computation and Language · Computer Science 2021-03-25 Divyansh Kaushik , Amrith Setlur , Eduard Hovy , Zachary C. Lipton

Natural language is compositional; the meaning of a sentence is a function of the meaning of its parts. This property allows humans to create and interpret novel sentences, generalizing robustly outside their prior experience. Neural…

Computation and Language · Computer Science 2021-06-30 Henry Conklin , Bailin Wang , Kenny Smith , Ivan Titov

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

Computation and Language · Computer Science 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang

To address the problem of NLP classifiers learning spurious correlations between training features and target labels, a common approach is to make the model's predictions invariant to these features. However, this can be counter-productive…

Machine Learning · Computer Science 2023-06-22 Parikshit Bansal , Amit Sharma

Counterfactual explanations for machine learning models are used to find minimal interventions to the feature values such that the model changes the prediction to a different output or a target output. A valid counterfactual explanation…

Machine Learning · Computer Science 2023-03-23 Shravan Kumar Sajja , Sumanta Mukherjee , Satyam Dwivedi

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage them for predictions,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Target-oriented multimodal sentiment classification seeks to predict sentiment polarity for specific targets from image-text pairs. While existing works achieve competitive performance, they often over-rely on textual content and fail to…

Computation and Language · Computer Science 2025-09-12 Zhiyue Liu , Fanrong Ma , Xin Ling

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu