English
Related papers

Related papers: Identifying Spurious Correlations and Correcting t…

200 papers

Deep neural networks often exploit *spurious* features that are present in the majority of examples within a class during training. This leads to *poor worst-group test accuracy*, i.e., poor accuracy for minority groups that lack these…

Machine Learning · Computer Science 2025-04-18 Siddharth Joshi , Yu Yang , Yihao Xue , Wenhan Yang , Baharan Mirzasoleiman

In this paper, we study a simple and generic framework to tackle the problem of learning model parameters when a fraction of the training samples are corrupted. We first make a simple observation: in a variety of such settings, the…

Machine Learning · Computer Science 2019-02-20 Yanyao Shen , Sujay Sanghavi

To construct models of large, multivariate complex systems, such as those in biology, one needs to constrain which variables are allowed to interact. This can be viewed as detecting "local" structures among the variables. In the context of…

Data Analysis, Statistics and Probability · Physics 2023-10-19 Mahajabin Rahman , Ilya Nemenman

The ability to predict future events or patterns based on previous experience is crucial for many applications such as traffic control, weather forecasting, or supply chain management. While modern supervised Machine Learning approaches…

Neurons and Cognition · Quantitative Biology 2024-10-16 Florian Feiler , Emre Neftci , Younes Bouhadjar

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

Deep neural networks trained with Empirical Risk Minimization (ERM) perform well when both training and test data come from the same domain, but they often fail to generalize to out-of-distribution samples. In image classification, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Aryan Yazdan Parast , Basim Azam , Naveed Akhtar

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro

Although much progress has been made towards robust deep learning, a significant gap in robustness remains between real-world perturbations and more narrowly defined sets typically studied in adversarial defenses. In this paper, we aim to…

Machine Learning · Computer Science 2020-10-09 Eric Wong , J. Zico Kolter

In prediction tasks, there exist features that are related to the label in the same way across different settings for that task; these are semantic features or semantics. Features with varying relationships to the label are nuisances. For…

Machine Learning · Computer Science 2024-07-04 Aahlad Puli , Nitish Joshi , Yoav Wald , He He , Rajesh Ranganath

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

Spuriousness arises when there is an association between two or more variables in a dataset that are not causally related. In this work, we propose an explainability framework to preemptively disentangle the nature of such spurious…

Machine Learning · Computer Science 2025-11-17 Barproda Halder , Faisal Hamman , Pasan Dissanayake , Qiuyi Zhang , Ilia Sucholutsky , Sanghamitra Dutta

We consider one of the most basic multiple testing problems that compares expectations of multivariate data among several groups. As a test statistic, a conventional (approximate) $t$-statistic is considered, and we determine its rejection…

Methodology · Statistics 2016-12-20 Yoshiyuki Ninomiya , Satoshi Kuriki , Toshihiko Shiroishi , Toyoyuki Takada

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Models trained with empirical risk minimization (ERM) are known to learn to rely on spurious features, i.e., their prediction is based on undesired auxiliary features which are strongly correlated with class labels but lack causal…

Machine Learning · Computer Science 2024-01-11 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

Pose Machines provide a sequential prediction framework for learning rich implicit spatial models. In this work we show a systematic design for how convolutional networks can be incorporated into the pose machine framework for learning…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Shih-En Wei , Varun Ramakrishna , Takeo Kanade , Yaser Sheikh

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

Machine Learning · Computer Science 2024-12-02 Yanzhe Bekkemoen , Helge Langseth

The interpretation of defect models heavily relies on software metrics that are used to construct them. However, such software metrics are often correlated to defect models. Prior work often uses feature selection techniques to remove…

Software Engineering · Computer Science 2018-06-27 Jirayus Jiarpakdee , Chakkrit Tantithamthavorn , Christoph Treude

While machine learning approaches to image restoration offer great promise, current methods risk training models fixated on performing well only for image corruption of a particular level of difficulty---such as a certain level of noise or…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Ruohan Gao , Kristen Grauman

Deep learning has revolutionized the field of artificial intelligence. Based on the statistical correlations uncovered by deep learning-based methods, computer vision has contributed to tremendous growth in areas like autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Kexuan Zhang , Qiyu Sun , Chaoqiang Zhao , Yang Tang