English
Related papers

Related papers: Identifying Spurious Correlations using Counterfac…

200 papers

Computer vision datasets frequently contain spurious correlations between task-relevant labels and (easy to learn) latent task-irrelevant attributes (e.g. context). Models trained on such datasets learn "shortcuts" and underperform on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Sriram Yenamandra , Pratik Ramesh , Viraj Prabhu , Judy Hoffman

Machine learning models that automate decision-making are increasingly used in consequential areas such as loan approvals, pretrial bail approval, and hiring. Unfortunately, most of these models are black boxes, i.e., they are unable to…

Artificial Intelligence · Computer Science 2024-05-28 Sopam Dasgupta , Joaquín Arias , Elmer Salazar , Gopal Gupta

Deep neural networks often exploit *spurious* features that are present in the majority of examples within a class during training. This leads to *poor worst-group test accuracy*, i.e., poor accuracy for minority groups that lack these…

Machine Learning · Computer Science 2025-04-18 Siddharth Joshi , Yu Yang , Yihao Xue , Wenhan Yang , Baharan Mirzasoleiman

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

Machine Learning · Computer Science 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful…

Machine Learning · Computer Science 2024-03-22 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Learning representations unaffected by superficial characteristics is important to ensure that shifts in these characteristics at test time do not compromise downstream prediction performance. For instance, in healthcare applications, we…

Machine Learning · Computer Science 2025-07-28 Minghui Sun , Benjamin A. Goldstein , Matthew M. Engelhard

Despite large-scale pre-trained language models have achieved striking results for text classificaion, recent work has raised concerns about the challenge of shortcut learning. In general, a keyword is regarded as a shortcut if it creates a…

Computation and Language · Computer Science 2023-07-06 Rui Song , Fausto Giunchiglia , Yingji Li , Hao Xu

We present a simple but effective method to measure and mitigate model biases caused by reliance on spurious cues. Instead of requiring costly changes to one's data or model training, our method better utilizes the data one already has by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Mazda Moayeri , Wenxiao Wang , Sahil Singla , Soheil Feizi

Language models (LMs) have achieved notable success in numerous NLP tasks, employing both fine-tuning and in-context learning (ICL) methods. While language models demonstrate exceptional performance, they face robustness challenges due to…

Computation and Language · Computer Science 2024-06-18 Yuhang Zhou , Paiheng Xu , Xiaoyu Liu , Bang An , Wei Ai , Furong Huang

We introduce canonical correlation forests (CCFs), a new decision tree ensemble method for classification and regression. Individual canonical correlation trees are binary decision trees with hyperplane splits based on local canonical…

Machine Learning · Statistics 2017-08-10 Tom Rainforth , Frank Wood

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

To enhance group robustness to spurious correlations, prior work often relies on auxiliary group annotations and assumes identical sets of groups across training and test domains. To overcome these limitations, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chenruo Liu , Hongjun Liu , Zeyu Lai , Yiqiu Shen , Chen Zhao , Qi Lei

To construct interpretable explanations that are consistent with the original ML model, counterfactual examples---showing how the model's output changes with small perturbations to the input---have been proposed. This paper extends the work…

Machine Learning · Computer Science 2020-06-16 Divyat Mahajan , Chenhao Tan , Amit Sharma

For visual tracking, an ideal filter learned by the correlation filter (CF) method should take both discrimination and reliability information. However, existing attempts usually focus on the former one while pay less attention to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Chong Sun , Dong Wang , Huchuan Lu , Ming-Hsuan Yang

Most multi-view clustering methods are limited by shallow models without sound nonlinear information perception capability, or fail to effectively exploit complementary information hidden in different views. To tackle these issues, we…

Machine Learning · Computer Science 2022-10-14 Fu Lele , Zhang Lei , Yang Jinghua , Chen Chuan , Zhang Chuanfu , Zheng Zibin

The use of machine learning models in high-stake applications (e.g., healthcare, lending, college admission) has raised growing concerns due to potential biases against protected social groups. Various fairness notions and methods have been…

Machine Learning · Computer Science 2023-11-10 Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

In Artificial Intelligence, interpreting the results of a Machine Learning technique often termed as a black box is a difficult task. A counterfactual explanation of a particular "black box" attempts to find the smallest change to the input…

Risk Management · Quantitative Finance 2021-07-23 Dan Wang , Zhi Chen , Ionut Florescu

Evaluating machine learning (ML) model bias is key to building trustworthy and robust ML systems. Counterfactual Fairness (CF) audits allow the measurement of bias of ML models with a causal framework, yet their conclusions rely on a single…

Machine Learning · Computer Science 2026-01-07 Davi Valério , Chrysoula Zerva , Mariana Pinto , Ricardo Santos , André Carreiro