English
Related papers

Related papers: Testing Generalizability in Causal Inference

200 papers

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Causal inference requires evaluating models on balanced distributions between treatment and control groups, while training data often exhibits imbalance due to historical decision-making policies. Most conventional statistical methods…

Machine Learning · Statistics 2025-11-21 Akira Tanimoto

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

The NLP community typically relies on performance of a model on a held-out test set to assess generalization. Performance drops observed in datasets outside of official test sets are generally attributed to "out-of-distribution" effects.…

Computation and Language · Computer Science 2024-04-03 Aparna Elangovan , Jiayuan He , Yuan Li , Karin Verspoor

Analysts often make visual causal inferences about possible data-generating models. However, visual analytics (VA) software tends to leave these models implicit in the mind of the analyst, which casts doubt on the statistical validity of…

Human-Computer Interaction · Computer Science 2021-07-29 Alex Kale , Yifan Wu , Jessica Hullman

Many spatial phenomena exhibit treatment interference where treatments at one location may affect the response at other locations. Because interference violates the stable unit treatment value assumption, standard methods for causal…

Methodology · Statistics 2020-07-02 Andrew Giffin , Brian Reich , Shu Yang , Ana Rappold

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

We discuss recent work for causal inference and predictive robustness in a unifying way. The key idea relies on a notion of probabilistic invariance or stability: it opens up new insights for formulating causality as a certain risk…

Methodology · Statistics 2018-12-21 Peter Bühlmann

As the frontiers of applied statistics progress through increasingly complex experiments we must exploit increasingly sophisticated inferential models to analyze the observations we make. In order to avoid misleading or outright erroneous…

Methodology · Statistics 2018-03-23 Michael Betancourt

Most supervised machine learning tasks are subject to irreducible prediction errors. Probabilistic predictive models address this limitation by providing probability distributions that represent a belief over plausible targets, rather than…

Machine Learning · Statistics 2022-10-25 David Widmann , Fredrik Lindsten , Dave Zachariah

The promise that causal modelling can lead to robust AI generalization has been challenged in recent work on domain generalization (DG) benchmarks. We revisit the claims of the causality and DG literature, reconciling apparent…

There has been widespread use of causal inference methods for the rigorous analysis of observational studies and to identify policy evaluations. In this article, we consider a class of generalized coarsened procedures for confounding. At a…

Methodology · Statistics 2025-07-04 Debashis Ghosh , Lei Wang

Classical machine learning techniques often struggle with overfitting and unreliable predictions when exposed to novel conditions. Introducing causality into the modelling process offers a promising way to mitigate these challenges by…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 David Zapata Gonzalez , Marcel Meyer , Oliver Mueller

Causal inference is a central goal across many scientific disciplines. Over the past several decades, three major frameworks have emerged to formalize causal questions and guide their analysis: the potential outcomes framework, structural…

Statistics Theory · Mathematics 2026-02-12 Linbo Wang , Thomas Richardson , James Robins

In causal inference, generalization capability refers to the ability to conduct causal inference methods on new data to estimate the causal-effect between unknown phenomenon, which is crucial for expanding the boundaries of knowledge.…

Computation and Language · Computer Science 2024-10-16 Chen Wang , Dongming Zhao , Bo Wang , Ruifang He , Yuexian Hou

We introduce Matched Machine Learning, a framework that combines the flexibility of machine learning black boxes with the interpretability of matching, a longstanding tool in observational causal inference. Interpretability is paramount in…

Methodology · Statistics 2023-04-05 Marco Morucci , Cynthia Rudin , Alexander Volfovsky

Causal inference is a vital aspect of multiple scientific disciplines and is routinely applied to high-impact applications such as medicine. However, evaluating the performance of causal inference methods in real-world environments is…

Machine Learning · Computer Science 2023-07-04 Mathieu Chevalley , Yusuf Roohani , Arash Mehrjou , Jure Leskovec , Patrick Schwab

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

We introduce computational causal inference as an interdisciplinary field across causal inference, algorithms design and numerical computing. The field aims to develop software specializing in causal inference that can analyze massive…

Computation · Statistics 2020-07-22 Jeffrey C. Wong

A vast amount of expert and domain knowledge is captured by causal structural priors, yet there has been little research on testing such priors for generalization and data synthesis purposes. We propose a novel model architecture, Causal…

Machine Learning · Computer Science 2022-11-08 Jeffrey Jiang , Omead Pooladzandi , Sunay Bhat , Gregory Pottie