English
Related papers

Related papers: For objective causal inference, design trumps anal…

200 papers

Confounding is a significant obstacle to unbiased estimation of causal effects from observational data. For settings with high-dimensional covariates -- such as text data, genomics, or the behavioral social sciences -- researchers have…

Artificial Intelligence · Computer Science 2024-02-01 Katherine A. Keith , Sergey Feldman , David Jurgens , Jonathan Bragg , Rohit Bhattacharya

Online platforms regularly conduct randomized experiments to understand how changes to the platform causally affect various outcomes of interest. However, experimentation on online platforms has been criticized for having, among other…

Machine Learning · Computer Science 2022-05-12 Smitha Milli , Luca Belli , Moritz Hardt

Identifying causal effects is a key problem of interest across many disciplines. The two long-standing approaches to estimate causal effects are observational and experimental (randomized) studies. Observational studies can suffer from…

Machine Learning · Computer Science 2024-07-09 Sepehr Elahi , Sina Akbari , Jalal Etesami , Negar Kiyavash , Patrick Thiran

Causal inference is at the heart of empirical research in natural and social sciences and is critical for scientific discovery and informed decision making. The gold standard in causal inference is performing randomized controlled trials;…

Databases · Computer Science 2020-04-09 Babak Salimi , Harsh Parikh , Moe Kayali , Sudeepa Roy , Lise Getoor , Dan Suciu

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

Randomised controlled trials (RCTs) are the most effective approach to causal discovery, but in many circumstances it is impossible to conduct RCTs. Therefore observational studies based on passively observed data are widely accepted as an…

Artificial Intelligence · Computer Science 2016-11-11 Jiuyong Li , Thuc Duy Le , Lin Liu , Jixue Liu , Zhou Jin , Bingyu Sun , Saisai Ma

A key issue for all observational causal inference is that it relies on an unverifiable assumption - that observed characteristics are sufficient to proxy for treatment confounding. In this paper we argue that in medical cases these…

Applications · Statistics 2023-03-14 Alexander Peysakhovich , Yin Aphinyanaphongs

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

The goal of a well-controlled study is to remove unwanted variation when estimating the causal effect of the intervention of interest. Experiments conducted in the basic sciences frequently achieve this goal using experimental controls,…

Methodology · Statistics 2021-04-22 Kristen B. Hunter , Kristen Koenig , Marie-Abèle Bind

Typically, a randomized experiment is designed to test a hypothesis about the average treatment effect and sometimes hypotheses about treatment effect variation. The results of such a study may then be used to inform policy and practice for…

Methodology · Statistics 2026-05-01 Elizabeth Tipton , Michalis Mamakos

A growing number of researchers are conducting randomized experiments to analyze causal relationships in network settings where units influence one another. A dominant methodology for analyzing these experiments is design-based, leveraging…

Methodology · Statistics 2024-07-30 Ambarish Chattopadhyay , Kosuke Imai , Jose R. Zubizarreta

The injunction to `analyze the way you randomize' is well-known to statisticians since Fisher advocated for randomization as the basis of inference. Yet even those convinced by the merits of randomization-based inference seldom follow this…

Methodology · Statistics 2021-12-16 Nicole E. Pashley , Guillaume W. Basse , Luke W. Miratrix

Testing hypotheses is an issue of primary importance in the scientific research, as well as in many other human activities. Much clarification about it can be achieved if the process of learning from data is framed in a stochastic model of…

Data Analysis, Statistics and Probability · Physics 2007-05-23 G. D'Agostini

Modern science increasingly relies on ever-growing observational datasets and automated inference pipelines, under the implicit belief that accumulating more data makes scientific conclusions more reliable. Here we show that this belief can…

Machine Learning · Computer Science 2026-02-06 Zhipeng Zhang , Kai Li

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding -- when…

Econometrics · Economics 2025-11-07 Ashesh Rambachan , Amanda Coston , Edward Kennedy

Randomized experiments have long been the gold standard for scientists seeking to learn about cause and effect. When randomized experiments are infeasible, scientists often resort to observational studies, which are widely available and…

Methodology · Statistics 2026-04-13 Bohan Wu , Sebastian Salazar , Donald P. Green , David M. Blei

Bipartite experiments arise in various fields, in which the treatments are randomized over one set of units, while the outcomes are measured over another separate set of units. However, existing methods often rely on strong model…

Methodology · Statistics 2025-04-16 Sizhu Lu , Lei Shi , Yue Fang , Wenxin Zhang , Peng Ding

There is a movement in design of experiments away from the classic randomization put forward by Fisher, Cochran and others to one based on optimization. In fixed-sample trials comparing two groups, measurements of subjects are known in…

Methodology · Statistics 2018-10-22 Adam Kapelner , Abba M. Krieger , Uri Shalit , David Azriel

Matching and weighting methods for observational studies involve the choice of an estimand, the causal effect with reference to a specific target population. Commonly used estimands include the average treatment effect in the treated (ATT),…

Methodology · Statistics 2023-07-12 Noah Greifer , Elizabeth A. Stuart

Consider a researcher estimating the parameters of a regression function based on data for all 50 states in the United States or on data for all visits to a website. What is the interpretation of the estimated parameters and the standard…

Statistics Theory · Mathematics 2019-06-25 Alberto Abadie , Susan Athey , Guido W. Imbens , Jeffrey M. Wooldridge