English
Related papers

Related papers: The Hardness of Validating Observational Studies w…

200 papers

Randomized trials are considered the gold standard for making informed decisions in medicine, yet they often lack generalizability to the patient populations in clinical practice. Observational studies, on the other hand, cover a broader…

Methodology · Statistics 2026-04-14 Piersilvio De Bartolomeis , Javier Abad , Konstantin Donhauser , Fanny Yang

Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current…

Machine Learning · Computer Science 2024-06-18 Yuxuan Wang , Mingzhou Liu , Xinwei Sun , Wei Wang , Yizhou Wang

We consider the problem of assessing whether, in an individual case, there is a causal relationship between an observed exposure and a response variable. When data are available on similar individuals we may be able to estimate prospective…

Statistics Theory · Mathematics 2023-11-15 Monica Musio , Philip Dawid

Experimental and observational studies often lack validity due to untestable assumptions. We propose a double machine learning approach to combine experimental and observational studies, allowing practitioners to test for assumption…

A growing body of literature attempts to learn about contagion using observational (i.e. non-experimental) data collected from a single social network. While the conclusions of these studies may be correct, the methods rely on assumptions…

Applications · Statistics 2017-06-30 Elizabeth L. Ogburn

A major challenge in estimating treatment effects in observational studies is the reliance on untestable conditions such as the assumption of no unmeasured confounding. In this work, we propose an algorithm that can falsify the assumption…

Methodology · Statistics 2025-06-03 Rickard K. A. Karlsson , Jesse H. Krijthe

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

At the heart of causal structure learning from observational data lies a deceivingly simple question: given two statistically dependent random variables, which one has a causal effect on the other? This is impossible to answer using…

Machine Learning · Computer Science 2020-10-13 Nikolaos Nikolaou , Konstantinos Sechidis

This study demonstrates the existence of a testable condition for the identification of the causal effect of a treatment on an outcome in observational data, which relies on two sets of variables: observed covariates to be controlled for…

Econometrics · Economics 2026-05-20 Martin Huber , Jannis Kueck

Data can be collected in scientific studies via a controlled experiment or passive observation. Big data is often collected in a passive way, e.g. from social media. In studies of causation great efforts are made to guard against bias and…

Methodology · Statistics 2018-11-21 Elena Pesce , Eva Riccomagno , Henry P. Wynn

Researchers increasingly have access to two types of data: (i) large observational datasets where treatment (e.g., class size) is not randomized but several primary outcomes (e.g., graduation rates) and secondary outcomes (e.g., test…

Methodology · Statistics 2025-05-29 Susan Athey , Raj Chetty , Guido Imbens

To draw scientifically meaningful conclusions and build reliable models of quantitative phenomena, cause and effect must be taken into consideration (either implicitly or explicitly). This is particularly challenging when the measurements…

Machine Learning · Computer Science 2020-12-11 Max A. Little , Reham Badawy

Selection bias, arising from the systematic inclusion or exclusion of certain samples, poses a significant challenge to the validity of causal inference. While Bareinboim et al. introduced methods for recovering unbiased observational and…

Methodology · Statistics 2025-06-05 Jingyang He , Shuai Wang , Ang Li

A common assumption in causal inference from observational data is that there is no hidden confounding. Yet it is, in general, impossible to verify this assumption from a single dataset. Under the assumption of independent causal mechanisms…

Methodology · Statistics 2023-11-07 Rickard K. A. Karlsson , Jesse H. Krijthe

The health effects of environmental exposures have been studied for decades, typically using standard regression models to assess exposure-outcome associations found in observational non-experimental data. We propose and illustrate a…

Applications · Statistics 2017-09-20 Marie-Abele C. Bind , Donald B. Rubin

A data science task can be deemed as making sense of the data or testing a hypothesis about it. The conclusions inferred from data can greatly guide us to make informative decisions. Big data has enabled us to carry out countless prediction…

Machine Learning · Computer Science 2022-01-12 Wenhao Zhang , Ramin Ramezani , Arash Naeim

Time plays a fundamental role in causal analyses, where the goal is to quantify the effect of a specific treatment on future outcomes. In a randomized experiment, times of treatment, and when outcomes are observed, are typically well…

Methodology · Statistics 2016-01-19 Guillaume W. Basse , Alexander Volfovsky , Edoardo M. Airoldi

In prior work we have introduced an asymptotic threshold of sufficient randomness for causal inference from observational data. In this paper we extend that prior work in three main ways. First, we show how to empirically estimate a lower…

Methodology · Statistics 2023-09-07 Brian Knaeble , Braxton Osting , Placede Tshiaba

Data from observational studies (OSs) is widely available and readily obtainable yet frequently contains confounding biases. On the other hand, data derived from randomized controlled trials (RCTs) helps to reduce these biases; however, it…

Methodology · Statistics 2024-10-30 Dong Yao , Caizhi Tang , Qing Cui , Longfei Li

From scientific experiments to online A/B testing, the previously observed data often affects how future experiments are performed, which in turn affects which data will be collected. Such adaptivity introduces complex correlations between…

Machine Learning · Statistics 2018-01-03 Xinkun Nie , Xiaoying Tian , Jonathan Taylor , James Zou