English
Related papers

Related papers: Using permutations to detect, quantify and correct…

200 papers

The proliferation of healthcare data has brought the opportunities of applying data-driven approaches, such as machine learning methods, to assist diagnosis. Recently, many deep learning methods have been shown with impressive successes in…

Machine Learning · Statistics 2018-09-03 Haohan Wang , Zhenglin Wu , Eric P. Xing

Unobserved confounding arises when an unmeasured feature influences both the treatment and the outcome, leading to biased causal effect estimates. This issue undermines observational studies in fields like economics, medicine, ecology or…

Machine Learning · Computer Science 2025-09-09 Alexander Merkov , David Rohde , Alexandre Gilotte , Benjamin Heymann

Unmeasured confounding is a major challenge for identifying causal relationships from non-experimental data. Here, we propose a method that can accommodate unmeasured discrete confounding. Extending recent identifiability results in deep…

Machine Learning · Computer Science 2024-08-13 Patrick Burauel , Frederick Eberhardt , Michel Besserve

We study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Since the long-term outcome is observed only after a long delay, it is not measured in the experimental…

Methodology · Statistics 2024-09-04 Guido Imbens , Nathan Kallus , Xiaojie Mao , Yuhao Wang

In real-world studies, the collected confounders may suffer from measurement error. Although mismeasurement of confounders is typically unintentional -- originating from sources such as human oversight or imprecise machinery -- deliberate…

Methodology · Statistics 2024-09-20 Jeffrey Zhang , Junu Lee

The fundamental problem in treatment effect estimation from observational data is confounder identification and balancing. Most of the previous methods realized confounder balancing by treating all observed pre-treatment variables as…

Methodology · Statistics 2021-10-13 Anpeng Wu , Kun Kuang , Junkun Yuan , Bo Li , Runze Wu , Qiang Zhu , Yueting Zhuang , Fei Wu

Data-driven decision making frequently relies on predicting counterfactual outcomes. In practice, researchers commonly train counterfactual prediction models on a source dataset to inform decisions on a possibly separate target population.…

Machine Learning · Statistics 2026-04-07 Keith Barnatchez , Kevin P. Josey , Rachel C. Nethery , Giovanni Parmigiani

Causal inference from observational data often assumes "ignorability," that all confounders are observed. This assumption is standard yet untestable. However, many scientific studies involve multiple causes, different variables whose…

Machine Learning · Statistics 2019-04-16 Yixin Wang , David M. Blei

Confounding seriously impairs our ability to learn about causal relations from observational data. Confounding can be defined as a statistical association between two variables due to inputs from a common source (the confounder). For…

Methodology · Statistics 2018-05-17 Anders Ledberg

In the era of fast-paced precision medicine, observational studies play a major role in properly evaluating new treatments in clinical practice. Yet, unobserved confounding can significantly compromise causal conclusions drawn from…

Machine Learning · Statistics 2026-03-20 Piersilvio De Bartolomeis , Javier Abad , Konstantin Donhauser , Fanny Yang

Many major works in social science employ matching to make causal conclusions, but different matches on the same data may produce different treatment effect estimates, even when they achieve similar balance or minimize the same loss…

Applications · Statistics 2023-03-23 Marco Morucci , Cynthia Rudin

Standard methods in preference learning involve estimating the parameters of discrete choice models from data of selections (choices) made by individuals from a discrete set of alternatives (the choice set). While there are many models for…

Machine Learning · Computer Science 2021-08-18 Kiran Tomlinson , Johan Ugander , Austin R. Benson

No unmeasured confounding is often assumed in estimating treatment effects in observational data when using approaches such as propensity scores and inverse probability weighting. However, in many such studies due to the limitation of the…

Applications · Statistics 2019-08-06 Rong Huang , Ronghui Xu , Parambir S. Dulai

Restricting randomization in the design of experiments (e.g., using blocking/stratification, pair-wise matching, or rerandomization) can improve the treatment-control balance on important covariates and therefore improve the estimation of…

Econometrics · Economics 2020-11-02 Brian Quistorff , Gentry Johnson

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

Unmeasured confounding presents a common challenge in observational studies, potentially making standard causal parameters unidentifiable without additional assumptions. Given the increasing availability of diverse data sources, exploiting…

Methodology · Statistics 2023-09-18 Shanshan Luo , Yechi Zhang , Wei Li

The treatment effects of medications play a key role in guiding medical prescriptions. They are usually assessed with randomized controlled trials (RCTs), which are expensive. Recently, large-scale electronic health records (EHRs) have…

Machine Learning · Statistics 2019-08-20 Linying Zhang , Yixin Wang , Anna Ostropolets , Jami J. Mulgrave , David M. Blei , George Hripcsak

Convergence bounds are one of the main tools to obtain information on the performance of a distributed machine learning task, before running the task itself. In this work, we perform a set of experiments to assess to which extent, and in…

Networking and Internet Architecture · Computer Science 2022-12-06 Francesco Malandrino , Carla Fabiana Chiasserini

Balancing influential covariates is crucial for valid treatment comparisons in clinical studies. While covariate-adaptive randomization is commonly used to achieve balance, its performance can be inadequate when the number of baseline…

Methodology · Statistics 2024-12-30 Ziqing Guo , Yang Liu , Lucy Xia

Whereas confidence intervals are used to assess uncertainty due to unmeasured individuals, confounding intervals can be used to assess uncertainty due to unmeasured attributes. Previously, we have introduced a methodology for computing…

Methodology · Statistics 2025-08-13 Brian Knaeble , R Mitchell Hughes