English
Related papers

Related papers: Predicting Counterfactuals from Large Historical D…

200 papers

Randomized experiments have become a cornerstone of evidence-based decision-making in contexts ranging from online platforms to public health. However, in experimental settings with network interference, a unit's treatment can influence…

Machine Learning · Computer Science 2025-10-22 Sadegh Shirani , Yuwei Luo , William Overman , Ruoxuan Xiong , Mohsen Bayati

Increasing the success rate of a process, i.e. the percentage of cases that end in a positive outcome, is a recurrent process improvement goal. At runtime, there are often certain actions (a.k.a. treatments) that workers may execute to lift…

Machine Learning · Computer Science 2023-03-08 Zahra Dasht Bozorgi , Marlon Dumas , Marcello La Rosa , Artem Polyvyanyy , Mahmoud Shoush , Irene Teinemaa

Many applications of causal inference require using treatment effects estimated on a study population to make decisions in a separate target population. We consider the challenging setting where there are covariates that are observed in the…

Machine Learning · Computer Science 2024-10-22 Khurram Yamin , Vibhhu Sharma , Ed Kennedy , Bryan Wilder

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

Researchers are often interested in treatment effects on outcomes that are only defined conditional on a post-treatment event status. For example, in a study of the effect of different cancer treatments on quality of life at end of…

Matching is a widely used causal inference design that aims to approximate a randomized experiment using observational data by forming matched sets of treated and control units based on similarities in their covariates. Ideally, treated…

Methodology · Statistics 2026-04-06 Jianan Zhu , Jeffrey Zhang , Zijian Guo , Siyu Heng

Pragmatic trials increasingly define outcomes using real-world data such as electronic health records, where assessments are collected during routine care rather than at fixed timepoints. Consequently, these uncontrolled assessments may be…

Recently, there has been great interest in estimating the conditional average treatment effect using flexible machine learning methods. However, in practice, investigators often have working hypotheses about effect heterogeneity across…

Methodology · Statistics 2023-09-13 Chan Park , Hyunseung Kang

The treatment allocation mechanism in a randomized clinical trial can be optimized by maximizing the nonparametric efficiency bound for a specific measure of treatment effect. Optimal treatment allocations which may or may not depend on…

Methodology · Statistics 2025-05-23 Wei Zhang , Zhiwei Zhang , Aiyi Liu

The constant development of new data analysis methods in many fields of research is accompanied by an increasing awareness that these new methods often perform better in their introductory paper than in subsequent comparison studies…

Methodology · Statistics 2024-01-17 Christina Nießl , Sabine Hoffmann , Theresa Ullmann , Anne-Laure Boulesteix

Causal inference has received great attention across different fields from economics, statistics, education, medicine, to machine learning. Within this area, inferring causal effects at individual level in observational studies has become…

Methodology · Statistics 2017-02-16 Thai Pham

Understanding treatment effect heterogeneity has become increasingly important in many fields. In this paper we study distributions and quantiles of individual treatment effects to provide a more comprehensive and robust understanding of…

Methodology · Statistics 2026-03-31 Zhe Chen , Xinran Li

We study the model selection problem in conditional average treatment effect (CATE) prediction. Unlike previous works on this topic, we focus on preserving the rank order of the performance of candidate CATE predictors to enable accurate…

Machine Learning · Statistics 2020-07-20 Yuta Saito , Shota Yasui

Detection of interactions between treatment effects and patient descriptors in clinical trials is critical for optimizing the drug development process. The increasing volume of data accumulated in clinical trials provides a unique…

Applications · Statistics 2017-12-25 Baptiste Goujaud , Eric W. Tramel , Pierre Courtiol , Mikhail Zaslavskiy , Gilles Wainrib

The increasing prevalence of rich sources of data and the availability of electronic medical record databases and electronic registries opens tremendous opportunities for enhancing medical research. For example, controlled trials are…

Methodology · Statistics 2015-09-23 Liwen Ouyang , Daniel W. Apley , Sanjay Mehrotra

The standard paradigm for confirmatory clinical trials is to compare experimental treatments with a control, for example the standard of care or a placebo. However, it is not always the case that a suitable control exists. Efficient…

Methodology · Statistics 2024-10-29 Thomas Burnett , Thomas Jaki

Suppose we are interested in the effect of a treatment in a clinical trial. The efficiency of inference may be limited due to small sample size. However, external control data are often available from historical studies. Motivated by an…

Methodology · Statistics 2021-12-10 Xinyu Li , Wang Miao , Fang Lu , Xiao-Hua Zhou

Researchers are frequently interested in understanding the causal effect of treatment interventions. However, in some cases, the treatment of interest--readily available in a randomized controlled trial (RCT)--is either not directly…

Methodology · Statistics 2025-09-29 Lan Wen , Aaron L Sarvet

Stress testing poses a causal question: how would portfolio credit losses change if the macroeconomy followed an adverse counterfactual path? Yet standard practice remains predictive and might be therefore vulnerable to omitted-variable…

Artificial Intelligence · Computer Science 2026-05-19 Yu Wang , Xiangchen Liu , Siguang Li

Utilizing established risk factors and prognostic models can often improve the construction of a newer risk model that uses novel biomarkers in a smaller, internal study. However, directly borrowing information from an established…

Methodology · Statistics 2026-03-12 Nicholas C. Henderson