English
Related papers

Related papers: Real vs. Semi-Simulated: Rethinking Evaluation for…

200 papers

In empirical studies with time-to-event outcomes, investigators often leverage observational data to conduct causal inference on the effect of exposure when randomized controlled trial data is unavailable. Model misspecification and lack of…

Methodology · Statistics 2023-05-05 Shenbo Xu , Bang Zheng , Bowen Su , Stan Finkelstein , Roy Welsch , Kenney Ng , Ioanna Tzoulaki , Zach Shahn

Triple difference designs have become increasingly popular in empirical economics. The advantage of a triple difference design is that, within a treatment group, it allows for another subgroup of the population -- potentially less impacted…

Econometrics · Economics 2025-06-04 Laura Caron

Machine learning is increasingly used to select which individuals receive limited-resource interventions in domains such as human services, education, development, and more. However, it is often not apparent what the right quantity is for…

Machine Learning · Computer Science 2025-03-20 Vibhhu Sharma , Bryan Wilder

When estimating heterogeneous treatment effects, missing outcome data can complicate treatment effect estimation, causing certain subgroups of the population to be poorly represented. In this work, we discuss this commonly overlooked…

Machine Learning · Statistics 2025-04-15 Matthew Pryce , Karla Diaz-Ordaz , Ruth H. Keogh , Stijn Vansteelandt

In observational studies, treatment may be adapted to covariates at several times without a fixed protocol, in continuous time. Treatment influences covariates, which influence treatment, which influences covariates, and so on. Then even…

Statistics Theory · Mathematics 2015-09-02 Judith J. Lok

We propose a formal model for counterfactual estimation with unobserved confounding in "data-rich" settings, i.e., where there are a large number of units and a large number of measurements per unit. Our model provides a bridge between the…

Econometrics · Economics 2025-04-03 Alberto Abadie , Anish Agarwal , Devavrat Shah

This paper introduces a novel approach for estimating heterogeneous treatment effects of binary treatment in panel data, particularly focusing on short panel data with large cross-sectional data and observed confoundings. In contrast to…

Methodology · Statistics 2024-06-05 Meijia Wang , Ignacio Martinez , P. Richard Hahn

The simultaneous application of multiple treatments is increasingly common in many fields, such as healthcare and marketing. In such scenarios, it is important to estimate the single treatment effects and the interaction treatment effects…

Methodology · Statistics 2025-11-14 Yuki Murakami , Takumi Hattori , Kohsuke Kubota

When a new treatment is considered for use, whether a pharmaceutical drug or a search engine ranking algorithm, a typical question that arises is, will its performance exceed that of the current treatment? The conventional way to answer…

Machine Learning · Computer Science 2016-10-27 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov

Experimentation is widely utilized for causal inference and data-driven decision-making across disciplines. In an A/B experiment, for example, an online business randomizes two different treatments (e.g., website designs) to their customers…

Methodology · Statistics 2025-01-15 Wenxuan Guo , JungHo Lee , Panos Toulis

Estimating heterogeneous treatment effects has become increasingly important in many fields and life and death decisions are now based on these estimates: for example, selecting a personalized course of medical treatment. Recently, a…

Methodology · Statistics 2019-04-01 Sören R. Künzel , Simon J. S. Walter , Jasjeet S. Sekhon

In this paper, we argue that the prevailing approach to training and evaluating machine learning models often fails to consider their real-world application within organizational or societal contexts, where they are intended to create…

Machine Learning · Computer Science 2025-04-24 Burcu Sayin , Jie Yang , Xinyue Chen , Andrea Passerini , Fabio Casati

We study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Since the long-term outcome is observed only after a long delay, it is not measured in the experimental…

Methodology · Statistics 2024-09-04 Guido Imbens , Nathan Kallus , Xiaojie Mao , Yuhao Wang

Personalized treatment effect estimates are often of interest in high-stakes applications -- thus, before deploying a model estimating such effects in practice, one needs to be sure that the best candidate from the ever-growing machine…

Machine Learning · Statistics 2023-06-07 Alicia Curth , Mihaela van der Schaar

Structural equation modeling (SEM) and path analysis have long been central tools for studying complex causal relationships in the social and behavioral sciences, yet their reliance on parametric assumptions can lead to biased inference…

Other Statistics · Statistics 2026-03-10 Junjie Ma , Xiaoya Zhang , Guangye He , Yuting Han , Ting Ge , Feng Ji

Meta-analysis can be a critical part of the research process, often serving as the primary analysis on which the practitioners, policymakers, and individuals base their decisions. However, current literature synthesis approaches to…

Methodology · Statistics 2023-08-28 Lily H. Zhang , Menelaos Konstantinidis , Marie-Abèle Bind , Donald B. Rubin

Regression analyses based on transformations of cumulative incidence functions are often adopted when modeling and testing for treatment effects in clinical trial settings involving competing and semi-competing risks. Common frameworks…

Methodology · Statistics 2024-01-11 Alexandra Bühler , Richard J Cook , Jerald F Lawless

Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly correlated with performance in real-world applications -- a…

Machine Learning · Computer Science 2024-06-18 Olivier Binette , Jerome P. Reiter

For counterfactual policy evaluation, it is important to ensure that treatment parameters are relevant to policies in question. This is especially challenging under unobserved heterogeneity, as is well featured in the definition of the…

Econometrics · Economics 2023-08-08 Sukjin Han , Shenshen Yang

Causal machine learning has the potential to revolutionize decision-making by combining the predictive power of machine learning algorithms with the theory of causal inference. However, these methods remain underutilized by the broader…