English
Related papers

Related papers: Designing Experiments Informed by Observational St…

200 papers

The optimization of composition and processing to obtain materials that exhibit desirable characteristics has historically relied on a combination of scientist intuition, trial and error, and luck. We propose a methodology that can…

Machine Learning · Statistics 2017-07-20 Julia Ling , Max Hutchinson , Erin Antono , Sean Paradiso , Bryce Meredig

We address the problem of integrating data from multiple, possibly biased, observational and interventional studies, to eventually compute counterfactuals in structural causal models. We start from the case of a single observational dataset…

Artificial Intelligence · Computer Science 2023-03-17 Marco Zaffalon , Alessandro Antonucci , David Huber , Rafael Cabañas

Bipartite experiments arise in various fields, in which the treatments are randomized over one set of units, while the outcomes are measured over another separate set of units. However, existing methods often rely on strong model…

Methodology · Statistics 2025-04-16 Sizhu Lu , Lei Shi , Yue Fang , Wenxin Zhang , Peng Ding

Design of experiments and model selection, though essential steps in data science, are usually viewed as unrelated processes in the study and analysis of biological networks. Not accounting for their inter-relatedness has the potential to…

Algebraic Geometry · Mathematics 2024-11-19 Anyu Zhang , Jingzhen Hu , Qingzhong Liang , Elena S. Dimitrova , Brandilyn Stigler

This paper deals with a new design methodology for stratified comparative experiments based on interacting reinforced urn systems. The key idea is to model the interaction between urns for borrowing information across strata and to use it…

From scientific experiments to online A/B testing, the previously observed data often affects how future experiments are performed, which in turn affects which data will be collected. Such adaptivity introduces complex correlations between…

Machine Learning · Statistics 2018-01-03 Xinkun Nie , Xiaoying Tian , Jonathan Taylor , James Zou

A fundamental issue in causal inference for Big Observational Data is confounding due to covariate imbalances between treatment groups. This can be addressed by designing the data prior to analysis. Existing design methods, developed for…

Methodology · Statistics 2022-03-17 Yumin Zhang , Arman Sabbaghi

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

Unobserved confounding is one of the main challenges when estimating causal effects. We propose a causal reduction method that, given a causal model, replaces an arbitrary number of possibly high-dimensional latent confounders with a single…

Machine Learning · Statistics 2023-02-24 Maximilian Ilse , Patrick Forré , Max Welling , Joris M. Mooij

Observational studies can play a useful role in assessing the comparative effectiveness of competing treatments. In a clinical trial the randomization of participants to treatment and control groups generally results in well-balanced groups…

Combining observational and experimental data for causal inference can improve treatment effect estimation. However, many observational data sets cannot be released due to data privacy considerations, so one researcher may not have access…

Methodology · Statistics 2024-08-26 Charlotte Z. Mann , Adam C. Sales , Johann A. Gagnon-Bartsch

We provide a novel characterization of semiparametric efficiency in a generic supervised learning setting where the outcome mean function -- defined as the conditional expectation of the outcome of interest given the other observed…

Methodology · Statistics 2025-04-22 Harrison H. Li

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

We provide an approach to exploratory data analysis in matched observational studies with a single intervention and multiple endpoints. In such settings, the researcher would like to explore evidence for actual treatment effects among these…

Methodology · Statistics 2025-12-10 Mengqi Lin , Colin Fogarty

We study the problem of multi-task non-smooth optimization that arises ubiquitously in statistical learning, decision-making and risk management. We develop a data fusion approach that adaptively leverages commonalities among a large number…

Machine Learning · Statistics 2022-10-25 Henry Lam , Kaizheng Wang , Yuhang Wu , Yichen Zhang

Background: Adaptive interventions provide a guide for using ongoing information about individuals to decide whether and how to modify the type, amount, delivery modality, or timing of treatment, to improve intervention effectiveness while…

Methodology · Statistics 2026-03-12 John J. Dziak , Inbal Nahum-Shani

Every design choice will have different effects on different units. However traditional A/B tests are often underpowered to identify these heterogeneous effects. This is especially true when the set of unit-level attributes is…

Artificial Intelligence · Computer Science 2016-11-09 Alexander Peysakhovich , Akos Lada

This paper presents a technique which exploits the occurrence of certain events as observed by different sensors, to detect and classify objects. This technique explores the extent of dependence between features being observed by the…

Signal Processing · Electrical Eng. & Systems 2021-03-08 Siddharth Roheda , Hamid Krim , Zhi-Quan Luo , Tianfu Wu

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui