English
Related papers

Related papers: Remote Auditing: Design-based Tests of Randomizati…

200 papers

The randomized controlled trial (RCT) is the gold standard for estimating the average treatment effect (ATE) of a medical intervention but requires 100s-1000s of subjects, making it expensive and difficult to implement. While a cross-over…

Signal Processing · Electrical Eng. & Systems 2023-05-10 Sayeri Lala , Niraj K. Jha

Randomized experiments are considered the gold standard for estimating causal effects. However, out of the set of possible randomized assignments, some may be likely to produce poor effect estimates and misleading conclusions. Restricted…

Methodology · Statistics 2025-08-28 Maggie Wang , René F. Kizilcec , Michael Baiocchi

Randomized Controlled Trials (RCTs) are the gold standard for comparing the effectiveness of a new treatment to the current one (the control). Most RCTs allocate the patients to the treatment group and the control group by uniform…

Machine Learning · Statistics 2018-10-22 Onur Atan , William R. Zame , Mihaela van der Schaar

Switchback experiments--alternating treatment and control over time--are widely used when unit-level randomization is infeasible, outcomes are aggregated, or user interference is unavoidable. In practice, experimentation must support fast…

Methodology · Statistics 2026-02-27 Jizhou Liu , Liang Zhong

We argue that randomized controlled trials (RCTs) are special even among settings where average treatment effects are identified by a nonparametric unconfoundedness assumption. This claim follows from two results of Robins and Ritov (1997):…

Methodology · Statistics 2021-09-28 P. M. Aronow , James M. Robins , Theo Saarinen , Fredrik Sävje , Jasjeet Sekhon

Randomized controlled trials (RCTs) are widely regarded as the gold standard for causal inference in biomedical research. For instance, when estimating the average treatment effect on the treated (ATT), a doubly robust estimation procedure…

Methodology · Statistics 2025-09-26 Chi-Shian Dai , Chao Ying , Yang Ning , Jiwei Zhao

Randomized Controlled Trials (RCTs) are the gold standard for evaluating the effect of new medical treatments. Treatments must pass stringent regulatory conditions in order to be approved for widespread use, yet even after the regulatory…

Machine Learning · Statistics 2025-03-13 Omer Noy Klein , Alihan Hüyük , Ron Shamir , Uri Shalit , Mihaela van der Schaar

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

We consider how increasingly available observational data can be used to improve the design of randomized controlled trials (RCTs). We seek to design a prospective RCT, with the intent of using an Empirical Bayes estimator to shrink the…

Methodology · Statistics 2022-04-15 Evan T. R. Rosenman , Luke Miratrix

Objective: Randomized controlled trial (RCT) results often inform clinical decision-making, but the highly curated populations of trials and the care provided during the trial are often not reflective of real-world practice. The objective…

Applications · Statistics 2024-02-26 Guanbo Wang , Ting-Wei Ernie Liao , David Furfaro , Leo Anthony Celi , Kevin Sheng-Kai Ma

Inference-time scaling can amplify reasoning pathologies: sycophancy, rung collapse, and premature certainty. We present RAudit, a diagnostic protocol for auditing LLM reasoning without ground truth access. The key constraint is blindness:…

Artificial Intelligence · Computer Science 2026-02-02 Edward Y. Chang , Longling Geng

Observational studies provide the only evidence on the effectiveness of interventions when randomized controlled trials (RCTs) are impractical due to cost, ethical concerns, or time constraints. While many methodologies aim to draw causal…

The conditional randomization test (CRT) was recently proposed to test whether two random variables X and Y are conditionally independent given random variables Z. The CRT assumes that the conditional distribution of X given Z is known…

Machine Learning · Computer Science 2023-04-11 Shuai Li , Ziqi Chen , Hongtu Zhu , Christina Dan Wang , Wang Wen

Causal inference is vital for informed decision-making across fields such as biomedical research and social sciences. Randomized controlled trials (RCTs) are considered the gold standard for internal validity of inferences, whereas…

Methodology · Statistics 2025-12-02 Ruoqi Yu , Bikram Karmakar , Jessica Vandeleest , Eleanor Bimla Schwarz

Randomized controlled trials (RCTs) are considered the gold standard for estimating the average treatment effect (ATE) of interventions. One use of RCTs is to study the causes of global poverty -- a subject explicitly cited in the 2019…

Machine Learning · Computer Science 2023-05-26 Connor T. Jerzak , Fredrik Johansson , Adel Daoud

Cluster randomized trials (CRTs) offer a practical alternative for addressing logistical challenges and ensuring feasibility in community health, education, and prevention studies, even though randomized controlled trials are considered the…

Methodology · Statistics 2025-10-30 Jooyeon Lee , M. S. , Evan Kwiatkowski , Ph. D

We consider the task of evaluating policies of algorithmic resource allocation through randomized controlled trials (RCTs). Such policies are tasked with optimizing the utilization of limited intervention resources, with the goal of…

Artificial Intelligence · Computer Science 2023-02-07 Aditya Mate , Bryan Wilder , Aparna Taneja , Milind Tambe

Financial statement auditing is conducted under a risk-based evidence approach to obtain reasonable assurance. In practice, auditors often perform additional sampling or related procedures when an initial sample does not provide a…

Statistical Finance · Quantitative Finance 2026-04-08 Masahiro Kato , Kei Nakagawa

Randomized controlled trials (RCTs) face inherent limitations, such as ethical or resource constraints, which lead to a limited number of study participants. To address these limitations, recent research endeavors have sought to incorporate…

Methodology · Statistics 2025-02-20 Peijin Wang , Hwanhee Hong , Kyungeun Jeon , Laine Elliott Thomas

Background: When planning a cluster randomized trial, evaluators often have access to an enumerated cohort representing the target population of clusters. Practicalities of conducting the trial, such as the need to oversample clusters with…

Methodology · Statistics 2024-09-19 Sarah E. Robertson , Jon A. Steingrimsson , Issa J. Dahabreh