English
Related papers

Related papers: Remote Auditing: Design-based Tests of Randomizati…

200 papers

Estimating heterogeneous treatment effects is central to data-driven decision-making, yet industrial applications often face a fundamental tension between limited randomized controlled trial (RCT) budgets and abundant but biased…

Randomized experiments can provide unbiased estimates of sample average treatment effects. However, estimates of population treatment effects can be biased when the experimental sample and the target population differ. In this case, the…

Methodology · Statistics 2022-11-10 Wenqi Shi , Xi Lin

This article studies the benefits of using spatially randomized experimental designs which partition the experimental area into distinct, non-overlapping units with treatments assigned randomly. Such designs offer improved policy evaluation…

Statistics Theory · Mathematics 2025-11-18 Ying Yang , Chengchun Shi , Fang Yao , Shouyang Wang , Hongtu Zhu

Randomized Controlled Trials (RCT)s are relied upon to assess new treatments, but suffer from limited power to guide personalized treatment decisions. On the other hand, observational (i.e., non-experimental) studies have large and diverse…

Methodology · Statistics 2023-03-07 Zeshan Hussain , Ming-Chieh Shih , Michael Oberst , Ilker Demirel , David Sontag

We extend Fisher's randomization test (FRT) to test conditional independence between observed outcomes and treatments given covariates in both randomized experiments and observational studies, with no restriction on the variable type of…

Methodology · Statistics 2025-06-12 Zhen Zhong

Randomized controlled trials (RCTs) often exhibit limited inferential efficiency in estimating treatment effects due to small sample sizes. In recent years, the combination of external controls has gained increasing attention as a means of…

Methodology · Statistics 2025-10-06 Qinwei Yang , Jingyi Li , Peng Wu

Observed events in recommendation are consequence of the decisions made by a policy, thus they are usually selectively labeled, namely the data are Missing Not At Random (MNAR), which often causes large bias to the estimate of true outcomes…

Machine Learning · Computer Science 2021-10-05 Zifeng Wang , Xi Chen , Rui Wen , Shao-Lun Huang

Randomised controlled trials (RCTs) are the most effective approach to causal discovery, but in many circumstances it is impossible to conduct RCTs. Therefore observational studies based on passively observed data are widely accepted as an…

Artificial Intelligence · Computer Science 2016-11-11 Jiuyong Li , Thuc Duy Le , Lin Liu , Jixue Liu , Zhou Jin , Bingyu Sun , Saisai Ma

Cluster randomized trials (CRTs) often enroll large numbers of participants, but due to logistical and fiscal challenges, only a subset of participants may be selected for measurement of certain outcomes, and those sampled may, purposely or…

Randomized experiments ensure robust causal inference that are critical to effective learning analytics research and practice. However, traditional randomized experiments, like A/B tests, are limiting in large scale digital learning…

Applications · Statistics 2019-02-04 Timothy NeCamp , Josh Gardner , Christopher Brooks

Remote sensing change detection aims to localize semantic changes between images of the same location captured at different times. In the past few years, newer methods have attributed enhanced performance to the additions of new and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Blaž Rolih , Matic Fučka , Filip Wolf , Luka Čehovin Zajc

Online experiments such as Randomised Controlled Trials (RCTs) or A/B-tests are the bread and butter of modern platforms on the web. They are conducted continuously to allow platforms to estimate the causal effect of replacing system…

Machine Learning · Computer Science 2023-04-24 Olivier Jeunen

Random testing (RT) is a well-studied testing method that has been widely applied to the testing of many applications, including embedded software systems, SQL database systems, and Android applications. Adaptive random testing (ART) aims…

Software Engineering · Computer Science 2020-07-15 Rubing Huang , Weifeng Sun , Yinyin Xu , Haibo Chen , Dave Towey , Xin Xia

The rapid deployment of AI systems in high-stakes domains, including those classified as high-risk under the The EU AI Act (Regulation (EU) 2024/1689), has intensified the need for reliable compliance auditing. For binary classifiers,…

Machine Learning · Computer Science 2026-03-10 Valentin Lafargue , Adriana Laurindo Monteiro , Emmanuelle Claeys , Laurent Risser , Jean-Michel Loubes

Complete randomization balances covariates on average, but covariate imbalance often exists in finite samples. Rerandomization can ensure covariate balance in the realized experiment by discarding the undesired treatment assignments. Many…

Methodology · Statistics 2022-07-07 Xin Lu , Tianle Liu , Hanzhong Liu , Peng Ding

Understanding the effects of interventions is central to scientific progress, with randomized controlled trials (RCTs) regarded as the gold standard for causal inference in many applied fields. However, RCTs are costly, time-consuming, and…

Methodology · Statistics 2026-05-27 Drago Plecko , Patrik Okanovic , Torsten Hoefler , Elias Bareinboim

Randomized Controlled Trials (RCTs) are pivotal in generating internally valid estimates with minimal assumptions, serving as a cornerstone for researchers dedicated to advancing causal inference methods. However, extending these findings…

Methodology · Statistics 2024-05-28 Melody Y Huang , Harsh Parikh

Randomised controlled trials (RCTs) are regarded as the gold standard for estimating causal treatment effects on health outcomes. However, RCTs are not always feasible, because of time, budget or ethical constraints. Observational data such…

Methodology · Statistics 2024-02-20 Li Su , Roonak Rezvani , Shaun R. Seaman , Colin Starr , Isaac Gravestock

Background: Natural or quasi experiments are appealing for public health research because they enable the evaluation of events or interventions that are difficult or impossible to manipulate experimentally, such as many policy and health…

Design-based causal inference, also known as randomization-based or finite-population causal inference, is one of the most widely used causal inference frameworks, largely due to the merit that its validity can be guaranteed by study design…

Methodology · Statistics 2025-05-27 Siyu Heng , Jiawei Zhang , Yang Feng