English
Related papers

Related papers: Real-time Program Evaluation using Anytime-valid R…

200 papers

Treatment effect estimation is essential for informed decision-making in many fields such as healthcare, economics, and public policy. While flexible machine learning models have been widely applied for estimating heterogeneous treatment…

Machine Learning · Computer Science 2025-09-29 Pascal Memmesheimer , Vincent Heuveline , Jürgen Hesser

We study the model selection problem in conditional average treatment effect (CATE) prediction. Unlike previous works on this topic, we focus on preserving the rank order of the performance of candidate CATE predictors to enable accurate…

Machine Learning · Statistics 2020-07-20 Yuta Saito , Shota Yasui

The present paper proposes a new treatment effects estimator that is valid when the number of time periods is small, and the parallel trends condition holds conditional on covariates and unobserved heterogeneity in the form of interactive…

Econometrics · Economics 2023-06-16 Nicholas Brown , Kyle Butts , Joakim Westerlund

Recent research in causal inference under network interference has explored various experimental designs and estimation techniques to address this issue. However, existing methods, which typically rely on single experiments, often reach a…

Methodology · Statistics 2025-03-10 Qianyi Chen , Bo Li

Statistical experiments often seek to identify random variables with the largest population means. This inferential task, known as rank verification, has been well-studied on Gaussian data with equal variances. This work provides the first…

Methodology · Statistics 2025-07-15 Jeremy Goldwasser , Will Fithian , Giles Hooker

The analysis of platform trials can be enhanced by utilizing non-concurrent controls. Since including this data might also introduce bias in the treatment effect estimators if time trends are present, methods for incorporating…

Methodology · Statistics 2026-05-21 Pavla Krotka , Martin Posch , Marta Bofill Roig

Applied researchers are increasingly interested in whether and how treatment effects vary in randomized evaluations, especially variation not explained by observed covariates. We propose a model-free approach for testing for the presence of…

Methodology · Statistics 2014-12-17 Peng Ding , Avi Feller , Luke Miratrix

For job scheduling systems, where jobs require some amount of processing and then leave the system, it is natural for each user to provide an estimate of their job's time requirement in order to aid the scheduler. However, if there is no…

Computer Science and Game Theory · Computer Science 2022-02-14 Isaac Grosof , Michael Mitzenmacher

Randomized experiments (a.k.a. A/B tests) are a powerful tool for estimating treatment effects, to inform decisions making in business, healthcare and other applications. In many problems, the treatment has a lasting effect that evolves…

Machine Learning · Computer Science 2022-10-17 Ziyang Tang , Yiheng Duan , Stephanie Zhang , Lihong Li

Many decisions in healthcare, business, and other policy domains are made without the support of rigorous evidence due to the cost and complexity of performing randomized experiments. Using observational data to answer causal questions is…

Machine Learning · Statistics 2017-11-02 Alejandro Schuler , Ken Jung , Robert Tibshirani , Trevor Hastie , Nigam Shah

Classical and more recent tests for detecting distributional changes in multivariate time series often lack power against alternatives that involve changes in the cross-sectional dependence structure. To be able to detect such changes…

Statistics Theory · Mathematics 2014-09-16 Axel Bücher , Ivan Kojadinovic , Tom Rohmer , Johan Segers

We study a new model where the potential outcomes, corresponding to the values of a (possibly continuous) treatment, are linked through common factors. The factors can be estimated using a panel of regressors. We propose a procedure to…

Econometrics · Economics 2024-01-09 Jad Beyhum

CONTEXT: There is growing interest in establishing software engineering as an evidence-based discipline. To that end, replication is often used to gain confidence in empirical findings, as opposed to reproduction where the goal is showing…

Software Engineering · Computer Science 2018-02-14 Martin Shepperd

Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education, but safe deployment in high stakes settings requires ways of assessing its…

Machine Learning · Computer Science 2020-08-12 Omer Gottesman , Joseph Futoma , Yao Liu , Sonali Parbhoo , Leo Anthony Celi , Emma Brunskill , Finale Doshi-Velez

This paper studies inference in randomized controlled trials with covariate-adaptive randomization when there are multiple treatments. More specifically, we study inference about the average effect of one or more treatments relative to…

Econometrics · Economics 2019-01-21 Federico A. Bugni , Ivan A. Canay , Azeem M. Shaikh

In this work, we consider the fundamental problem of reachability analysis over imperative programs with real variables. The reachability property requires that a program can reach certain target states during its execution. Previous works…

Programming Languages · Computer Science 2020-07-29 Ali Asadi , Krishnendu Chatterjee , Hongfei Fu , Amir Kafshdar Goharshady , Mohammad Mahdavi

In this paper, I propose a general procedure for multivariate distribution-free nonparametric testing derived from the concept of ranks that are based upon measure transportation in the context of multiple change point analysis. I will use…

Other Statistics · Statistics 2021-08-30 Amanda Ng

Grounded text generation systems often generate text that contains factual inconsistencies, hindering their real-world applicability. Automatic factual consistency evaluation may help alleviate this limitation by accelerating evaluation…

This paper presents a unified rank-based inferential procedure for fitting the accelerated failure time model to partially interval-censored data. A Gehan-type monotone estimating function is constructed based on the idea of the familiar…

Methodology · Statistics 2026-04-14 Taehwa Choi , Sangbum Choi , Dipankar Bandyopadhyay

Predictive models are often introduced to decision-making tasks under the rationale that they improve performance over an existing decision-making policy. However, it is challenging to compare predictive performance against an existing…

Machine Learning · Computer Science 2024-06-13 Luke Guerdan , Amanda Coston , Kenneth Holstein , Zhiwei Steven Wu