English
Related papers

Related papers: Treatment effect validation via a permutation test…

200 papers

Consider two random variables contaminated by two unknown transformations. The aim of this paper is to test the equality of those transformations. Two cases are distinguished: first, the two random variables have known distributions.…

Methodology · Statistics 2011-11-01 Mohamed Boutahar , Denys Pommeret

We study variants of the average treatment effect on the treated with population parameters replaced by their sample counterparts. For each estimand, we derive the limiting distribution with respect to a semiparametric efficient estimator…

Methodology · Statistics 2024-02-12 Andrew Yiu

Booming in business and a staple analysis in medical trials, the A/B test assesses the effect of an intervention or treatment by comparing its success rate with that of a control condition. Across many practical applications, it is…

Applications · Statistics 2020-11-16 Quentin F. Gronau , K. N. Akash Raj , Eric-Jan Wagenmakers

We compare different permutation tests and some parametric counterparts that are applicable to unbalanced designs in two by two designs. First the different approaches are shortly summarized. Then we investigate the behavior of the tests in…

Methodology · Statistics 2013-10-01 Sonja Hahn , Frank Konietschke , Luigi Salmaso

Classical randomized experiments, equipped with randomization-based inference, provide assumption-free inference for treatment effects. They have been the gold standard for drawing causal inference and provide excellent internal validity.…

Methodology · Statistics 2021-09-22 Zihao Yang , Tianyi Qu , Xinran Li

Econometric applications with multi-way clustering often feature a small number of effective clusters or heavy-tailed data, making standard cluster-robust and bootstrap inference unreliable in finite samples. In this paper, we develop a…

Methodology · Statistics 2026-01-14 Wenxuan Guo , Panos Toulis , Yuhao Wang

Randomized experiments (a.k.a. A/B tests) are a powerful tool for estimating treatment effects, to inform decisions making in business, healthcare and other applications. In many problems, the treatment has a lasting effect that evolves…

Machine Learning · Computer Science 2022-10-17 Ziyang Tang , Yiheng Duan , Stephanie Zhang , Lihong Li

Experiments often yield non-identically distributed data for statistical analysis. Tests of hypothesis under such set-ups are generally performed using the likelihood ratio test, which is non-robust with respect to outliers and model…

Statistics Theory · Mathematics 2017-07-25 Abhik Ghosh , Ayanendranath Basu

Friedman test is a nonparametric method that proposed for analyzing data from a randomized complete block design as a robust alternative to parametric method and widely applied in many fields such as agriculture, biology, business,…

Methodology · Statistics 2022-02-21 Elsayed A. H. Elamir

This paper investigates the robustness of futility analyses in clinical trials when interim analysis population deviates from the target population. We demonstrate how population shifts can distort early stopping decisions and propose…

Methodology · Statistics 2025-07-31 Rui Jin , Cai Wu , Peter Mesenbrink

This paper provides a new approach for identifying and estimating the Average Treatment Effect on the Treated under a linear factor model that allows for multiple time-varying unobservables. Unlike the majority of the literature on…

Econometrics · Economics 2025-03-28 Koki Fusejima , Takuya Ishihara

In this review, we present an overview of the main aspects related to the statistical evaluation of medical tests for diagnosis and prognosis. Measures of diagnostic performance for binary tests, such as sensitivity, specificity, and…

Methodology · Statistics 2020-07-16 Vanda Inacio , Maria Xose Rodriguez-Alvarez , Pilar Gayoso-Diz

Fisher's randomization test (FRT) delivers exact $p$-values under the strong null hypothesis of no treatment effect on any units whatsoever and allows for flexible covariate adjustment to improve the power. Of interest is whether the…

Methodology · Statistics 2021-05-03 Anqi Zhao , Peng Ding

In order to test if a treatment is perceptibly different from a placebo in a randomized experiment with covariates, classical nonparametric tests based on ranks of observations/residuals have been employed (eg: by Rosenbaum), with…

Methodology · Statistics 2022-04-15 Boyan Duan , Aaditya Ramdas , Larry Wasserman

Motivated by population studies of Diffusion Tensor Imaging, the paper investigates the use of mean-based and dispersion-based permutation tests to define and compute the significance of a statistical test for data taking values on…

Statistics Theory · Mathematics 2013-05-07 Anne Collard , Christophe Phillips , Rodolphe Sepulchre

This paper studies the robustness of estimated policy effects to changes in the distribution of covariates, a key determinant of the external validity of (quasi)-experimental results. I propose a novel robustness metric $\delta^*$ which…

Econometrics · Economics 2026-05-27 Pietro Emilio Spini

Measuring the effect of peers on individuals' outcomes is a challenging problem, in part because individuals often select peers who are similar in both observable and unobservable ways. Group formation experiments avoid this problem by…

Methodology · Statistics 2023-03-09 Guillaume Basse , Peng Ding , Avi Feller , Panos Toulis

In this paper we review recent advances in statistical methods for the evaluation of the heterogeneity of treatment effects (HTE), including subgroup identification and estimation of individualized treatment regimens, from randomized…

Methodology · Statistics 2024-10-22 Ilya Lipkovich , David Svensson , Bohdana Ratitch , Alex Dmitrienko

Permutation tests are amongst the most commonly used statistical tools in modern genomic research, a process by which p-values are attached to a test statistic by randomly permuting the sample or gene labels. Yet permutation p-values…

Applications · Statistics 2016-03-21 Belinda Phipson , Gordon K. Smyth

For general repeated measures designs the Wald-type statistic (WTS) is an asymptotically valid procedure allowing for unequal covariance matrices and possibly non-normal multivariate observations. The drawback of this procedure is the poor…

Methodology · Statistics 2016-06-24 Sarah Friedrich , Edgar Brunner , Markus Pauly