English
Related papers

Related papers: Cheap Permutation Testing

200 papers

Hypothesis testing of random forest (RF) variable importance measures (VIMP) remains the subject of ongoing research. Among recent developments, heuristic approaches to parametric testing have been proposed whose distributional assumptions…

Methodology · Statistics 2023-07-20 Alexander Hapfelmeier , Roman Hornung , Bernhard Haller

We investigate the large-sample behavior of change-point tests based on weighted two-sample U-statistics, in the case of short-range dependent data. Under some mild mixing conditions, we establish convergence of the test statistic to an…

Statistics Theory · Mathematics 2023-04-04 Herold Dehling , Kata Vuk , Martin Wendler

The synthetic control method is often applied to problems with one treated unit and a small number of control units. A common inferential task in this setting is to test null hypotheses regarding the average treatment effect on the treated.…

Methodology · Statistics 2025-04-22 Lihua Lei , Timothy Sudijono

I introduce a simple permutation procedure to test conventional (non-sharp) hypotheses about the effect of a binary treatment in the presence of a finite number of large, heterogeneous clusters when the treatment effect is identified by…

Econometrics · Economics 2023-02-08 Andreas Hagemann

Distance correlation has gained much recent attention in the data science community: the sample statistic is straightforward to compute and asymptotically equals zero if and only if independence, making it an ideal choice to discover any…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Sambit Panda , Joshua T. Vogelstein

The quantum analogue of the equality function, known as the quantum state identity problem, is the task of deciding whether $n$ unknown quantum states are equal or unequal, given the promise that all states are either pairwise orthogonal or…

Quantum Physics · Physics 2026-04-15 Harry Buhrman , Dmitry Grinko , Philip Verduyn Lunel , Jordi Weggemans

Test statistics are often strongly dependent in large-scale multiple testing applications. Most corrections for multiplicity are unduly conservative for correlated test statistics, resulting in a loss of power to detect true positives. We…

Statistics Theory · Mathematics 2012-03-20 Nicolai Meinshausen , Marloes H. Maathuis , Peter Bühlmann

Recently a distribution free approach for testing parametric hypotheses based on unitary transformations has been suggested in \cite{Khm13, Khm16, Khm17} and further studied in \cite{Ngu17} and \cite{Rob19}. In this note we show that the…

Methodology · Statistics 2020-02-10 Estate V. Khmaladze

Econometric applications with multi-way clustering often feature a small number of effective clusters or heavy-tailed data, making standard cluster-robust and bootstrap inference unreliable in finite samples. In this paper, we develop a…

Methodology · Statistics 2026-01-14 Wenxuan Guo , Panos Toulis , Yuhao Wang

Conditional independence testing is a key problem required by many machine learning and statistics tools. In particular, it is one way of evaluating the usefulness of some features on a supervised prediction problem. We propose a novel…

Machine Learning · Statistics 2019-08-02 Marco Henrique de Almeida Inácio , Rafael Izbicki , Rafael Bassi Stern

We develop a new permutation test for inference on a subvector of coefficients in linear models. The test is exact when the regressors and the error terms are independent. Then, we show that the test is asymptotically of correct level,…

Econometrics · Economics 2023-09-13 Xavier D'Haultfœuille , Purevdorj Tuvaandorj

Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is…

Methodology · Statistics 2023-06-13 Zhanrui Cai , Jing Lei , Kathryn Roeder

Permutation tests are amongst the most commonly used statistical tools in modern genomic research, a process by which p-values are attached to a test statistic by randomly permuting the sample or gene labels. Yet permutation p-values…

Applications · Statistics 2016-03-21 Belinda Phipson , Gordon K. Smyth

Many testing problems are readily amenable to randomised tests such as those employing data splitting. However despite their usefulness in principle, randomised tests have obvious drawbacks. Firstly, two analyses of the same dataset may…

Methodology · Statistics 2024-09-05 F. Richard Guo , Rajen D. Shah

Permutation tests enable testing statistical hypotheses in situations when the distribution of the test statistic is complicated or not available. In some situations, the test statistic under investigation is multivariate, with the multiple…

Methodology · Statistics 2023-11-08 Zdeněk Hlávka , Daniel Hlubinka , Šárka Hudecová

We study the problem of testing discrete distributions with a focus on the high probability regime. Specifically, given samples from one or more discrete distributions, a property $\mathcal{P}$, and parameters $0< \epsilon, \delta <1$, we…

Data Structures and Algorithms · Computer Science 2020-09-15 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , John Peebles , Eric Price

Re-sampling based statistical tests are known to be computationally heavy, but reliable when small sample sizes are available. Despite their nice theoretical properties not much effort has been put to make them efficient. In this paper we…

Methodology · Statistics 2018-06-29 Christina Chatzipantsiou , Marios Dimitriadis , Manos Papadakis , Michail Tsagris

Testing the independence between random vectors is a fundamental problem in statistics. Distance correlation, a recently popular dependence measure, is universally consistent for testing independence against all distributions with finite…

Methodology · Statistics 2024-08-22 Yuwei Ke , Hok Kan Ling , Yanglei Song

New inference methods for the multivariate coefficient of variation and its reciprocal, the standardized mean, are presented. While there are various testing procedures for both parameters in the univariate case, it is less known how to do…

Methodology · Statistics 2020-03-31 Marc Ditzhaus , Łukas Smaga

This paper studies one-sided hypothesis testing under random sampling without replacement. That is, when $n+1$ binary random variables $X_1,\ldots, X_{n+1}$ are subject to a permutation invariant distribution and $n$ binary random variables…

Statistics Theory · Mathematics 2022-11-07 Zihao Li , Huangjun Zhu , Masahito Hayashi