English
Related papers

Related papers: Residual permutation test for regression coefficie…

200 papers

The gold standard for identifying causal relationships is a randomized controlled experiment. In many applications in the social sciences and medicine, the researcher does not control the assignment mechanism and instead may rely upon…

Applications · Statistics 2016-11-22 Johann Gagnon-Bartsch , Yotam Shem-Tov

We propose a novel resampling-based method to construct an asymptotically exact test for any subset of hypotheses on coefficients in high-dimensional linear regression. It can be embedded into any multiple testing procedure to make…

Methodology · Statistics 2022-05-26 Anna Vesely , Jelle J. Goeman , Livio Finos

Invariance-based randomization tests -- such as permutation tests, rotation tests, or sign changes -- are an important and widely used class of statistical methods. They allow drawing inferences under weak assumptions on the data…

Statistics Theory · Mathematics 2022-05-31 Edgar Dobriban

We consider a nonlinear polynomial regression model in which we wish to test the null hypothesis of structural stability in the regression parameters against the alternative of a break at an unknown time. We derive the extreme value…

Statistics Theory · Mathematics 2008-10-23 Alexander Aue , Lajos Horváth , Marie Hušková , Piotr Kokoszka

Principal component regression (PCR) is a simple, but powerful and ubiquitously utilized method. Its effectiveness is well established when the covariates exhibit low-rank structure. However, its ability to handle settings with noisy,…

Machine Learning · Computer Science 2021-05-20 Anish Agarwal , Devavrat Shah , Dennis Shen , Dogyoon Song

We propose methods for estimating correspondence between two point sets under the presence of outliers in both the source and target sets. The proposed algorithms expand upon the theory of the regression without correspondence problem to…

Machine Learning · Statistics 2019-10-29 Amin Nejatbakhsh , Erdem Varol

Residual marked empirical process-based tests are commonly used in regression models. However, they suffer from data sparseness in high-dimensional space when there are many covariates. This paper has three purposes. First, we suggest a…

Methodology · Statistics 2015-10-27 Xuehu Zhu , Xu Guo , Lixing Zhu

Permutation-based partial-correlation tests guarantee finite-sample Type I error control under any fixed design and exchangeable noise, yet their power can collapse when the permutation-augmented design aligns too closely with the covariate…

Methodology · Statistics 2025-06-04 Tianyi Wang , Guanghui Wang , Zhaojun Wang , Changliang Zou

The integrated conditional moment (ICM) test is a classical and widely used method for assessing the adequacy of regression models. Although it performs well in fixed-dimension settings, its behavior changes dramatically when the predictor…

Methodology · Statistics 2026-04-17 Yue Hu , Haiqi Li , Xintao Xia

We present a general approach to constructing permutation tests that are both exact for the null hypothesis of equality of distributions and asymptotically correct for testing equality of parameters of distributions while allowing the…

Statistics Theory · Mathematics 2021-07-12 Colin B. Fogarty

Permutation tests are widely used for statistical hypothesis testing when the sampling distribution of the test statistic under the null hypothesis is analytically intractable or unreliable due to finite sample sizes. One critical challenge…

Computation · Statistics 2023-08-29 Yang Shi , Huining Kang , Ji-Hyun Lee , Hui Jiang

In this work, we focus on the high-dimensional trace regression model with a low-rank coefficient matrix. We establish a nearly optimal in-sample prediction risk bound for the rank-constrained least-squares estimator under no assumptions on…

Statistics Theory · Mathematics 2022-04-19 Michael Law , Ya'acov Ritov , Ruixiang Zhang , Ziwei Zhu

Given independent samples from P and Q, two-sample permutation tests allow one to construct exact level tests when the null hypothesis is P=Q. On the other hand, when comparing or testing particular parameters $\theta$ of P and Q, such as…

Statistics Theory · Mathematics 2013-04-23 EunYi Chung , Joseph P. Romano

A novel method is proposed for detecting changes in the covariance structure of moderate dimensional time series. This non-linear test statistic has a number of useful properties. Most importantly, it is independent of the underlying…

Methodology · Statistics 2021-08-18 Sean Ryan , Rebecca Killick

We investigate the problem of testing the global null in the high-dimensional regression models when the feature dimension $p$ grows proportionally to the number of observations $n$. Despite a number of prior work studying this problem,…

Methodology · Statistics 2020-10-06 Yue Li , Ilmun Kim , Yuting Wei

This paper provides some useful tests for fitting a parametric single-index regression model when covariates are measured with error and validation data is available. We propose two tests whose consistency rates do not depend on the…

Methodology · Statistics 2016-04-29 Hira L. Koul , Chuanlong Xie , Lixing Zhu

Conformal prediction provides finite-sample, distribution-free coverage under exchangeability, but standard constructions may lack robustness in the presence of outliers or heavy tails. We propose a robust conformal method based on a…

Statistics Theory · Mathematics 2026-04-21 Alejandro Cholaquidis , Emilien Joly , Leonardo Moreno

This paper derives asymptotic theory for Breitung's (2002, Journal of Econometrics 108, 343-363) nonparameteric variance ratio unit root test when applied to regression residuals. The test requires neither the specification of the…

Econometrics · Economics 2025-10-10 Karsten Reichold

There has been much interest in the nonparametric testing of conditional independence in the econometric and statistical literature, but the simplest and potentially most useful method, based on the sample partial correlation, seems to have…

Statistics Theory · Mathematics 2020-05-27 Wicher Bergsma

Permutation procedures are common practice in hypothesis testing when distributional assumptions about the test statistic are not met or unknown. With only few permutations, empirical p-values lie on a coarse grid and may even be zero when…