English
Related papers

Related papers: A Ridge-Regularised Jackknifed Anderson-Rubin Test

200 papers

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight…

We study the gradient wild bootstrap-based inference for instrumental variable quantile regressions in the framework of a small number of large clusters in which the number of clusters is viewed as fixed, and the number of observations for…

Econometrics · Economics 2024-08-21 Wenjie Wang , Yichong Zhang

We propose a weak-instrument-robust subvector Lagrange multiplier test for instrumental variables regression. We show that it is asymptotically size-correct under a technical condition or as the number of instruments grows to infinity. This…

Statistics Theory · Mathematics 2026-03-03 Malte Londschien , Peter Bühlmann

This paper proposes an overidentifying restriction test for high-dimensional linear instrumental variable models. The novelty of the proposed test is that it allows the number of covariates and instruments to be larger than the sample size.…

Econometrics · Economics 2024-05-08 Qingliang Fan , Zijian Guo , Ziwei Mei

We study the problem of detecting multiple change points in the mean vectors of an independent sequence of high-dimensional observations. We propose a family of ridge-regularized CUSUM statistics built upon the adaptable ridge-regularized…

Methodology · Statistics 2026-05-26 Haoran Li , Haotian Xu

This paper presents an inference method for the local average treatment effect (LATE) in the presence of high-dimensional covariates, regardless of the strength of identification. We propose an orthogonalized Anderson-Rubin test statistic…

Econometrics · Economics 2025-11-11 Yukun Ma

A fundamental problem in multivariate analysis is testing general linear hypotheses for regression coefficients in a multivariate linear model. This framework encompasses a wide range of well-studied tasks, including MANOVA, joint…

Methodology · Statistics 2025-07-09 Haoran Li

Testing restrictions on regression coefficients in linear models often requires correcting the conventional F-test for potential heteroskedasticity or autocorrelation amongst the disturbances, leading to so-called heteroskedasticity and…

Statistics Theory · Mathematics 2016-12-21 David Preinerstorfer , Benedikt M. Pötscher

For studying or reducing the bias of functionals of the Kaplan-Meier survival estimator, the jackknifing approach of Stute and Wang (1994) is natural. We have studied the behavior of the jackknife estimate of bias under different…

Methodology · Statistics 2013-12-17 Md Hasinur Rahaman Khan , J. Ewart H. Shaw

We introduce a novel approach called the Bayesian Jackknife empirical likelihood method for analyzing survey data obtained from various unequal probability sampling designs. This method is particularly applicable to parameters described by…

Methodology · Statistics 2023-09-14 Mengdong Shang , Xia Chen

Conventional regularization is designed to control variance, but in small-data regression it can also aggravate underfitting when predictive signal is concentrated in weak directions of a restricted representation. We study a…

Machine Learning · Computer Science 2026-04-21 Dongseok Kim , Gisung Oh

When outcome data are expensive or onerous to collect, scientists increasingly substitute predictions from machine learning and AI models for unlabeled cases, a process which has consequences for downstream statistical inference. While…

Machine Learning · Statistics 2026-03-13 Stephen Salerno , Zhenke Wu , Tyler McCormick

The error or variability of machine learning algorithms is often assessed by repeatedly re-fitting a model with different weighted versions of the observed data. The ubiquitous tools of cross-validation (CV) and the bootstrap are examples…

Methodology · Statistics 2020-02-10 Ryan Giordano , Will Stephenson , Runjing Liu , Michael I. Jordan , Tamara Broderick

Tests based on heteroskedasticity robust standard errors are an important technique in econometric practice. Choosing the right critical value, however, is not simple at all: conventional critical values based on asymptotics often lead to…

Statistics Theory · Mathematics 2025-05-07 Benedikt M. Pötscher , David Preinerstorfer

Using modifications of Lindeberg's interpolation technique, I propose a new identification-robust test for the structural parameter in a heteroskedastic instrumental variables model. While my analysis allows the number of instruments to be…

Econometrics · Economics 2024-12-17 Manu Navjeevan

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

Empirical instrumental variables (IV) studies often report separate results based on low-dimensional instruments and many base instruments. This paper proposes a combination test that integrates these commonly reported statistics. The test…

Econometrics · Economics 2026-03-25 Liyu Dou , Pengjin Min , Wenjie Wang , Yichong Zhang

Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [{\it Ann. Statist.} {\bf 1} (1973) 799--821], robust…

Statistics Theory · Mathematics 2017-11-16 Wen-Xin Zhou , Koushiki Bose , Jianqing Fan , Han Liu

Detecting the presence of anomalies in regression models is a crucial task in machine learning, as anomalies can significantly impact the accuracy and reliability of predictions. Random Sample Consensus (RANSAC) is one of the most popular…

Machine Learning · Statistics 2024-10-22 Le Hong Phong , Ho Ngoc Luat , Vo Nguyen Le Duy

We derive new bounds for the condition number of kernel matrices, which we then use to enhance existing non-asymptotic test error bounds for kernel ridgeless regression (KRR) in the over-parameterized regime for a fixed input dimension. For…

Machine Learning · Computer Science 2024-05-31 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius