English
Related papers

Related papers: Robust Inference on Infinite and Growing Dimension…

200 papers

This paper studies the asymptotics of resampling without replacement in the proportional regime where dimension $p$ and sample size $n$ are of the same order. For a given dataset $(X,y)\in \mathbb{R}^{n\times p}\times \mathbb{R}^n$ and…

Statistics Theory · Mathematics 2026-02-04 Pierre C. Bellec , Takuya Koriyama

Identification-robust hypothesis tests are commonly based on the continuous updating GMM objective function. When the number of moment conditions grows proportionally with the sample size, the large-dimensional weighting matrix prohibits…

Econometrics · Economics 2025-10-10 Tom Boot , Johannes W. Ligtenberg

We develop a uniform inference theory for high-dimensional slope parameters in threshold regression models, allowing for either cross-sectional or time series data. We first establish oracle inequalities for prediction errors, and L1…

Econometrics · Economics 2025-09-16 Jiatong Li , Hongqiang Yan

We study the residual bootstrap (RB) method in the context of high-dimensional linear regression. Specifically, we analyze the distributional approximation of linear contrasts $c^{\top} (\hat{\beta}_{\rho}-\beta)$, where…

Statistics Theory · Mathematics 2016-07-05 Miles E. Lopes

Thanks to its favorable properties, the multivariate normal distribution is still largely employed for modeling phenomena in various scientific fields. However, when the number of components $p$ is of the same asymptotic order as the sample…

Statistics Theory · Mathematics 2022-11-17 Caizhu Huang , Claudia Di Caterina , Nicola Sartori

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

Machine Learning · Computer Science 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

There is increasing interest in modeling high-dimensional longitudinal outcomes in applications such as developmental neuroimaging research. Growth curve model offers a useful tool to capture both the mean growth pattern across individuals,…

Methodology · Statistics 2023-05-26 Lu Wang , Xiang Lyu , Zhengwu Zhang , Lexin Li

In this paper, we consider tests for ultrahigh-dimensional partially linear regression models. The presence of ultrahigh-dimensional nuisance covariates and unknown nuisance function makes the inference problem very challenging. We adopt…

Methodology · Statistics 2023-04-18 Hongwei Shi , Bowen Sun , Weichao Yang , Xu Guo

In longitudinal panels and other regression models with unobserved effects, fixed effects estimation is often paired with cluster-robust variance estimation (CRVE) in order to account for heteroskedasticity and un-modeled dependence among…

Methodology · Statistics 2022-11-08 James E. Pustejovsky , Elizabeth Tipton

Spaces with locally varying scale of measurement, like multidimensional structures with differently scaled dimensions, are pretty common in statistics and machine learning. Nevertheless, it is still understood as an open question how to…

Machine Learning · Statistics 2024-03-05 Christoph Jansen , Georg Schollmeyer , Hannah Blocher , Julian Rodemann , Thomas Augustin

This paper develops tools to obtain robust probabilistic estimates for queueing models at the large deviations (LD) scale. These tools are based on the recently introduced robust R\'enyi bounds, which provide LD estimates (and more…

Probability · Mathematics 2020-08-14 Rami Atar , Amarjit Budhiraja , Paul Dupuis , Ruoyu Wu

We study high-dimensional regression in principal components space when the predictors are observed with additive measurement error and the response errors may be heavy-tailed. The starting point is the $\ell_1$-penalized…

Methodology · Statistics 2026-04-07 Long Feng , Xiaoyi Wang , Le Zhou

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

It is a critical challenge to efficiently unlock the powerful reasoning potential of Large Language Models (LLMs) for specific tasks or new distributions. Existing test-time adaptation methods often require tuning model parameters, which is…

Computation and Language · Computer Science 2025-12-05 Xinyue Kang , Diwei Shi , Li Chen

We consider high-dimensional generalized linear models when the covariates are contaminated by measurement error. Estimates from errors-in-variables regression models are well-known to be biased in traditional low-dimensional settings if…

Computation · Statistics 2020-01-06 Michael Byrd , Monnie McGee

Under complete linkage disequilibrium (LD), robust tests often have greater power than Pearson's chi-square test and trend tests for the analysis of case-control genetic association studies. Robust statistics have been used in…

Methodology · Statistics 2010-10-26 Gang Zheng , Jungnam Joo , Dmitri Zaykin , Colin Wu , Nancy Geller

For a regression model, we consider the risk of the maximum likelihood estimator with respect to $\alpha$-divergence, which includes the special cases of Kullback-Leibler divergence, Hellinger distance and $\chi^2$ divergence. The…

Statistics Theory · Mathematics 2017-09-12 Yo Sheena

Logistic regression is used thousands of times a day to fit data, predict future outcomes, and assess the statistical significance of explanatory variables. When used for the purpose of statistical inference, logistic models produce…

Statistics Theory · Mathematics 2017-06-06 Pragya Sur , Yuxin Chen , Emmanuel J. Candès

We are interested in testing general linear hypotheses in a high-dimensional multivariate linear regression model. The framework includes many well-studied problems such as two-sample tests for equality of population means, MANOVA and…

Methodology · Statistics 2018-10-05 Haoran Li , Alexander Aue , Debashis Paul

Traditional methods for linear regression generally assume that the underlying error distribution, equivalently the distribution of the responses, is normal. Yet, sometimes real life response data may exhibit a skewed pattern, and assuming…

Methodology · Statistics 2025-01-07 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh