English
Related papers

Related papers: Asymptotics of Linear Regression with Linearly Dep…

200 papers

Graphical models have long been studied in statistics as a tool for inferring conditional independence relationships among a large set of random variables. The most existing works in graphical modeling focus on the cases that the data are…

Methodology · Statistics 2022-12-12 Siqi Liang , Faming Liang

This paper aims at analyzing the regularization effect that data augmentation induces on supervised regression methods in the proportional regime, where the number of covariates grows proportionally to the number of samples. We provide a…

Machine Learning · Statistics 2026-05-12 Lucas Morisset , Alain Durmus , Adrien Hardy

Multivariate processes with long-range dependence properties can be encountered in many fields of application. Two fundamental characteristics in such frameworks are long-range dependence parameters and correlations between component time…

Statistics Theory · Mathematics 2022-04-07 Irène Gannaz

The paper presents a systematic theory for asymptotic inference of autocovariances of stationary processes. We consider nonparametric tests for serial correlations based on the maximum (or ${\cal L}^\infty$) and the quadratic (or ${\cal…

Statistics Theory · Mathematics 2015-03-19 Han Xiao , Wei Biao Wu

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro

In this paper we consider a regression model that allows for time series covariates as well as heteroscedasticity with a regression function that is modelled nonparametrically. We assume that the regression function changes at some unknown…

Statistics Theory · Mathematics 2019-09-17 Maria Mohr , Leonie Selk

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

In spatio-temporal analysis, we often record data at specific time intervals but with varying spatial locations between these timepoints. We propose a conditional model to analyze such spatio-temporal data that accommodates the dependencies…

Methodology · Statistics 2026-04-03 Subhrajyoty Roy , Soudeep Deb , Sayar Karmakar , Rishideep Roy

We study the universality property of estimators for high-dimensional linear models, which implies that the distribution of estimators is independent of whether the covariates follow a Gaussian distribution. Recent developments in…

Statistics Theory · Mathematics 2025-10-14 Toshiki Tsuda , Masaaki Imaizumi

We study estimation and prediction of Gaussian random fields with covariance models belonging to the generalized Wendland (GW) class, under fixed domain asymptotics. As the Mat\'ern case, this class allows a continuous parameterization of…

Statistics Theory · Mathematics 2017-11-17 M. Bevilacqua , T. Faouzi , R. Furrer , E. Porcu

We study regression discontinuity designs with the use of additional covariates for estimation of the average treatment effect. We provide a detailed proof of asymptotic normality of the covariate-adjusted estimator under minimal…

Statistics Theory · Mathematics 2023-10-16 Patrick Kramer , Alexander Kreiß

We study the asymptotic behaviour of both spherical $t$-designs and random uniform designs as the set of sampling points in non-parametric regression with spherical regressors of arbitrary dimension. We show that the corresponding…

Statistics Theory · Mathematics 2026-05-05 Martin Kroll

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax…

Statistics Theory · Mathematics 2017-02-07 Yun Yang , Zuofeng Shang , Guang Cheng

This paper studies the asymptotics of resampling without replacement in the proportional regime where dimension $p$ and sample size $n$ are of the same order. For a given dataset $(X,y)\in \mathbb{R}^{n\times p}\times \mathbb{R}^n$ and…

Statistics Theory · Mathematics 2026-02-04 Pierre C. Bellec , Takuya Koriyama

Gaussian scale mixtures are constructed as Gaussian processes with a random variance. They have non-Gaussian marginals and can exhibit asymptotic dependence unlike Gaussian processes, which are asymptotically independent except in the case…

Methodology · Statistics 2017-01-31 Raphael Huser , Thomas Opitz , Emeric Thibaud

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

Statistics Theory · Mathematics 2023-01-03 Lang Liu , Zaid Harchaoui

We investigate the high-dimensional properties of robust regression estimators in the presence of heavy-tailed contamination of both the covariates and response functions. In particular, we provide a sharp asymptotic characterisation of…

Statistics Theory · Mathematics 2024-06-03 Urte Adomaityte , Leonardo Defilippis , Bruno Loureiro , Gabriele Sicuro

Motivated by statistical inference problems in high-dimensional time series data analysis, we first derive non-asymptotic error bounds for Gaussian approximations of sums of high-dimensional dependent random vectors on hyper-rectangles,…

Statistics Theory · Mathematics 2024-06-05 Jinyuan Chang , Xiaohui Chen , Mingcong Wu

The standard linear and logistic regression models assume that the response variables are independent, but share the same linear relationship to their corresponding vectors of covariates. The assumption that the response variables are…

Machine Learning · Computer Science 2019-10-09 Constantinos Daskalakis , Nishanth Dikkala , Ioannis Panageas