English
Related papers

Related papers: Asymptotics of Linear Regression with Linearly Dep…

200 papers

We develop adaptive estimation and inference methods for high-dimensional Gaussian copula regression that achieve the same performance without the knowledge of the marginal transformations as that for high-dimensional linear regression.…

Methodology · Statistics 2015-12-09 T. Tony Cai , Linjun Zhang

In this article, we consider flexible seasonal time series models which consist of a common trend function over periods and additive individual trend (seasonal effect) functions. The consistency and asymptotic normality of the local linear…

Mathematical Physics · Physics 2014-03-11 Kyong-Hui Kim , Hak-Myong Pak

Linear regression without correspondences is the problem of performing a linear regression fit to a dataset for which the correspondences between the independent samples and the observations are unknown. Such a problem naturally arises in…

Machine Learning · Computer Science 2019-10-07 Manolis C. Tsakiris , Liangzu Peng , Aldo Conca , Laurent Kneip , Yuanming Shi , Hayoung Choi

We study parameter estimation in linear Gaussian covariance models, which are $p$-dimensional Gaussian models with linear constraints on the covariance matrix. Maximum likelihood estimation for this class of models leads to a non-convex…

Statistics Theory · Mathematics 2016-04-19 Piotr Zwiernik , Caroline Uhler , Donald Richards

A major effort in modern high-dimensional statistics has been devoted to the analysis of linear predictors trained on nonlinear feature embeddings via empirical risk minimization (ERM). Gaussian equivalence theory (GET) has emerged as a…

Statistics Theory · Mathematics 2025-12-04 Garrett G. Wen , Hong Hu , Yue M. Lu , Zhou Fan , Theodor Misiakiewicz

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

It has been observed that the performances of many high-dimensional estimation problems are universal with respect to underlying sensing (or design) matrices. Specifically, matrices with markedly different constructions seem to achieve…

Information Theory · Computer Science 2023-07-24 Rishabh Dudeja , Subhabrata Sen , Yue M. Lu

The paper considers so-called adaptive estimations of regression, distribution density and spectral density of a Gaussian stationary sequence, asymptotically optimal in order at a growing number of observation on any regular subspace…

Probability · Mathematics 2007-05-23 Eugene Ostrovsky , Leonid Sirota

In this expository note we describe a surprising phenomenon in overparameterized linear regression, where the dimension exceeds the number of samples: there is a regime where the test risk of the estimator found by gradient descent…

Machine Learning · Statistics 2019-12-17 Preetum Nakkiran

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

We construct uniform and point-wise asymptotic confidence sets for the single edge in an otherwise smooth image function which are based on rotated differences of two one-sided kernel estimators. Using methods from M-estimation, we show…

Statistics Theory · Mathematics 2019-03-26 Viktor Bengs , Matthias Eulert , Hajo Holzmann

The results of a series of theoretical studies are reported, examining the convergence rate for different approximate representations of $\alpha$-stable distributions. Although they play a key role in modelling random processes with jumps…

Probability · Mathematics 2020-01-03 Marina Riabiz , Tohid Ardeshiri , Ioannis Kontoyiannis , Simon Godsill

In this article, we introduce a system of stochastic differential equations (SDEs) consisting of time-dependent covariates and consider both fixed and random effects set-ups. We also allow the functional part associated with the drift…

Statistics Theory · Mathematics 2017-10-16 Trisha Maitra , Sourabh Bhattacharya

We consider the problem of variable selection in Bayesian multivariate linear regression models, involving multiple response and predictor variables, under multivariate normal errors. In the absence of a known covariance structure,…

Methodology · Statistics 2025-07-25 Joyee Ghosh , Xun Li

We consider a class of doubly weighted rank-based estimating methods for the transformation (or accelerated failure time) model with missing data as arise, for example, in case-cohort studies. The weights considered may not be predictable…

Statistics Theory · Mathematics 2009-08-24 Bin Nan , John D. Kalbfleisch , Menggang Yu

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

In the statistical inference for long range dependent time series the shape of the limit distribution typically depends on unknown parameters. Therefore, we propose to use subsampling. We show the validity of subsampling for general…

Statistics Theory · Mathematics 2016-10-20 Annika Betken , Martin Wendler

Designing a covariance function that represents the underlying correlation is a crucial step in modeling complex natural systems, such as climate models. Geospatial datasets at a global scale usually suffer from non-stationarity and…

Machine Learning · Statistics 2015-07-10 Chintan A. Dalal , Vladimir Pavlovic , Robert E. Kopp

We consider a general class of statistical experiments, in which an $n$-dimensional centered Gaussian random variable is observed and its covariance matrix is the parameter of interest. The covariance matrix is assumed to be…

Statistics Theory · Mathematics 2025-01-17 Cristina Butucea , Alexander Meister , Angelika Rohde

Current statistics literature on statistical inference of random fields typically assumes that the fields are stationary or focuses on models of non-stationary Gaussian fields with parametric/semiparametric covariance families, which may…

Statistics Theory · Mathematics 2024-09-04 Yunyi Zhang , Zhou Zhou
‹ Prev 1 8 9 10 Next ›