English
Related papers

Related papers: Convergence and Fluctuations of Regularized Tyler …

200 papers

This paper investigates the asymptotic properties of quantile regression estimators in linear models, with a particular focus on polynomial regressors and robustness to heavy-tailed noise. Under independent and identically distributed…

Statistics Theory · Mathematics 2025-06-09 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

For the high-dimensional covariance estimation problem, when $\lim_{n\to \infty}p/n=c \in (0,1)$ the orthogonally equivariant estimator of the population covariance matrix proposed by Tsai and Tsai (2024b) enjoys some optimal properties.…

Statistics Theory · Mathematics 2024-11-05 Ming-Tien Tsai , Chia-Hsian Tsai

Objectives: Highly flexible nonparametric estimators have gained popularity in causal inference and epidemiology. Popular examples of such estimators include targeted maximum likelihood estimators (TMLE) and double machine learning (DML).…

Methodology · Statistics 2024-08-20 Hongxiang Qiu

The extreme value dependence of regularly varying stationary time series can be described by the spectral tail process. Drees, Segers and Warchol [Extremes 18(3): 369--402, 2015] proposed estimators of the marginal distributions of this…

Statistics Theory · Mathematics 2019-07-23 Holger Drees , Miran Knezevic

The goal of this paper is to develop distributionally robust optimization (DRO) estimators, specifically for multidimensional Extreme Value Theory (EVT) statistics. EVT supports using semi-parametric models called max-stable distributions…

Machine Learning · Statistics 2024-08-02 Patrick Kuiper , Ali Hasan , Wenhao Yang , Yuting Ng , Hoda Bidkhori , Jose Blanchet , Vahid Tarokh

We study the error of the number of points of a unimodular lattice that fall in a strictly convex and analytic set having the origin and that is dilated by a factor $t$. The aim is to generalize the result of a previous article. We first…

Probability · Mathematics 2022-11-08 Julien Trevisan

Deep neural networks have been shown to be highly miscalibrated. often they tend to be overconfident in their predictions. It poses a significant challenge for safety-critical systems to utilise deep neural networks (DNNs), reliably. Many…

Machine Learning · Computer Science 2022-05-05 Aditya Singh , Alessandro Bay , Biswa Sengupta , Andrea Mirabile

In this paper, we study extended linear regression approaches for quantum state tomography based on regularization techniques. For unknown quantum states represented by density matrices, performing measurements under certain basis yields…

Quantum Physics · Physics 2019-04-29 Biqiang Mu , Hongsheng Qi , Ian R. Petersen , Guodong Shi

Here we present an expository, general analysis of valid post-selection or post-regularization inference about a low-dimensional target parameter, $\alpha$, in the presence of a very high-dimensional nuisance parameter, $\eta$, which is…

Statistics Theory · Mathematics 2017-10-03 Victor Chernozhukov , Christian Hansen , Martin Spindler

This paper has two main goals: (a) establish several statistical properties---consistency, asymptotic distributions, and convergence rates---of stationary solutions and values of a class of coupled nonconvex and nonsmoothempirical risk…

Statistics Theory · Mathematics 2019-10-08 Zhengling Qi , Ying Cui , Yufeng Liu , Jong-Shi Pang

This paper addresses the challenge of Toeplitz covariance matrix estimation from partial entries of random quantized samples. To balance trade-offs among the number of samples, the number of entries observed per sample, and the data…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Hongwei Xu , Zai Yang

We consider the spectral properties of a class of regularized estimators of (large) empirical covariance matrices corresponding to stationary (but not necessarily Gaussian) sequences, obtained by banding. We prove a law of large numbers…

Probability · Mathematics 2009-01-22 Greg W. Anderson , Ofer Zeitouni

We study the distributions of the LASSO, SCAD, and thresholding estimators, in finite samples and in the large-sample limit. The asymptotic distributions are derived for both the case where the estimators are tuned to perform consistent…

Statistics Theory · Mathematics 2009-09-07 Benedikt M. Potscher , Hannes Leeb

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic…

Statistics Theory · Mathematics 2015-10-28 David Morales-Jimenez , Romain Couillet , Matthew R. McKay

This paper revisits and extends the convergence and robustness properties of value and policy iteration algorithms for discrete-time linear quadratic regulator problems. In the model-based case, we extend current results concerning the…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Bowen Song , Chenxuan Wu , Andrea Iannelli

Low-complexity non-smooth convex regularizers are routinely used to impose some structure (such as sparsity or low-rank) on the coefficients for linear predictors in supervised learning. Model consistency consists then in selecting the…

Optimization and Control · Mathematics 2019-01-17 Jalal Fadili , Guillaume Garrigos , Jérome Malick , Gabriel Peyré

We consider fully row/column-correlated linear regression models and study several classical estimators (including minimum norm interpolators (GLS), ordinary least squares (LS), and ridge regressors). We show that \emph{Random Duality…

Machine Learning · Statistics 2024-06-14 Mihailo Stojnic

R-function theory of Thomas used in study of inelastic scattering of neutrons to a definite state. Onset of fluctuations, effects of randomness of phases of interfering amplitudes, and variations in statistical distributions of neutron…

Nuclear Experiment · Physics 2010-03-16 Frank W. K. Firk

Fisher's randomization test (FRT) delivers exact $p$-values under the strong null hypothesis of no treatment effect on any units whatsoever and allows for flexible covariate adjustment to improve the power. Of interest is whether the…

Methodology · Statistics 2021-05-03 Anqi Zhao , Peng Ding