English
Related papers

Related papers: Convergence and Fluctuations of Regularized Tyler …

200 papers

Diffusion models trained on different, non-overlapping subsets of a dataset often produce strikingly similar outputs when given the same noise seed. We trace this consistency to a simple linear effect: the shared Gaussian statistics across…

Machine Learning · Computer Science 2026-02-04 Binxu Wang , Jacob Zavatone-Veth , Cengiz Pehlevan

In this work, we study the positive definiteness (PDness) problem in covariance matrix estimation. For high dimensional data, many regularized estimators are proposed under structural assumptions on the true covariance matrix including…

Methodology · Statistics 2019-04-16 Young-Geun Choi , Johan Lim , Anindya Roy , Junyong Park

In constrained stochastic optimization, one naturally expects that imposing a stricter feasible set does not increase the statistical risk of an estimator defined by projection onto that set. In this paper, we show that this intuition can…

Statistics Theory · Mathematics 2026-01-23 Omar Al-Ghattas

This paper studies large $N$ and large $T$ conditional quantile panel data models with interactive fixed effects. We propose a nuclear norm penalized estimator of the coefficients on the covariates and the low-rank matrix formed by the…

Econometrics · Economics 2021-03-17 Junlong Feng

This paper establishes non-asymptotic convergence of the cutoffs in Random serial dictatorship in an environment with many students, many schools, and arbitrary student preferences. Convergence is shown to hold when the number of schools,…

Theoretical Economics · Economics 2026-05-26 Suhas Vijaykumar

The traditional class of elliptical distributions is extended to allow for asymmetries. A completely robust dispersion matrix estimator (the `spectral estimator') for the new class of `generalized elliptical distributions' is presented. It…

Physics and Society · Physics 2007-05-23 Gabriel Frahm , Uwe Jaekel

In this article, we study the fluctuations of the random variable: $$ {\mathcal I}_n(\rho) = \frac 1N \log\det(\Sigma_n \Sigma_n^* + \rho I_N),\quad (\rho>0) $$ where $\Sigma_n= n^{-1/2} D_n^{1/2} X_n\tilde D_n^{1/2} +A_n$, as the…

Probability · Mathematics 2011-07-04 Walid Hachem , Malika Kharouf , Jamal Najim , Jack W. Silverstein

The Eigenstate Thermalization Hypothesis (ETH) was developed as a framework for understanding how the principles of statistical mechanics emerge in the long-time limit of isolated quantum many-body systems. Since then, ETH has shifted the…

Statistical Mechanics · Physics 2025-12-01 Elisa Vallini , Laura Foini , Silvia Pappalardi

Estimation of the Average Treatment Effect (ATE) is often carried out in 2 steps, wherein the first step, the treatment and outcome are modeled, and in the second step the predictions are inserted into the ATE estimator. In the first steps,…

Methodology · Statistics 2023-07-21 Mehdi Rostami , Olli Saarela

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based…

Machine Learning · Statistics 2015-04-24 Martin Slawski , Ping Li , Matthias Hein

Consider a deterministic self-adjoint matrix X_n with spectral measure converging to a compactly supported probability measure, the largest and smallest eigenvalues converging to the edges of the limiting measure. We perturb this matrix by…

Probability · Mathematics 2011-09-05 Florent Benaych-Georges , Alice Guionnet , Mylène Maïda

The comovement phenomenon in financial markets creates decision scenarios with positively correlated asset returns. This paper addresses covariance matrix estimation under such conditions, motivated by observations of significant positive…

Econometrics · Economics 2025-07-03 Weilong Liu , Yanchu Liu

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

Non-asymptotic theory of random matrices strives to investigate the spectral properties of random matrices, which are valid with high probability for matrices of a large fixed size. Results obtained in this framework find their applications…

Probability · Mathematics 2013-08-02 Mark Rudelson

Regularized estimators in the context of group variables have been applied successfully in model and feature selection in order to preserve interpretability. We formulate a Distributionally Robust Optimization (DRO) problem which recovers…

Statistics Theory · Mathematics 2017-05-12 Jose Blanchet , Yang Kang

In this paper, we consider directly estimating the eigenvalues of precision matrix, without inverting the corresponding estimator for the eigenvalues of covariance matrix. We focus on a general asymptotic regime, i.e., the large dimensional…

Statistics Theory · Mathematics 2025-09-22 Jie Zhou , Junhao Xie , Jiaqi Chen

We investigate the fluctuations of linear spectral statistics of a Wigner matrix $W\_N$ deformed by a deterministic diagonal perturbation $D\_N$, around a deterministic equivalent which can be expressed in terms of the free convolution…

Probability · Mathematics 2020-03-17 Sandrine Dallaporta , Maxime Fevrier