English
Related papers

Related papers: Local Laws for Sparse Sample Covariance Matrices w…

200 papers

This paper studies the sparsistency and rates of convergence for estimating sparse covariance and precision matrices based on penalized likelihood with nonconvex penalty functions. Here, sparsistency refers to the property that all…

Statistics Theory · Mathematics 2009-11-20 Clifford Lam , Jianqing Fan

We propose a novel estimation approach for the covariance matrix based on the $l_1$-regularized approximate factor model. Our sparse approximate factor (SAF) covariance estimator allows for the existence of weak factors and hence relaxes…

Econometrics · Economics 2019-06-14 Maurizio Daniele , Winfried Pohlmeier , Aygul Zagidullina

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$…

Computation · Statistics 2018-11-13 Ofer Shwartz , Boaz Nadler

We prove an algorithmic regularity lemma for $L_p$ regular matrices $(1 < p \leq \infty),$ a class of sparse $\{0,1\}$ matrices which obey a natural pseudorandomness condition. This extends a result of Coja-Oghlan, Cooper and Frieze who…

Combinatorics · Mathematics 2017-05-19 Thodoris Karageorgos , Silouanos Brazitikos

The circular law asserts that the empirical distribution of eigenvalues of appropriately normalized $n\times n$ matrix with i.i.d. entries converges to the uniform measure on the unit disc as the dimension $n$ grows to infinity. Consider an…

Probability · Mathematics 2019-03-05 Mark Rudelson , Konstantin Tikhomirov

Given a matrix A \in R^{m x n}, we present a randomized algorithm that sparsifies A by retaining some of its elements by sampling them according to a distribution that depends on both the square and the absolute value of the entries. We…

Information Theory · Computer Science 2014-04-02 Abhisek Kundu , Petros Drineas

Given a sample covariance matrix, we solve a maximum likelihood problem penalized by the number of nonzero coefficients in the inverse covariance matrix. Our objective is to find a sparse representation of the sample data and to highlight…

Optimization and Control · Mathematics 2007-06-13 Alexandre d'Aspremont , Onureena Banerjee , Laurent El Ghaoui

We consider the spectral properties of sparse stochastic block models, where $N$ vertices are partitioned into $K$ balanced communities. Under an assumption that the intra-community probability and inter-community probability are of similar…

Probability · Mathematics 2019-09-26 Jong Yun Hwang , Ji Oon Lee , Wooseok Yang

For two large matrices ${\mathbf X}$ and ${\mathbf Y}$ with Gaussian i.i.d.\ entries and dimensions $T\times N_X$ and $T\times N_Y$, respectively, we derive the probability distribution of the singular values of $\mathbf{X}^T \mathbf{Y}$ in…

Statistics Theory · Mathematics 2025-08-29 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

We consider random non-normal matrices constructed by removing one row and column from samples from Dyson's circular ensembles or samples from the classical compact groups. We develop sparse matrix models whose spectral measures match these…

Probability · Mathematics 2016-06-22 Rowan Killip , Rostyslav Kozhan

In sparse principal component analysis we are given noisy observations of a low-rank matrix of dimension $n\times p$ and seek to reconstruct it under additional sparsity assumptions. In particular, we assume here each of the principal…

Statistics Theory · Mathematics 2016-04-27 Yash Deshpande , Andrea Montanari

Computational problem certificates are additional data structures for each output, which can be used by a-possibly randomized-verification algorithm that proves the correctness of each output. In this paper, we give an algorithm that…

Symbolic Computation · Computer Science 2019-12-03 Jean-Guillaume Dumas , Erich Kaltofen , Emmanuel Thomé , Gilles Villard

We consider random n\times n matrices of the form (XX*+YY*)^{-1/2}YY*(XX*+YY*)^{-1/2}, where X and Y have independent entries with zero mean and variance one. These matrices are the natural generalization of the Gaussian case, which are…

Probability · Mathematics 2015-06-05 Laszlo Erdos , Brendan Farrell

We consider complex sample covariance matrices $M_N=\frac{1}{N}YY^*$ where $Y$ is a $N \times p$ random matrix with i.i.d. entries $Y_{ij}, 1\leq i\leq N, 1\leq j \leq p$ with distribution $F$. Under some regularity and decay assumption on…

Probability · Mathematics 2011-01-05 S. Péché

For a class of symmetric random matrices whose entries are martingale differences adapted to an increasing filtration, we prove that under a Lindeberg-like condition, the empirical spectral distribution behaves asymptotically similarly to a…

Probability · Mathematics 2014-02-27 Florence Merlevède , Costel Peligrad , Magda Peligrad

This paper investigates limiting properties of eigenvalues of multivariate sample spatial-sign covariance matrices when both the number of variables and the sample size grow to infinity. The underlying p-variate populations are general…

Statistics Theory · Mathematics 2021-01-25 Weiming Li , Qinwen Wang , Jianfeng Yao , Wang Zhou

We consider products of independent square non-Hermitian random matrices. More precisely, let X(1),...,X(n) be random matrices with independent entries (real or complex with independent real and imaginary parts) with zero mean and variance…

Probability · Mathematics 2015-12-11 Yuriy Nemish

Consider a $p$-dimensional population ${\mathbf x} \in\mathbb{R}^p$ with iid coordinates in the domain of attraction of a stable distribution with index $\alpha\in (0,2)$. Since the variance of ${\mathbf x}$ is infinite, the sample…

Probability · Mathematics 2022-09-20 Johannes Heiny , Jianfeng Yao

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

Statistics Theory · Mathematics 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu