English
Related papers

Related papers: A large covariance matrix estimator under intermed…

200 papers

We describe an algorithm for sampling a low-rank random matrix $Q$ that best approximates a fixed target matrix $P\in\mathbb{C}^{n\times m}$ in the following sense: $Q$ is unbiased, i.e., $\mathbb{E}[Q] = P$; $\mathsf{rank}(Q)\leq r$; and…

Data Structures and Algorithms · Computer Science 2026-03-18 Leighton Pate Barnes , Stephen Cameron , Benjamin Howard

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

The sparse inverse covariance estimation problem is commonly solved using an $\ell_{1}$-regularized Gaussian maximum likelihood estimator known as "graphical lasso", but its computational cost becomes prohibitive for large data sets. A…

Machine Learning · Statistics 2018-06-08 Richard Y. Zhang , Salar Fattahi , Somayeh Sojoudi

For data with high-dimensional covariates but small to moderate sample sizes, the analysis of single datasets often generates unsatisfactory results. The integrative analysis of multiple independent datasets provides an effective way of…

Methodology · Statistics 2015-01-19 Yuan Huang , Qingzhao Zhang , Sanguo Zhang , Jian Huang , Shuangge Ma

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

Sparse additive models are families of $d$-variate functions that have the additive decomposition $f^* = \sum_{j \in S} f^*_j$, where $S$ is an unknown subset of cardinality $s \ll d$. In this paper, we consider the case where each…

Statistics Theory · Mathematics 2011-12-20 Garvesh Raskutti , Martin J. Wainwright , Bin Yu

This paper studies the principal component (PC) method-based estimation of weak factor models with sparse loadings. We uncover an intrinsic near-sparsity preservation property for the PC estimators of loadings, which comes from the…

Econometrics · Economics 2024-11-08 Jie Wei , Yonghui Zhang

The low-rank matrix reconstruction (LRMR) approach is widely used in direction-of-arrival (DOA) estimation. As the rank norm penalty in an LRMR is NP-hard to compute, the nuclear norm (or the trace norm for a positive semidefinite (PSD)…

Information Theory · Computer Science 2017-12-07 Xiaohuan Wu , Wei-Ping Zhu , Jun Yan

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

Machine Learning · Statistics 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos

We study the meta-learning for support (i.e. the set of non-zero entries) recovery in high-dimensional Principal Component Analysis. We reduce the sufficient sample complexity in a novel task with the information that is learned from…

Machine Learning · Statistics 2022-08-22 Imon Banerjee , Jean Honorio

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

Machine Learning · Statistics 2021-09-23 Antoine Dedieu

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

We propose a flexible dual functional factor model for modelling high-dimensional functional time series. In this model, a high-dimensional fully functional factor parametrisation is imposed on the observed functional processes, whereas a…

Econometrics · Economics 2024-01-15 Chenlei Leng , Degui Li , Hanlin Shang , Yingcun Xia
‹ Prev 1 8 9 10 Next ›