English
Related papers

Related papers: Structured Matrix Estimation and Completion

200 papers

We propose a general error analysis related to the low-rank approximation of a given real matrix in both the spectral and Frobenius norms. First, we derive deterministic error bounds that hold with some minimal assumptions. Second, we…

Numerical Analysis · Mathematics 2022-06-22 Youssef Diouane , Selime Gürol , Alexandre Scotto Di Perrotolo , Xavier Vasseur

We propose a general method for optimally approximating an arbitrary matrix $\mathbf{M}$ by a structured matrix $\mathbf{T}$ (circulant, Toeplitz/Hankel, etc.) and examine its use for estimating the spectra of genomic linkage disequilibrium…

Applications · Statistics 2024-09-10 Chris Salahub , Jeffrey Uhlmann

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

We consider the problem of linear estimation, and establish an extension of the Gauss-Markov theorem, in which the bias operator is allowed to be non-zero but bounded with respect to a matrix norm of Schatten type. We derive simple and…

Machine Learning · Computer Science 2023-11-21 Simon Segert

Completing a data matrix X has become an ubiquitous problem in modern data science, with applications in recommender systems, computer vision, and networks inference, to name a few. One typical assumption is that X is low-rank. A more…

Machine Learning · Computer Science 2018-08-03 Daniel L. Pimentel-Alarcón

Matrix completion is a classical problem in data science wherein one attempts to reconstruct a low-rank matrix while only observing some subset of the entries. Previous authors have phrased this problem as a nuclear norm minimization…

Machine Learning · Computer Science 2019-04-19 Christian Parkinson , Kevin Huynh , Deanna Needell

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

First, we extend the results of approximate matrix multiplication from the Frobenius norm to the spectral norm. Second, We develop a class of fast approximate generalized linear regression algorithms with respect to the spectral norm.…

Numerical Analysis · Computer Science 2015-11-11 Haishan Ye , Zhihua Zhang

Structured low-rank approximation is the problem of minimizing a weighted Frobenius distance to a given matrix among all matrices of fixed rank in a linear space of matrices. We study exact solutions to this problem by way of computational…

Optimization and Control · Mathematics 2017-02-23 Giorgio Ottaviani , Pierre-Jean Spaenlehauer , Bernd Sturmfels

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low…

Machine Learning · Statistics 2012-08-09 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

Estimating the matrix of connections probabilities is one of the key questions when studying sparse networks. In this work, we consider networks generated under the sparse graphon model and the in-homogeneous random graph model with missing…

Statistics Theory · Mathematics 2021-04-28 Solenne Gaucher , Olga Klopp

We obtain the optimal Bayesian minimax rate for the unconstrained large covariance matrix of multivariate normal sample with mean zero, when both the sample size, n, and the dimension, p, of the covariance matrix tend to infinity.…

Statistics Theory · Mathematics 2017-12-04 Kyoungjae Lee , Jaeyong Lee

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp

We study subset selection for matrices defined as follows: given a matrix $\matX \in \R^{n \times m}$ ($m > n$) and an oversampling parameter $k$ ($n \le k \le m$), select a subset of $k$ columns from $\matX$ such that the pseudo-inverse of…

Data Structures and Algorithms · Computer Science 2013-06-25 Haim Avron , Christos Boutsidis

This paper considers sparse spiked covariance matrix models in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of…

Statistics Theory · Mathematics 2016-03-29 Tony Cai , Zongming Ma , Yihong Wu

We consider the estimation of quadratic functionals in a Gaussian sequence model where the eigenvalues are supposed to be unknown and accessible through noisy observations only. Imposing smoothness assumptions both on the signal and the…

Statistics Theory · Mathematics 2019-07-16 Martin Kroll

A general framework based on Gaussian models and a MAP-EM algorithm is introduced in this paper for solving matrix/table completion problems. The numerical experiments with the standard and challenging movie ratings data show that the…

Machine Learning · Computer Science 2010-10-21 Flavien Léger , Guoshen Yu , Guillermo Sapiro

We consider Bayesian inference of signals with vector-valued entries. Extending concentration techniques from the mathematical physics of spin glasses, we show that the matrix-valued minimum mean-square error concentrates when the size of…

Information Theory · Computer Science 2019-07-17 Jean Barbier