English
Related papers

Related papers: Estimation of high-dimensional low-rank matrices

200 papers

The paper introduces a penalized matrix estimation procedure aiming at solutions which are sparse and low-rank at the same time. Such structures arise in the context of social networks or protein interactions where underlying graphs have…

Data Structures and Algorithms · Computer Science 2012-07-03 Emile Richard , Pierre-Andre Savalle , Nicolas Vayatis

We propose a general error analysis related to the low-rank approximation of a given real matrix in both the spectral and Frobenius norms. First, we derive deterministic error bounds that hold with some minimal assumptions. Second, we…

Numerical Analysis · Mathematics 2022-06-22 Youssef Diouane , Selime Gürol , Alexandre Scotto Di Perrotolo , Xavier Vasseur

The problem of matrix sensing, or trace regression, is a problem wherein one wishes to estimate a low-rank matrix from linear measurements perturbed with noise. A number of existing works have studied both convex and nonconvex approaches to…

Statistics Theory · Mathematics 2025-06-26 Joshua Agterberg , René Vidal

Understanding efficiency in high dimensional linear models is a longstanding problem of interest. Classical work with smaller dimensional problems dating back to Huber and Bickel has illustrated the benefits of efficient loss functions.…

Statistics Theory · Mathematics 2017-08-16 Jelena Bradic

The low-rank matrix completion problem asks whether a given real matrix with missing values can be completed so that the resulting matrix has low rank or is close to a low-rank matrix. The completed matrix is often required to satisfy…

Computational Complexity · Computer Science 2025-06-24 Dror Chawin , Ishay Haviv

Intuitively, if a density operator has small rank, then it should be easier to estimate from experimental data, since in this case only a few eigenvectors need to be learned. We prove two complementary results that confirm this intuition.…

Quantum Physics · Physics 2012-10-18 Steven T. Flammia , David Gross , Yi-Kai Liu , Jens Eisert

We study matrix estimation problems arising in reinforcement learning (RL) with low-rank structure. In low-rank bandits, the matrix to be recovered specifies the expected arm rewards, and for low-rank Markov Decision Processes (MDPs), it…

Machine Learning · Computer Science 2023-10-31 Stefan Stojanovic , Yassir Jedra , Alexandre Proutiere

We extend the theory of low-rank matrix recovery and completion to the case when Poisson observations for a linear combination or a subset of the entries of a matrix are available, which arises in various applications with count data. We…

Machine Learning · Computer Science 2016-04-20 Yang Cao , Yao Xie

The estimation of high dimensional quantum states is an important statistical problem arising in current quantum technology applications. A key example is the tomography of multiple ions states, employed in the validation of state…

Quantum Physics · Physics 2015-12-09 Cristina Butucea , Madalin Guta , Theodore Kypraios

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

In this letter, we study the deterministic sampling patterns for the completion of low rank matrix, when corrupted with a sparse noise, also known as robust matrix completion. We extend the recent results on the deterministic sampling…

Information Theory · Computer Science 2018-03-14 Morteza Ashraphijuo , Vaneet Aggarwal , Xiaodong Wang

This paper gives two theoretical results on estimating low-rank parameter matrices for linear models with multivariate responses. We first focus on robust parameter estimation of low-rank multi-task learning with heavy-tailed data and…

Statistics Theory · Mathematics 2023-05-24 Kangqiang Li , Yuxuan Wang

The problem of completing a large matrix with lots of missing entries has received widespread attention in the last couple of decades. Two popular approaches to the matrix completion problem are based on singular value thresholding and…

Statistics Theory · Mathematics 2022-04-25 Sohom Bhattacharya , Sourav Chatterjee

Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion…

Machine Learning · Statistics 2020-03-23 Xiaojun Mao , Raymond K. W. Wong , Song Xi Chen

As network data has become ubiquitous in the sciences, there has been growing interest in network models whose structure is driven by latent node-level variables in a (typically low-dimensional) latent geometric space. These "latent…

Statistics Theory · Mathematics 2026-01-12 Roddy Taing , Keith Levin

Many real-world data sets are sparse or almost sparse. One method to measure this for a matrix $A\in \mathbb{R}^{n\times n}$ is the \emph{numerical sparsity}, denoted $\mathsf{ns}(A)$, defined as the minimum $k\geq 1$ such that…

Data Structures and Algorithms · Computer Science 2021-07-06 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Shay Sapir

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

We study a panel data model with general heterogeneous effects where slopes are allowed to vary across both individuals and over time. The key dimension reduction assumption we employ is that the heterogeneous slopes can be expressed as…

Statistics Theory · Mathematics 2019-09-05 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

This paper examines a general class of noisy matrix completion tasks where the goal is to estimate a matrix from observations obtained at a subset of its entries, each of which is subject to random noise or corruption. Our specific focus is…

Machine Learning · Statistics 2016-11-18 Akshay Soni , Swayambhoo Jain , Jarvis Haupt , Stefano Gonella

The Schatten quasi-norm can be used to bridge the gap between the nuclear norm and rank function, and is the tighter approximation to matrix rank. However, most existing Schatten quasi-norm minimization (SQNM) algorithms, as well as for…

Information Theory · Computer Science 2016-11-29 Fanhua Shang , Yuanyuan Liu , James Cheng