English
Related papers

Related papers: 1-Bit Matrix Completion under Exact Low-Rank Const…

200 papers

Recent work established that rank overparameterization eliminates spurious local minima in nonconvex low-rank matrix recovery under the restricted isometry property (RIP). But this does not fully explain the practical success of…

Optimization and Control · Mathematics 2025-05-07 Richard Y. Zhang

In this paper, we consider the streaming memory-limited matrix completion problem when the observed entries are noisy versions of a small random fraction of the original entries. We are interested in scenarios where the matrix size is very…

Spectral Theory · Mathematics 2015-04-14 Se-Young Yun , Marc Lelarge , Alexandre Proutiere

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low…

Machine Learning · Statistics 2012-08-09 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

In this paper we consider the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We establish for the nuclear-norm penalized estimator of…

Statistics Theory · Mathematics 2011-10-26 Karim Lounici

Matrix completion is a class of machine learning methods that concerns the prediction of missing entries in a partially observed matrix. This paper studies matrix completion for mixed data, i.e., data involving mixed types of variables…

Machine Learning · Statistics 2022-11-18 Yunxiao Chen , Xiaoou Li

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

This paper studies the problem of deterministic rank-one matrix completion. It is known that the simplest semidefinite programming relaxation, involving minimization of the nuclear norm, does not in general return the solution for this…

Numerical Analysis · Mathematics 2018-01-03 Augustin Cosse , Laurent Demanet

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon

We give the first algorithm for Matrix Completion whose running time and sample complexity is polynomial in the rank of the unknown target matrix, linear in the dimension of the matrix, and logarithmic in the condition number of the matrix.…

Machine Learning · Computer Science 2014-07-16 Moritz Hardt , Mary Wootters

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

Matrix rank minimization problems are gaining a plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In…

Optimization and Control · Mathematics 2010-10-06 Yun-Bin Zhao

This paper proposes a new method for solving the well-known rank aggregation problem from pairwise comparisons using the method of low-rank matrix completion. The partial and noisy data of pairwise comparisons is transformed into a matrix…

Machine Learning · Statistics 2018-06-15 Tal Levy , Alireza Vahid , Raja Giryes

In this paper, we introduce a powerful technique based on Leave-one-out analysis to the study of low-rank matrix completion problems. Using this technique, we develop a general approach for obtaining fine-grained, entrywise bounds for…

Machine Learning · Statistics 2020-06-18 Lijun Ding , Yudong Chen

In this work, we present an efficient rank-compression approach for the classical simulation of Kraus decoherence channels in noisy quantum circuits. The approximation is achieved through iterative compression of the density matrix based on…

Quantum Physics · Physics 2020-09-16 Yi-Ting Chen , Collin Farquhar , Robert M. Parrish

The matrix rank minimization problem has applications in many fields such as system identification, optimal control, low-dimensional embedding, etc. As this problem is NP-hard in general, its convex relaxation, the nuclear norm minimization…

Optimization and Control · Mathematics 2011-01-04 Donald Goldfarb , Shiqian Ma

Matrix completion algorithms recover a low rank matrix from a small fraction of the entries, each entry contaminated with additive errors. In practice, the singular vectors and singular values of the low rank matrix play a pivotal role for…

Methodology · Statistics 2016-05-03 Juhee Cho , Donggyu Kim , Karl Rohe

The essence of distantly supervised relation extraction is that it is an incomplete multi-label classification problem with sparse and noisy features. To tackle the sparsity and noise challenges, we propose solving the classification…

Computation and Language · Computer Science 2014-11-18 Miao Fan , Deli Zhao , Qiang Zhou , Zhiyuan Liu , Thomas Fang Zheng , Edward Y. Chang

Matrix learning is at the core of many machine learning problems. A number of real-world applications such as collaborative filtering and text mining can be formulated as a low-rank matrix completion problem, which recovers incomplete…

Machine Learning · Computer Science 2021-02-23 Yaqing Wang , Quanming Yao , James T. Kwok

The problem of low rank approximation is ubiquitous in science. Traditionally this problem is solved in unitary invariant norms such as Frobenius or spectral norm due to existence of efficient methods for building approximations. However,…

Numerical Analysis · Mathematics 2023-08-25 Stanislav Morozov , Matvey Smirnov , Nikolai Zamarashkin