English
Related papers

Related papers: Inductive Matrix Completion: No Bad Local Minima a…

200 papers

Matrix completion is a well-studied problem with many machine learning applications. In practice, the problem is often solved by non-convex optimization algorithms. However, the current theoretical analysis for non-convex algorithms relies…

Machine Learning · Computer Science 2018-09-11 Yu Cheng , Rong Ge

A new message-passing (MP) method is considered for the matrix completion problem associated with recommender systems. We attack the problem using a (generative) factor graph model that is related to a probabilistic low-rank matrix…

Information Theory · Computer Science 2010-07-06 Byung-Hak Kim , Arvind Yedla , Henry D. Pfister

Matrix completion, i.e., the exact and provable recovery of a low-rank matrix from a small subset of its elements, is currently only known to be possible if the matrix satisfies a restrictive structural constraint---known as {\em…

Machine Learning · Statistics 2014-07-22 Yudong Chen , Srinadh Bhojanapalli , Sujay Sanghavi , Rachel Ward

Matrix completion aims to recover an unknown low-rank matrix from a small subset of its entries. In many applications, the rank of the unknown target matrix is known in advance. In this paper, first we revisit a recently proposed rank-based…

Optimization and Control · Mathematics 2024-06-11 Tacildo de Souza Araújo , Douglas S. Gonçalves , Cristiano Torezzan

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

We solve the Matrix Completion (MC) problem based on manifold optimization by incorporating the side information under which the columns of the intended matrix are drawn from a union of low dimensional subspaces. It is proved that this side…

Optimization and Control · Mathematics 2019-08-20 Mohamad Mahdi Mohades , Mohammad Hossein Kahaei

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

Optimization and Control · Mathematics 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

This paper addresses the problem of finding the closest generalized essential matrix from a given $6\times 6$ matrix, with respect to the Frobenius norm. To the best of our knowledge, this nonlinear constrained optimization problem has not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pedro Miraldo , Joao R. Cardoso

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

Machine Learning · Statistics 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as both an iteratively reweighted least squares (IRLS) algorithm and a saddle-escaping smoothing Newton method applied to a non-convex rank surrogate…

Optimization and Control · Mathematics 2020-09-08 Christian Kümmerle , Claudio M. Verdun

This paper is concerned with low-rank matrix optimization, which has found a wide range of applications in machine learning. This problem in the special case of matrix sensing has been studied extensively through the notion of Restricted…

Optimization and Control · Mathematics 2023-03-17 Ziye Ma , Somayeh Sojoudi

In this paper we consider the low-rank matrix completion problem with specific application to forecasting in time series analysis. Briefly, the low-rank matrix completion problem is the problem of imputing missing values of a matrix under a…

Methodology · Statistics 2018-02-23 Jonathan Gillard , Konstantin Usevich

We describe the Simple Greedy Matrix Completion Algorithm providing an efficient method for restoration of low-rank matrices from incomplete corrupted entries. We provide numerical evidences that, even in the simplest implementation, the…

Numerical Analysis · Mathematics 2013-04-16 Alexander Petukhov , Inna Kozlov

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

Matrix completion tackles the task of predicting missing values in a low-rank matrix based on a sparse set of observed entries. It is often assumed that the observation pattern is generated uniformly at random or has a very specific…

Machine Learning · Statistics 2025-03-18 Yudong Chen , Xumei Xi , Christina Lee Yu

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

When the linear measurements of an instance of low-rank matrix recovery satisfy a restricted isometry property (RIP)---i.e. they are approximately norm-preserving---the problem is known to contain no spurious local minima, so exact recovery…

Machine Learning · Computer Science 2018-11-01 Richard Y. Zhang , Cédric Josz , Somayeh Sojoudi , Javad Lavaei

In this paper we develop a new framework that captures the common landscape underlying the common non-convex low-rank matrix problems including matrix sensing, matrix completion and robust PCA. In particular, we show for all above problems…

Machine Learning · Computer Science 2017-04-04 Rong Ge , Chi Jin , Yi Zheng

In this paper, we study a general low-rank matrix recovery problem with linear measurements corrupted by some noise. The objective is to understand under what conditions on the restricted isometry property (RIP) of the problem local search…

Optimization and Control · Mathematics 2023-07-26 Ziye Ma , Yingjie Bi , Javad Lavaei , Somayeh Sojoudi

Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are…

Numerical Analysis · Mathematics 2020-12-15 Antonio Fazzi , Nicola Guglielmi , Ivan Markovsky