English
Related papers

Related papers: Understanding Alternating Minimization for Matrix …

200 papers

We consider the problem of reconstructing a rank-$k$ $n \times n$ matrix $M$ from a sampling of its entries. Under a certain incoherence assumption on $M$ and for the case when both the rank and the condition number of $M$ are bounded, it…

Machine Learning · Statistics 2017-08-23 David Gamarnik , Quan Li , Hongyi Zhang

Low-rank Matrix Completion (LRMC) describes the problem where we wish to recover missing entries of partially observed low-rank matrix. Most existing matrix completion work deals with sampling procedures that are independent of the…

Machine Learning · Computer Science 2025-04-15 Rishhabh Naik , Nisarg Trivedi , Davoud Ataee Tarzanagh , Laura Balzano

Low rank model arises from a wide range of applications, including machine learning, signal processing, computer algebra, computer vision, and imaging science. Low rank matrix recovery is about reconstructing a low rank matrix from…

Numerical Analysis · Mathematics 2018-09-12 Jian-Feng Cai , Ke Wei

In this paper, the problem of matrix rank minimization under affine constraints is addressed. The state-of-the-art algorithms can recover matrices with a rank much less than what is sufficient for the uniqueness of the solution of this…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Arash Amini , Christian Jutten

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

We propose a new Iteratively Reweighted Least Squares (IRLS) algorithm for the problem of completing or denoising low-rank matrices that are structured, e.g., that possess a Hankel, Toeplitz or block-Hankel/Toeplitz structure. The algorithm…

Optimization and Control · Mathematics 2018-12-06 Christian Kümmerle , Claudio Mayrink Verdun

The affine rank minimization problem consists of finding a matrix of minimum rank that satisfies a given system of linear equality constraints. Such problems have appeared in the literature of a diverse set of fields including system…

Optimization and Control · Mathematics 2010-08-09 Benjamin Recht , Maryam Fazel , Pablo A. Parrilo

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

Using the matrix product state (MPS) representation of tensor train decompositions, in this paper we propose a tensor completion algorithm which alternates over the matrices (tensors) in the MPS representation. This development is motivated…

Numerical Analysis · Computer Science 2016-10-03 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

In this paper, we introduce a novel and robust approach to Quantized Matrix Completion (QMC). First, we propose a rank minimization problem with constraints induced by quantization bounds. Next, we form an unconstrained optimization problem…

Machine Learning · Statistics 2019-02-20 Ashkan Esmaeili , Farokh Marvasti

We propose Matrix ALPS for recovering a sparse plus low-rank decomposition of a matrix given its corrupted and incomplete linear measurements. Our approach is a first-order projected gradient method over non-convex sets, and it exploits a…

Information Theory · Computer Science 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

The Nystrom method is an efficient technique to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

Artificial Intelligence · Computer Science 2010-04-13 Ameet Talwalkar , Afshin Rostamizadeh

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as both an iteratively reweighted least squares (IRLS) algorithm and a saddle-escaping smoothing Newton method applied to a non-convex rank surrogate…

Optimization and Control · Mathematics 2020-09-08 Christian Kümmerle , Claudio M. Verdun

Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations.…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Pontus Giselsson

This paper addresses the problem of finding the closest generalized essential matrix from a given $6\times 6$ matrix, with respect to the Frobenius norm. To the best of our knowledge, this nonlinear constrained optimization problem has not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pedro Miraldo , Joao R. Cardoso

In this paper, we propose an efficient and scalable low rank matrix completion algorithm. The key idea is to extend orthogonal matching pursuit method from the vector case to the matrix case. We further propose an economic version of our…

Machine Learning · Computer Science 2014-04-17 Zheng Wang , Ming-Jun Lai , Zhaosong Lu , Wei Fan , Hasan Davulcu , Jieping Ye

The problem of low-rank matrix completion has recently generated a lot of interest leading to several results that offer exact solutions to the problem. However, in order to do so, these methods make assumptions that can be quite…

Machine Learning · Statistics 2014-07-14 Srinadh Bhojanapalli , Prateek Jain

This paper considers the recovery of a low-rank matrix from an observed version that simultaneously contains both (a) erasures: most entries are not observed, and (b) errors: values at a constant fraction of (unknown) locations are…

Information Theory · Computer Science 2013-09-23 Yudong Chen , Ali Jalali , Sujay Sanghavi , Constantine Caramanis

We extend the theory of low-rank matrix recovery and completion to the case when Poisson observations for a linear combination or a subset of the entries of a matrix are available, which arises in various applications with count data. We…

Machine Learning · Computer Science 2016-04-20 Yang Cao , Yao Xie

In this paper, we study first-order methods on a large variety of low-rank matrix optimization problems, whose solutions only live in a low dimensional eigenspace. Traditional first-order methods depend on the eigenvalue decomposition at…

Optimization and Control · Mathematics 2019-04-25 Yongfeng Li , Haoyang Liu , Zaiwen Wen , Yaxiang Yuan