English
Related papers

Related papers: A Riemannian geometry for low-rank matrix completi…

200 papers

We consider a generalization of low-rank matrix completion to the case where the data belongs to an algebraic variety, i.e. each data point is a solution to a system of polynomial equations. In this case the original matrix is possibly…

Machine Learning · Statistics 2017-03-29 Greg Ongie , Rebecca Willett , Robert D. Nowak , Laura Balzano

Recovering a low rank matrix from a subset of its entries, some of which may be corrupted, is known as the robust matrix completion (RMC) problem. Existing RMC methods have several limitations: they require a relatively large number of…

Machine Learning · Computer Science 2025-12-16 Eilon Vaknin Laufer , Boaz Nadler

In this paper, we propose a Riemannian steepest descent method for solving a blind deconvolution problem. We prove that the proposed algorithm with an appropriate initialization will recover the exact solution with high probability when the…

Information Theory · Computer Science 2018-04-17 Wen Huang , Paul Hand

In this paper, we review the problem of matrix completion and expose its intimate relations with algebraic geometry, combinatorics and graph theory. We present the first necessary and sufficient combinatorial conditions for matrices of…

Machine Learning · Computer Science 2012-07-03 Franz Kiraly , Ryota Tomioka

We develop new algorithms for Riemannian bilevel optimization. We focus in particular on batch and stochastic gradient-based methods, with the explicit goal of avoiding second-order information such as Riemannian hyper-gradients. We propose…

Optimization and Control · Mathematics 2024-05-28 Sanchayan Dutta , Xiang Cheng , Suvrit Sra

We present a novel Riemannian approach for planar pose graph optimization problems. By formulating the cost function based on the Riemannian metric on the manifold of dual quaternions representing planar motions, the nonlinear structure of…

Robotics · Computer Science 2019-11-21 Kailai Li , Johannes Cox , Benjamin Noack , Uwe D. Hanebeck

We study a general matrix optimization problem with a fixed-rank positive semidefinite (PSD) constraint. We perform the Burer-Monteiro factorization and consider a particular Riemannian quotient geometry in a search space that has a total…

Optimization and Control · Mathematics 2022-11-30 Yuetian Luo , Nicolas Garcia Trillos

Considering orthogonal Stiefel manifolds as constraint manifolds, we give an explicit description of a set of local coordinates that also generate a basis for the tangent space in any point of the orthogonal Stiefel manifolds. We show how…

Optimization and Control · Mathematics 2018-08-28 Petre Birtea , Ioan Casu , Dan Comanescu

Matrix completion is a problem that arises in many data-analysis settings where the input consists of a partially-observed matrix (e.g., recommender systems, traffic matrix analysis etc.). Classical approaches to matrix completion assume…

Machine Learning · Computer Science 2017-05-02 Natali Ruchansky , Mark Crovella , Evimaria Terzi

We study the properties of stochastic approximation applied to a tame nondifferentiable function subject to constraints defined by a Riemannian manifold. The objective landscape of tame functions, arising in o-minimal topology extended to a…

Machine Learning · Computer Science 2025-08-13 Johannes Aspman , Vyacheslav Kungurtsev , Reza Roohi Seraji

We approach the Max-3-Cut problem through the lens of maximizing complex-valued quadratic forms and demonstrate that low-rank structure in the objective matrix can be exploited, leading to alternative algorithms to classical semidefinite…

Data Structures and Algorithms · Computer Science 2026-04-27 Ria Stevens , Fangshuo Liao , Barbara Su , Jianqiang Li , Anastasios Kyrillidis

This paper considers general rank-constrained optimization problems that minimize a general objective function $f(X)$ over the set of rectangular $n\times m$ matrices that have rank at most $r$. To tackle the rank constraint and also to…

Information Theory · Computer Science 2021-09-07 Zhihui Zhu , Qiuwei Li , Gongguo Tang , Michael B. Wakin

We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the…

Machine Learning · Statistics 2016-09-21 David Gamarnik , Sidhant Misra

Representations on the Symmetric Positive Definite (SPD) manifold have garnered significant attention across different applications. In contrast, the manifold of full-rank correlation matrices, a normalized alternative to SPD matrices,…

Machine Learning · Computer Science 2026-05-20 Ziheng Chen , Xiaojun Wu , Bernhard Schölkopf , Nicu Sebe

In this paper, we propose a low-rank coordinate descent approach to structured semidefinite programming with diagonal constraints. The approach, which we call the Mixing method, is extremely simple to implement, has no free parameters, and…

Optimization and Control · Mathematics 2026-05-12 Po-Wei Wang , Wei-Cheng Chang , J. Zico Kolter

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

In recent years, interest in gradient-based optimization over Riemannian manifolds has surged. However, a significant challenge lies in the reliance on hyperparameters, especially the learning rate, which requires meticulous tuning by…

Machine Learning · Computer Science 2024-06-05 Daniel Dodd , Louis Sharrock , Christopher Nemeth

Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in…

Machine Learning · Computer Science 2025-01-24 Fengmiao Bian , Jian-Feng Cai , Xiaoqun Zhang , Yuanwei Zhang

The task of reconstructing a low rank matrix from incomplete linear measurements arises in areas such as machine learning, quantum state tomography and in the phase retrieval problem. In this note, we study the particular setup that the…

Information Theory · Computer Science 2016-12-12 Holger Rauhut , Ulrich Terstiege