English
Related papers

Related papers: Nonlinear matrix recovery using optimization on th…

200 papers

In this paper, we consider a class of nonconvex-linear minimax problems on Riemannian manifolds, which find wide applications in machine learning and signal processing. For solving this class of problems, we develop a flexible Riemannian…

Optimization and Control · Mathematics 2026-02-12 Meng Xu , Bo Jiang , Ya-Feng Liu , Anthony Man-Cho So

We propose a general modeling and algorithmic framework for discrete structure recovery that can be applied to a wide range of problems. Under this framework, we are able to study the recovery of clustering labels, ranks of players, signs…

Statistics Theory · Mathematics 2020-09-29 Chao Gao , Anderson Y. Zhang

We consider the problem of robust matrix completion, which aims to recover a low rank matrix $L_*$ and a sparse matrix $S_*$ from incomplete observations of their sum $M=L_*+S_*\in\mathbb{R}^{m\times n}$. Algorithmically, the robust matrix…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

Large-scale optimization problems arising from the discretization of problems involving PDEs sometimes admit solutions that can be well approximated by low-rank matrices. In this paper, we will exploit this low-rank approximation property…

Numerical Analysis · Mathematics 2024-05-01 Marco Sutti , Bart Vandereycken

Robust low-rank matrix completion (RMC), or robust principal component analysis with partially observed data, has been studied extensively for computer vision, signal processing and machine learning applications. This problem aims to…

Machine Learning · Computer Science 2021-06-09 Minhui Huang , Shiqian Ma , Lifeng Lai

We introduce an adaptive structured low rank algorithm to recover MR images from their undersampled Fourier coefficients. The image is modeled as a combination of a piecewise constant component and a piecewise linear component. The Fourier…

Image and Video Processing · Electrical Eng. & Systems 2018-05-15 Yue Hu , Xiaohan Liu , Mathews Jacob

We analyze alternating minimization for column space recovery of a partially observed, approximately low rank matrix with a growing number of columns and a fixed budget of observations per column. In this work, we prove that if the budget…

Machine Learning · Computer Science 2021-05-18 Carolyn Kim , Mohsen Bayati

The problem of low-rank matrix completion has recently generated a lot of interest leading to several results that offer exact solutions to the problem. However, in order to do so, these methods make assumptions that can be quite…

Machine Learning · Statistics 2014-07-14 Srinadh Bhojanapalli , Prateek Jain

Recent work in the matrix completion literature has shown that prior knowledge of a matrix's row and column spaces can be successfully incorporated into reconstruction programs to substantially benefit matrix recovery. This paper proposes a…

Information Theory · Computer Science 2025-09-10 Oscar López

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the…

Statistics Theory · Mathematics 2021-05-06 Yunhua Xiang , Tianyu Zhang , Xu Wang , Ali Shojaie , Noah Simon

We propose an extremely versatile approach to address a large family of matrix nearness problems, possibly with additional linear constraints. Our method is based on splitting a matrix nearness problem into two nested optimization problems,…

Numerical Analysis · Mathematics 2025-08-14 Miryam Gnazzo , Vanni Noferini , Lauri Nyman , Federico Poloni

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

We consider the problem of recovering a complete (i.e., square and invertible) matrix $\mathbf A_0$, from $\mathbf Y \in \mathbb{R}^{n \times p}$ with $\mathbf Y = \mathbf A_0 \mathbf X_0$, provided $\mathbf X_0$ is sufficiently sparse.…

Information Theory · Computer Science 2017-01-20 Ju Sun , Qing Qu , John Wright

We consider the recovery of a continuous domain piecewise constant image from its non-uniform Fourier samples using a convex matrix completion algorithm. We assume the discontinuities/edges of the image are localized to the zero levelset of…

Information Theory · Computer Science 2018-02-14 Greg Ongie , Sampurna Biswas , Mathews Jacob

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

We revisit the problem of recovering a low-rank positive semidefinite matrix from rank-one projections using tools from optimal transport. More specifically, we show that a variational formulation of this problem is equivalent to computing…

Optimization and Control · Mathematics 2022-10-27 Tyler Maunu , Thibaut Le Gouic , Philippe Rigollet

This article focuses on the problem of reconstructing low-rank matrices from underdetermined measurements using alternating optimization strategies. We endeavour to combine an alternating least-squares based estimation strategy with ideas…

Statistics Theory · Mathematics 2014-07-15 Kezhi Li , Martin Sundin , Cristian R. Rojas , Saikat Chatterjee , Magnus Jansson

In this paper we study nonconvex and nonsmooth multi-block optimization over Riemannian manifolds with coupled linear constraints. Such optimization problems naturally arise from machine learning, statistical learning, compressive sensing,…

Optimization and Control · Mathematics 2017-10-09 Junyu Zhang , Shiqian Ma , Shuzhong Zhang

This paper considers the optimization problem in the form of $\min_{X \in \mathcal{F}_v} f(x) + \lambda \|X\|_1,$ where $f$ is smooth, $\mathcal{F}_v = \{X \in \mathbb{R}^{n \times q} : X^T X = I_q, v \in \mathrm{span}(X)\}$, and $v$ is a…

Optimization and Control · Mathematics 2023-07-21 Wen Huang , Meng Wei , Kyle A. Gallivan , Paul Van Dooren

Subspace learning and matrix factorization problems have great many applications in science and engineering, and efficient algorithms are critical as dataset sizes continue to grow. Many relevant problem formulations are non-convex, and in…

Numerical Analysis · Computer Science 2022-02-22 Dejiao Zhang , Laura Balzano