English
Related papers

Related papers: Guaranteed Rank Minimization via Singular Value Pr…

200 papers

Color images and video sequences can be modeled as three-way tensors, which admit low tubal-rank approximations via convex surrogate minimization. This optimization problem is efficiently addressed by tensor singular value thresholding…

Numerical Analysis · Mathematics 2025-08-13 Qiaohua Liu , Jiehui Gu

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

We present a theoretical and empirical analysis of the SyncRank algorithm for recovering a global ranking from noisy pairwise comparisons. By adopting a complex-valued data model where the true ranking is encoded in the phases of a…

Machine Learning · Statistics 2025-09-30 Yang Rao

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

Low-rank and nonsmooth matrix optimization problems capture many fundamental tasks in statistics and machine learning. While significant progress has been made in recent years in developing efficient methods for \textit{smooth} low-rank…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained using a thresholding…

Numerical Analysis · Computer Science 2017-04-13 Nematollah Zarmehi , Farokh Marvasti

We study the role of the constraint set in determining the solution to low-rank, positive semidefinite (PSD) matrix sensing problems. The setting we consider involves rank-one sensing matrices: In particular, given a set of rank-one…

Machine Learning · Statistics 2021-04-07 T. Mitchell Roddenberry , Santiago Segarra , Anastasios Kyrillidis

Truncated singular value decomposition (SVD), also known as the best low-rank matrix approximation, has been successfully applied to many domains such as biology, healthcare, and others, where high-dimensional datasets are prevalent. To…

Optimization and Control · Mathematics 2022-08-09 Yongchun Li , Weijun Xie

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou

Matrix rank minimizing subject to affine constraints arises in many application areas, ranging from signal processing to machine learning. Nuclear norm is a convex relaxation for this problem which can recover the rank exactly under some…

Computer Vision and Pattern Recognition · Computer Science 2015-08-20 Zhao Kang , Chong Peng , Qiang Cheng

This paper considers the problem of finding a low rank matrix from observations of linear combinations of its elements. It is well known that if the problem fulfills a restricted isometry property (RIP), convex relaxations using the nuclear…

Optimization and Control · Mathematics 2017-11-13 Carl Olsson , Marcus Carlsson , Erik Bylow

We introduce a "learning-based" algorithm for the low-rank decomposition problem: given an $n \times d$ matrix $A$, and a parameter $k$, compute a rank-$k$ matrix $A'$ that minimizes the approximation loss $\|A-A'\|_F$. The algorithm uses a…

Machine Learning · Computer Science 2019-10-31 Piotr Indyk , Ali Vakilian , Yang Yuan

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Computer Science 2014-08-12 David Wipf

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Statistics 2012-07-11 David Wipf

We consider the problem of noisy 1-bit matrix completion under an exact rank constraint on the true underlying matrix $M^*$. Instead of observing a subset of the noisy continuous-valued entries of a matrix $M^*$, we observe a subset of…

Machine Learning · Statistics 2015-02-25 Sonia Bhaskar , Adel Javanmard

The goal of this paper is to develop a novel numerical method for efficient multiplicative noise removal. The nonlocal self-similarity of natural images implies that the matrices formed by their nonlocal similar patches are low-rank. By…

Optimization and Control · Mathematics 2020-02-19 Xiaoxia Liu , Jian Lu , Lixin Shen , Chen Xu , Yuesheng Xu

We consider the precedence-constrained scheduling problem to minimize the total weighted completion time. For a single machine several $2$-approximation algorithms are known, which are based on linear programming and network flows. We show…

Data Structures and Algorithms · Computer Science 2023-09-22 Sven Jäger , Philipp Warode

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

Machine Learning · Statistics 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos