English
Related papers

Related papers: Convergence of fixed-point continuation algorithms…

200 papers

In many applications that require matrix solutions of minimal rank, the underlying cost function is non-convex leading to an intractable, NP-hard optimization problem. Consequently, the convex nuclear norm is frequently used as a surrogate…

Machine Learning · Statistics 2012-07-11 David Wipf

Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations.…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Pontus Giselsson

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

Given a limited number of entries from the superposition of a low-rank matrix plus the product of a known fat compression matrix times a sparse matrix, recovery of the low-rank and sparse components is a fundamental task subsuming…

Multiagent Systems · Computer Science 2013-10-01 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

The problem of computing a representation for a real polynomial as a sum of minimum number of squares of polynomials can be casted as finding a symmetric positive semidefinite real matrix (Gram matrix) of minimum rank subject to linear…

Optimization and Control · Mathematics 2011-01-28 Yue Ma , Lihong Zhi

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Recovering a large matrix from limited measurements is a challenging task arising in many real applications, such as image inpainting, compressive sensing and medical imaging, and this kind of problems are mostly formulated as low-rank…

Computer Vision and Pattern Recognition · Computer Science 2014-06-12 Yilun Wang , Xinhua Su

Matrix rank minimizing subject to affine constraints arises in many application areas, ranging from signal processing to machine learning. Nuclear norm is a convex relaxation for this problem which can recover the rank exactly under some…

Computer Vision and Pattern Recognition · Computer Science 2015-08-20 Zhao Kang , Chong Peng , Qiang Cheng

The rank minimization problem is to find the lowest-rank matrix in a given set. Nuclear norm minimization has been proposed as an convex relaxation of rank minimization. Recht, Fazel, and Parrilo have shown that nuclear norm minimization…

Information Theory · Computer Science 2009-03-30 Kiryung Lee , Yoram Bresler

The low-rank matrix completion problem can be solved by Riemannian optimization on a fixed-rank manifold. However, a drawback of the known approaches is that the rank parameter has to be fixed a priori. In this paper, we consider the…

Optimization and Control · Mathematics 2022-02-21 Bin Gao , P. -A. Absil

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

Systems and Control · Computer Science 2016-11-22 Simone Naldi

On the heels of compressed sensing, a remarkable new field has very recently emerged. This field addresses a broad range of problems of significant practical interest, namely, the recovery of a data matrix from what appears to be…

Information Theory · Computer Science 2009-03-19 Emmanuel J. Candes , Yaniv Plan

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

The fundamental matrix can be estimated from point matches. The current gold standard is to bootstrap the eight-point algorithm and two-view projective bundle adjustment. The eight-point algorithm first computes a simple linear least…

Optimization and Control · Mathematics 2014-03-20 Florian Bugarin , Adrien Bartoli , Didier Henrion , Jean-Bernard Lasserre , Jean-José Orteu , Thierry Sentenac

The low-rank matrix approximation problem is ubiquitous in computational mathematics. Traditionally, this problem is solved in spectral or Frobenius norms, where the accuracy of the approximation is related to the rate of decrease of the…

Numerical Analysis · Mathematics 2022-01-31 Stanislav Morozov , Nikolai Zamarashkin , Eugene Tyrtyshnikov

Trace norm regularization is a widely used approach for learning low rank matrices. A standard optimization strategy is based on formulating the problem as one of low rank matrix factorization which, however, leads to a non-convex problem.…

Machine Learning · Computer Science 2017-08-01 Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

Numerous applications in data mining and machine learning require recovering a matrix of minimal rank. Robust principal component analysis (RPCA) is a general framework for handling this kind of problems. Nuclear norm based convex surrogate…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Zhao Kang , Chong Peng , Qiang Cheng

In this paper, we study the low-rank matrix minimization problem, where the loss function is convex but nonsmooth and the penalty term is defined by the cardinality function. We first introduce an exact continuous relaxation, that is, both…

Optimization and Control · Mathematics 2024-08-20 Quan Yu , Xinzhen Zhang

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu