English
Related papers

Related papers: A Non-Convex Relaxation for Fixed-Rank Approximati…

200 papers

Low-rank matrix completion is a problem of immense practical importance. Recent works on the subject often use nuclear norm as a convex surrogate of the rank function. Despite its solid theoretical foundation, the convex version of the…

Computer Vision and Pattern Recognition · Computer Science 2014-10-29 Yu-Xiang Wang , Choon Meng Lee , Loong-Fah Cheong , Kim-Chuan Toh

We revisit the problem of robust principal component analysis with features acting as prior side information. To this aim, a novel, elegant, non-convex optimization approach is proposed to decompose a given observation matrix into a…

Machine Learning · Statistics 2017-09-15 Niannan Xue , Jiankang Deng , Yannis Panagakis , Stefanos Zafeiriou

In this work we study convex relaxations of quadratic optimisation problems over permutation matrices. While existing semidefinite programming approaches can achieve remarkably tight relaxations, they have the strong disadvantage that they…

Optimization and Control · Mathematics 2018-08-01 Florian Bernard , Christian Theobalt , Michael Moeller

This paper studies the problem of recovering a low-rank matrix from several noisy random linear measurements. We consider the setting where the rank of the ground-truth matrix is unknown a priori and use an objective function built from a…

Optimization and Control · Mathematics 2025-07-29 Lijun Ding , Zhen Qin , Liwei Jiang , Jinxin Zhou , Zhihui Zhu

Matrices satisfying the Restricted Isometry Property (RIP) play an important role in the areas of compressed sensing and statistical learning. RIP matrices with optimal parameters are mainly obtained via probabilistic arguments, as explicit…

Machine Learning · Computer Science 2019-11-01 Shiva Prasad Kasiviswanathan , Mark Rudelson

Sparse regression models are increasingly prevalent due to their ease of interpretability and superior out-of-sample performance. However, the exact model of sparse regression with an $\ell_0$ constraint restricting the support of the…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez

The graph matching problem is a significant special case of the Quadratic Assignment Problem, with extensive applications in pattern recognition, computer vision, protein alignments and related fields. As the problem is NP-hard, relaxation…

Optimization and Control · Mathematics 2025-04-01 Rongxuan Li

The Method of Alternating Projections (MAP), a classical algorithm for solving feasibility prob- lems, has recently been intensely studied for nonconvex sets. However, intrinsically available are only local convergence results: convergence…

Optimization and Control · Mathematics 2013-05-21 Heinz H. Bauschke , Hung M. Phan , Xianfu Wang

In this paper, we study the problem of decomposing a superposition of a low-rank matrix and a sparse matrix when a relatively few linear measurements are available. This problem arises in many data processing tasks such as aligning multiple…

Information Theory · Computer Science 2012-03-01 Arvind Ganesh , Kerui Min , John Wright , Yi Ma

We study the problem of robust matrix completion (RMC), where the partially observed entries of an underlying low-rank matrix is corrupted by sparse noise. Existing analysis of the non-convex methods for this problem either requires the…

Information Theory · Computer Science 2025-04-28 Tianming Wang , Ke Wei

This work studies low-rank approximation of a positive semidefinite matrix from partial entries via nonconvex optimization. We characterized how well local-minimum based low-rank factorization approximates a fixed positive semidefinite…

Optimization and Control · Mathematics 2019-04-08 Ji Chen , Xiaodong Li

We show that the maximization of the sum degrees-of-freedom for the static flat-fading multiple-input multiple-output (MIMO) interference channel is equivalent to a rank constrained rank minimization problem (RCRM), when the signal spaces…

Information Theory · Computer Science 2015-03-17 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

A new relaxed variant of interior point method for low-rank semidefinite programming problems is proposed in this paper. The method is a step outside of the usual interior point framework. In anticipation to converging to a low-rank primal…

Numerical Analysis · Mathematics 2021-03-26 Stefania Bellavia , Jacek Gondzio , Margherita Porcelli

We consider the chance-constrained binary knapsack problem (CKP), where the item weights are independent and normally distributed. We introduce a continuous relaxation for the CKP, represented as a non-convex optimization problem, which we…

Optimization and Control · Mathematics 2024-03-12 Junyoung Kim , Kyungsik Lee

In the past decade, sparse and low-rank recovery have drawn much attention in many areas such as signal/image processing, statistics, bioinformatics and machine learning. To achieve sparsity and/or low-rankness inducing, the $\ell_1$ norm…

Information Theory · Computer Science 2019-06-07 Fei Wen , Lei Chu , Peilin Liu , Robert C. Qiu

As surrogate functions of $L_0$-norm, many nonconvex penalty functions have been proposed to enhance the sparse vector recovery. It is easy to extend these nonconvex penalty functions on singular values of a matrix to enhance low-rank…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Canyi Lu , Jinhui Tang , Shuicheng Yan , Zhouchen Lin

We propose a general framework for reduced-rank modeling of matrix-valued data. By applying a generalized nuclear norm penalty we can directly model low-dimensional latent variables associated with rows and columns. Our framework flexibly…

Machine Learning · Statistics 2017-08-23 William Fithian , Rahul Mazumder

In this work, we develop a new complexity metric for an important class of low-rank matrix optimization problems in both symmetric and asymmetric cases, where the metric aims to quantify the complexity of the nonconvex optimization…

Optimization and Control · Mathematics 2023-07-24 Haixiang Zhang , Baturalp Yalcin , Javad Lavaei , Somayeh Sojoudi

Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank…

Optimization and Control · Mathematics 2022-02-17 Christian Grussler , Pontus Giselsson

This paper studies the problem of deterministic rank-one matrix completion. It is known that the simplest semidefinite programming relaxation, involving minimization of the nuclear norm, does not in general return the solution for this…

Numerical Analysis · Mathematics 2018-01-03 Augustin Cosse , Laurent Demanet