English
Related papers

Related papers: Non-Convex Rank/Sparsity Regularization and Local …

200 papers

Recent work established that rank overparameterization eliminates spurious local minima in nonconvex low-rank matrix recovery under the restricted isometry property (RIP). But this does not fully explain the practical success of…

Optimization and Control · Mathematics 2025-05-07 Richard Y. Zhang

We propose a convex optimization formulation with the nuclear norm and $\ell_1$-norm to find a large approximately rank-one submatrix of a given nonnegative matrix. We develop optimality conditions for the formulation and characterize the…

Optimization and Control · Mathematics 2010-11-09 Xuan Vinh Doan , Stephen A. Vavasis

The affine rank minimization problem consists of finding a matrix of minimum rank that satisfies a given system of linear equality constraints. Such problems have appeared in the literature of a diverse set of fields including system…

Optimization and Control · Mathematics 2010-08-09 Benjamin Recht , Maryam Fazel , Pablo A. Parrilo

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Trace norm regularization is a widely used approach for learning low rank matrices. A standard optimization strategy is based on formulating the problem as one of low rank matrix factorization which, however, leads to a non-convex problem.…

Machine Learning · Computer Science 2017-08-01 Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

Numerical Analysis · Mathematics 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

Machine Learning · Statistics 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

This paper develops a new class of nonconvex regularizers for low-rank matrix recovery. Many regularizers are motivated as convex relaxations of the matrix rank function. Our new factor group-sparse regularizers are motivated as a…

Machine Learning · Computer Science 2019-11-19 Jicong Fan , Lijun Ding , Yudong Chen , Madeleine Udell

Low rank regularization, in essence, involves introducing a low rank or approximately low rank assumption for matrix we aim to learn, which has achieved great success in many fields including machine learning, data mining and computer…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Zhanxuan Hu , Feiping Nie , Rong Wang , Xuelong Li

Low-rank matrix models have been universally useful for numerous applications, from classical system identification to more modern matrix completion in signal processing and statistics. The nuclear norm has been employed as a convex…

Statistics Theory · Mathematics 2023-03-06 Kiryung Lee , Rakshith Sharma Srinivasa , Marius Junge , Justin Romberg

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes…

Optimization and Control · Mathematics 2019-09-17 Pan Shang , Lingchen Kong

The nuclear norm is widely used as a convex surrogate of the rank function in compressive sensing for low rank matrix recovery with its applications in image recovery and signal processing. However, solving the nuclear norm based relaxed…

Machine Learning · Computer Science 2016-01-20 Canyi Lu , Jinhui Tang , Shuicheng Yan , Zhouchen Lin

To alleviate the bias generated by the l1-norm in the low-rank tensor completion problem, nonconvex surrogates/regularizers have been suggested to replace the tensor nuclear norm, although both can achieve sparsity. However, the…

Machine Learning · Computer Science 2023-10-11 Zhi-Yong Wang , Hing Cheung So , Abdelhak M. Zoubir

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

Information Theory · Computer Science 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi

We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Yann Traonmilin , Rémi Gribonval , Samuel Vaiter

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

In many applications, high-dimensional data points can be well represented by low-dimensional subspaces. To identify the subspaces, it is important to capture a global and local structure of the data which is achieved by imposing low-rank…

Machine Learning · Computer Science 2018-12-18 Maria Brbić , Ivica Kopriva

Numerous applications in data mining and machine learning require recovering a matrix of minimal rank. Robust principal component analysis (RPCA) is a general framework for handling this kind of problems. Nuclear norm based convex surrogate…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Zhao Kang , Chong Peng , Qiang Cheng

We consider the nonconvex regularized method for low-rank matrix recovery. Under the assumption on the singular values of the parameter matrix, we provide the recovery bound for any stationary point of the nonconvex method by virtue of…

Optimization and Control · Mathematics 2024-12-24 Xin Li , Dongya Wu