English
Related papers

Related papers: Low-Rank Matrix Regression via Least-Angle Regress…

200 papers

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

In high-dimensional multivariate regression problems, enforcing low rank in the coefficient matrix offers effective dimension reduction, which greatly facilitates parameter estimation and model interpretation. However, commonly-used…

Statistics Theory · Mathematics 2017-07-18 Yiyuan She , Kun Chen

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

Low-rank matrix approximation, which aims to construct a low-rank matrix from an observation, has received much attention recently. An efficient method to solve this problem is to convert the problem of rank minimization into a nuclear norm…

Information Theory · Computer Science 2016-09-21 Seyedroohollah Hosseini

We study the low-rank phase retrieval problem, where we try to recover a $d_1\times d_2$ low-rank matrix from a series of phaseless linear measurements. This is a fourth-order inverse problem, as we are trying to recover factors of matrix…

Information Theory · Computer Science 2020-07-07 Kiryung Lee , Sohail Bahmani , Yonina Eldar , Justin Romberg

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

We solve a weakly supervised regression problem. Under "weakly" we understand that for some training points the labels are known, for some unknown, and for others uncertain due to the presence of random noise or other reasons such as lack…

Machine Learning · Computer Science 2021-04-15 Vladimir Berikov , Alexander Litvinenko

Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized…

Optimization and Control · Mathematics 2024-05-21 Wenjing Li , Wei Bian , Kim-Chuan Toh

We present a natural generalization of the recent low rank + sparse matrix decomposition and consider the decomposition of matrices into components of multiple scales. Such decomposition is well motivated in practice as data matrices often…

Systems and Control · Computer Science 2016-08-04 Frank Ong , Michael Lustig

Minimization of the nuclear norm is often used as a surrogate, convex relaxation, for finding the minimum rank completion (recovery) of a partial matrix. The minimum nuclear norm problem can be solved as a trace minimization semidefinite…

Optimization and Control · Mathematics 2016-08-16 Shimeng Huang , Henry Wolkowicz

This paper considers the problem of recovering either a low rank matrix or a sparse vector from observations of linear combinations of the vector or matrix elements. Recent methods replace the non-convex regularization with $\ell_1$ or…

Optimization and Control · Mathematics 2017-03-22 Carl Olsson , Marcus Carlsson , Fredrik Andersson , Viktor Larsson

Low-rank matrix recovery can be solved to statistical optimality by convex matrix optimization under the classical assumption of restricted isometry property (RIP). However, for large problems, the convex formulation is commonly replaced by…

Optimization and Control · Mathematics 2026-04-22 Andrew D. McRae , Richard Y. Zhang

Recovering intrinsic data structure from corrupted observations plays an important role in various tasks in the communities of machine learning and signal processing. In this paper, we propose a novel model, named log-sum heuristic recovery…

Numerical Analysis · Computer Science 2014-08-13 Yue Deng , Qionghai Dai , Risheng Liu , Zengke Zhang , Sanqing Hu

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler

The goal of affine matrix rank minimization problem is to reconstruct a low-rank or approximately low-rank matrix under linear constraints. In general, this problem is combinatorial and NP-hard. In this paper, a nonconvex fraction function…

Optimization and Control · Mathematics 2018-06-21 Angang Cui , Jigen Peng , Haiyang Li

Estimation of low-rank matrices is of significant interest in a range of contemporary applications. In this paper, we introduce a rank-one projection model for low-rank matrix recovery and propose a constrained nuclear norm minimization…

Statistics Theory · Mathematics 2014-12-10 T. Tony Cai , Anru Zhang

Numerous applications in data mining and machine learning require recovering a matrix of minimal rank. Robust principal component analysis (RPCA) is a general framework for handling this kind of problems. Nuclear norm based convex surrogate…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Zhao Kang , Chong Peng , Qiang Cheng

Low-rank matrix recovery problems are inverse problems which naturally arise in various fields like signal processing, imaging and machine learning. They are non-convex and NP-hard in full generality. It is therefore a delicate problem to…

Optimization and Control · Mathematics 2021-05-24 Irène Waldspurger

The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has…

Information Retrieval · Computer Science 2016-02-29 Zhao Kang , Qiang Cheng

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon