English
Related papers

Related papers: Non-Convex Matrix Completion Against a Semi-Random…

200 papers

Low-rank matrix recovery problems are inverse problems which naturally arise in various fields like signal processing, imaging and machine learning. They are non-convex and NP-hard in full generality. It is therefore a delicate problem to…

Optimization and Control · Mathematics 2021-05-24 Irène Waldspurger

Many practical problems involve the recovery of a binary matrix from partial information, which makes the binary matrix completion (BMC) technique received increasing attention in machine learning. In particular, we consider a special case…

Machine Learning · Computer Science 2019-04-09 Chunsheng Liu

Matrix completion refers to completing a low-rank matrix from a few observed elements of its entries and has been known as one of the significant and widely-used problems in recent years. The required number of observations for exact…

Information Theory · Computer Science 2021-11-02 Hamideh. Sadat Fazael Ardakani , Niloufar Rahmani , Sajad Daei

We study the problem of learning a partially observed matrix under the low rank assumption in the presence of fully observed side information that depends linearly on the true underlying matrix. This problem consists of an important…

Machine Learning · Statistics 2026-02-05 Dimitris Bertsimas , Nicholas A. G. Johnson

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the…

Statistics Theory · Mathematics 2021-05-06 Yunhua Xiang , Tianyu Zhang , Xu Wang , Ali Shojaie , Noah Simon

The problem of finding the missing values of a matrix given a few of its entries, called matrix completion, has gathered a lot of attention in the recent years. Although the problem under the standard low rank assumption is NP-hard,…

Machine Learning · Computer Science 2014-12-01 Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

The existing matrix completion methods focus on optimizing the relaxation of rank function such as nuclear norm, Schatten-p norm, etc. They usually need many iterations to converge. Moreover, only the low-rank property of matrices is…

Machine Learning · Computer Science 2022-03-07 Xuelong Li , Hongyuan Zhang , Rui Zhang

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

We study the problem of estimating a low-rank positive semidefinite (PSD) matrix from a set of rank-one measurements using sensing vectors composed of i.i.d. standard Gaussian entries, which are possibly corrupted by arbitrary outliers.…

Information Theory · Computer Science 2016-12-21 Yuanxin Li , Yue Sun , Yuejie Chi

An usual problem in statistics consists in estimating the minimizer of a convex function. When we have to deal with large samples taking values in high dimensional spaces, stochastic gradient algorithms and their averaged versions are…

Statistics Theory · Mathematics 2022-01-12 Antoine Godichon-Baggioni

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

Non-convex optimization problems often arise from probabilistic modeling, such as estimation of posterior distributions. Non-convexity makes the problems intractable, and poses various obstacles for us to design efficient algorithms. In…

Machine Learning · Computer Science 2013-12-18 Khoat Than , Tu Bao Ho

Techniques of matrix completion aim to impute a large portion of missing entries in a data matrix through a small portion of observed ones. In practice including collaborative filtering, prior information and special structures are usually…

Statistics Theory · Mathematics 2022-03-09 Ji Chen , Xiaodong Li , Zongming Ma

Efficient algorithms for the sparse solution of under-determined linear systems $Ax = b$ are known for matrices $A$ satisfying suitable assumptions like the restricted isometry property (RIP). Without such assumptions little is known and…

Machine Learning · Computer Science 2021-01-22 G. Welper

A vast majority of machine learning algorithms train their models and perform inference by solving optimization problems. In order to capture the learning and prediction problems accurately, structural constraints such as sparsity or low…

Machine Learning · Statistics 2017-12-22 Prateek Jain , Purushottam Kar

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

In this paper, we consider the problem of Robust Matrix Completion (RMC) where the goal is to recover a low-rank matrix by observing a small number of its entries out of which a few can be arbitrarily corrupted. We propose a simple…

Machine Learning · Computer Science 2016-12-09 Yeshwanth Cherapanamjeri , Kartik Gupta , Prateek Jain