English
Related papers

Related papers: Strongly Convex Programming for Exact Matrix Compl…

200 papers

We study the robust recovery of a low-rank matrix from sparsely and grossly corrupted Gaussian measurements, with no prior knowledge on the intrinsic rank. We consider the robust matrix factorization approach. We employ a robust $\ell_1$…

Optimization and Control · Mathematics 2021-10-27 Lijun Ding , Liwei Jiang , Yudong Chen , Qing Qu , Zhihui Zhu

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

Optimization and Control · Mathematics 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Subspace identification is a classical and very well studied problem in system identification. The problem was recently posed as a convex optimization problem via the nuclear norm relaxation. Inspired by robust PCA, we extend this framework…

Systems and Control · Computer Science 2013-12-10 Dorsa Sadigh , Henrik Ohlsson , S. Shankar Sastry , Sanjit A. Seshia

Substantial progress has been made recently on developing provably accurate and efficient algorithms for low-rank matrix factorization via nonconvex optimization. While conventional wisdom often takes a dim view of nonconvex optimization…

Machine Learning · Computer Science 2019-10-23 Yuejie Chi , Yue M. Lu , Yuxin Chen

Many practical problems involve the recovery of a binary matrix from partial information, which makes the binary matrix completion (BMC) technique received increasing attention in machine learning. In particular, we consider a special case…

Machine Learning · Computer Science 2019-04-09 Chunsheng Liu

We propose Ky Fan 2-k-norm-based models for the nonconvex low-rank matrix recovery problem. A general difference of convex algorithm (DCA) is developed to solve these models. Numerical results show that the proposed models achieve high…

Optimization and Control · Mathematics 2019-04-12 Xuan Vinh Doan , Stephen Vavasis

The problem of low-rank matrix completion has recently generated a lot of interest leading to several results that offer exact solutions to the problem. However, in order to do so, these methods make assumptions that can be quite…

Machine Learning · Statistics 2014-07-14 Srinadh Bhojanapalli , Prateek Jain

This paper considers the problem of matrix completion when some number of the columns are completely and arbitrarily corrupted, potentially by a malicious adversary. It is well-known that standard algorithms for matrix completion can return…

Machine Learning · Statistics 2016-04-26 Yudong Chen , Huan Xu , Constantine Caramanis , Sujay Sanghavi

Consider a movie recommendation system where apart from the ratings information, side information such as user's age or movie's genre is also available. Unlike standard matrix completion, in this setting one should be able to predict…

Machine Learning · Computer Science 2013-06-05 Prateek Jain , Inderjit S. Dhillon

Matrix completion (MC) is a promising technique which is able to recover an intact matrix with low-rank property from sub-sampled/incomplete data. Its application varies from computer vision, signal processing to wireless network, and…

Signal Processing · Electrical Eng. & Systems 2019-05-08 Xiao Peng Li , Lei Huang , Hing Cheung So , Bo Zhao

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

Similarity matrix serves as a fundamental tool at the core of numerous downstream machine-learning tasks. However, missing data is inevitable and often results in an inaccurate similarity matrix. To address this issue, Similarity Matrix…

Machine Learning · Computer Science 2024-10-01 Changyi Ma , Runsheng Yu , Xiao Chen , Youzhi Zhang

We develop an efficient algorithm for weak recovery in a robust version of the stochastic block model. The algorithm matches the statistical guarantees of the best known algorithms for the vanilla version of the stochastic block model. In…

Machine Learning · Computer Science 2021-11-17 Jingqiu Ding , Tommaso d'Orsi , Rajai Nasser , David Steurer

In this paper we consider the low-rank matrix completion problem with specific application to forecasting in time series analysis. Briefly, the low-rank matrix completion problem is the problem of imputing missing values of a matrix under a…

Methodology · Statistics 2018-02-23 Jonathan Gillard , Konstantin Usevich

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by…

Machine Learning · Statistics 2018-11-13 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

The existing matrix completion methods focus on optimizing the relaxation of rank function such as nuclear norm, Schatten-p norm, etc. They usually need many iterations to converge. Moreover, only the low-rank property of matrices is…

Machine Learning · Computer Science 2022-03-07 Xuelong Li , Hongyuan Zhang , Rui Zhang