English
Related papers

Related papers: Bayesian Matrix Completion via Adaptive Relaxed Sp…

200 papers

This paper provides the best bounds to date on the number of randomly sampled entries required to reconstruct an unknown low rank matrix. These results improve on prior work by Candes and Recht, Candes and Tao, and Keshavan, Montanari, and…

Information Theory · Computer Science 2009-10-21 Benjamin Recht

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

Optimization and Control · Mathematics 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

In this paper, the problem of matrix rank minimization under affine constraints is addressed. The state-of-the-art algorithms can recover matrices with a rank much less than what is sufficient for the uniqueness of the solution of this…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Arash Amini , Christian Jutten

In this paper, we show that the low rank matrix completion problem can be reduced to the problem of finding the rank of a certain tensor.

Optimization and Control · Mathematics 2013-07-24 Harm Derksen

In this paper, we introduce a powerful technique based on Leave-one-out analysis to the study of low-rank matrix completion problems. Using this technique, we develop a general approach for obtaining fine-grained, entrywise bounds for…

Machine Learning · Statistics 2020-06-18 Lijun Ding , Yudong Chen

We present a simple, accurate method for solving consistent, rank-deficient linear systems, with or without addi- tional rank-completing constraints. Such problems arise in a variety of applications, such as the computation of the…

Numerical Analysis · Mathematics 2014-01-15 Josef Sifuentes , Zydrunas Gimbutas , Leslie Greengard

We study the problem of exact completion for $m \times n$ sized matrix of rank $r$ with the adaptive sampling method. We introduce a relation of the exact completion problem with the sparsest vector of column and row spaces (which we call…

Machine Learning · Computer Science 2022-03-08 Ilqar Ramazanli , Barnabas Poczos

Matrix and tensor completion are frameworks for a wide range of problems, including collaborative filtering, missing data, and image reconstruction. Missing entries are estimated by leveraging an assumption that the matrix or tensor is…

Methodology · Statistics 2019-05-29 Daniel E. Gilbert , Martin T. Wells

Boolean matrix factorization and Boolean matrix completion from noisy observations are desirable unsupervised data-analysis methods due to their interpretability, but hard to perform due to their NP-hardness. We treat these problems as…

Statistics Theory · Mathematics 2016-02-08 Siamak Ravanbakhsh , Barnabas Poczos , Russell Greiner

We propose Bayesian methods for Gaussian graphical models that lead to sparse and adaptively shrunk estimators of the precision (inverse covariance) matrix. Our methods are based on lasso-type regularization priors leading to parsimonious…

Methodology · Statistics 2013-10-07 Rajesh Talluri , Veerabhadran Baladandayuthapani , Bani K. Mallick

Matrix completion has been well studied under the uniform sampling model and the trace-norm regularized methods perform well both theoretically and numerically in such a setting. However, the uniform sampling model is unrealistic for a…

Machine Learning · Computer Science 2017-05-01 T. Tony Cai , Wen-Xin Zhou

Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective…

Optimization and Control · Mathematics 2021-03-30 April Sagan , John E. Mitchell

Efforts to understand the generalization mystery in deep learning have led to the belief that gradient-based optimization induces a form of implicit regularization, a bias towards models of low "complexity." We study the implicit…

Machine Learning · Computer Science 2019-10-29 Sanjeev Arora , Nadav Cohen , Wei Hu , Yuping Luo

Low-rank matrix completion addresses the problem of completing a matrix from a certain set of generic specified entries. Over the complex numbers a matrix with a given entry pattern can be uniquely completed to a specific rank, called the…

Algebraic Geometry · Mathematics 2025-03-13 Mareike Dressler , Robert Krone

We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and…

Machine Learning · Computer Science 2012-07-02 Yuhong Guo , Dale Schuurmans

We study the Riemannian optimization methods on the embedded manifold of low rank matrices for the problem of matrix completion, which is about recovering a low rank matrix from its partial entries. Assume $m$ entries of an $n\times n$ rank…

Numerical Analysis · Mathematics 2016-04-12 Ke Wei , Jian-Feng Cai , Tony F. Chan , Shingyu Leung

Boolean matrix factorisation aims to decompose a binary data matrix into an approximate Boolean product of two low rank, binary matrices: one containing meaningful patterns, the other quantifying how the observations can be expressed as a…

Machine Learning · Statistics 2017-02-28 Tammo Rukat , Chris C. Holmes , Michalis K. Titsias , Christopher Yau

Matrix completion is a classical problem in data science wherein one attempts to reconstruct a low-rank matrix while only observing some subset of the entries. Previous authors have phrased this problem as a nuclear norm minimization…

Machine Learning · Computer Science 2019-04-19 Christian Parkinson , Kevin Huynh , Deanna Needell

We propose a relax-and-round approach combined with a greedy search strategy for performing complex lattice basis reduction. Taking an optimization perspective, we introduce a relaxed version of the problem that, while still nonconvex, has…

Signal Processing · Electrical Eng. & Systems 2018-08-16 Marius Arvinte , Ahmed H. Tewfik

We study implicit regularization when optimizing an underdetermined quadratic objective over a matrix $X$ with gradient descent on a factorization of $X$. We conjecture and provide empirical and theoretical evidence that with small enough…

Machine Learning · Statistics 2017-05-26 Suriya Gunasekar , Blake Woodworth , Srinadh Bhojanapalli , Behnam Neyshabur , Nathan Srebro