English
Related papers

Related papers: Fast Low-Rank Bayesian Matrix Completion with Hier…

200 papers

Many problems in statistics and machine learning require the reconstruction of a rank-one signal matrix from noisy data. Enforcing additional prior information on the rank-one component is often key to guaranteeing good recovery…

Machine Learning · Statistics 2020-11-10 Jorio Cocola , Paul Hand , Vladislav Voroninski

Low rank matrix approximation is an important tool in machine learning. Given a data matrix, low rank approximation helps to find factors, patterns and provides concise representations for the data. Research on low rank approximation…

Computational Complexity · Computer Science 2017-04-21 Chen Dan , Kristoffer Arnsfelt Hansen , He Jiang , Liwei Wang , Yuchen Zhou

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch

Bayesian hierarchical models can provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models typically comprise a conditionally Gaussian prior model for the unknown which is augmented by a generalized…

Numerical Analysis · Mathematics 2025-01-09 Jonathan Lindbloom , Jan Glaubitz , Anne Gelb

Completing a data matrix X has become an ubiquitous problem in modern data science, with applications in recommender systems, computer vision, and networks inference, to name a few. One typical assumption is that X is low-rank. A more…

Machine Learning · Computer Science 2018-08-03 Daniel L. Pimentel-Alarcón

Recent advances in matrix completion enable data imputation in full-rank matrices by exploiting low dimensional (nonlinear) latent structure. In this paper, we develop a new model for high rank matrix completion (HRMC), together with batch…

Machine Learning · Computer Science 2020-02-21 Jicong Fan , Madeleine Udell

We describe a new algorithm for Gaussian Elimination suitable for general (unsymmetric and possibly singular) sparse matrices, of any entry type, which has a natural parallel and distributed-memory formulation but degrades gracefully to…

Mathematical Software · Computer Science 2012-01-17 Riccardo Murri

In this paper, we introduce a novel and robust approach to Quantized Matrix Completion (QMC). First, we propose a rank minimization problem with constraints induced by quantization bounds. Next, we form an unconstrained optimization problem…

Machine Learning · Statistics 2019-02-20 Ashkan Esmaeili , Farokh Marvasti

In this paper, we introduce a powerful technique based on Leave-one-out analysis to the study of low-rank matrix completion problems. Using this technique, we develop a general approach for obtaining fine-grained, entrywise bounds for…

Machine Learning · Statistics 2020-06-18 Lijun Ding , Yudong Chen

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

Matrix completion, the problem of completing missing entries in a data matrix with low dimensional structure (such as rank), has seen many fruitful approaches and analyses. Tensor completion is the tensor analog, that attempts to impute…

Numerical Analysis · Mathematics 2021-07-07 Zehan Chao , Longxiu Huang , Deanna Needell

We consider the problem of exact low-rank matrix completion from a geometric viewpoint: given a partially filled matrix M, we keep the positions of specified and unspecified entries fixed, and study how the minimal completion rank depends…

Statistics Theory · Mathematics 2019-09-24 Daniel Irving Bernstein , Grigoriy Blekherman , Rainer Sinn

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

Using the matrix product state (MPS) representation of the recently proposed tensor ring decompositions, in this paper we propose a tensor completion algorithm, which is an alternating minimization algorithm that alternates over the factors…

Machine Learning · Computer Science 2017-07-27 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

The problem of low-rank matrix completion with heterogeneous and sub-exponential (as opposed to homogeneous and Gaussian) noise is particularly relevant to a number of applications in modern commerce. Examples include panel sales data and…

Machine Learning · Statistics 2021-10-26 Vivek F. Farias , Andrew A. Li , Tianyi Peng

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

Inversion of sparse matrices with standard direct solve schemes is robust, but computationally expensive. Iterative solvers, on the other hand, demonstrate better scalability; but, need to be used with an appropriate preconditioner (e.g.,…

Numerical Analysis · Mathematics 2017-09-28 Hadi Pouransari , Pieter Coulier , Eric Darve

The Nystrom method is an efficient technique to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

Artificial Intelligence · Computer Science 2010-04-13 Ameet Talwalkar , Afshin Rostamizadeh

This paper considers theoretical analysis of recovering a low rank matrix given a few expansion coefficients with respect to any basis. The current approach generalizes the existing analysis for the low-rank matrix completion problem with…

Information Theory · Computer Science 2018-12-17 Abiy Tasissa , Rongjie Lai