English
Related papers

Related papers: Tailed Low-Rank Matrix Factorization for Similarit…

200 papers

We propose an algorithm for low rank matrix completion for matrices with binary entries which obtains explicit binary factors. Our algorithm, which we call TBMC (\emph{Tiling for Binary Matrix Completion}), gives interpretable output in the…

Numerical Analysis · Mathematics 2020-06-23 Melanie Beckerleg , Andrew Thompson

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

Optimization and Control · Mathematics 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

Semi-Non-negative Matrix Factorization is a technique that learns a low-dimensional representation of a dataset that lends itself to a clustering interpretation. It is possible that the mapping between this new representation and our…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 George Trigeorgis , Konstantinos Bousmalis , Stefanos Zafeiriou , Bjoern W. Schuller

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

Machine Learning · Computer Science 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

Machine Learning · Computer Science 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu

Several important applications, such as streaming PCA and semidefinite programming, involve a large-scale positive-semidefinite (psd) matrix that is presented as a sequence of linear updates. Because of storage limitations, it may only be…

Numerical Analysis · Computer Science 2017-06-20 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

We exploit the versatile framework of Riemannian optimization on quotient manifolds to develop R3MC, a nonlinear conjugate-gradient method for low-rank matrix completion. The underlying search space of fixed-rank matrices is endowed with a…

Optimization and Control · Mathematics 2014-09-23 B. Mishra , R. Sepulchre

We study Sigma-Delta quantization methods coupled with appropriate reconstruction algorithms for digitizing randomly sampled low-rank matrices. We show that the reconstruction error associated with our methods decays polynomially with the…

Information Theory · Computer Science 2018-04-18 Eric Lybrand , Rayan Saab

Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the…

Machine Learning · Computer Science 2024-12-10 Olivier Vu Thanh

Nonnegative matrix factorization (NMF) was popularized as a tool for data mining by Lee and Seung in 1999. NMF attempts to approximate a matrix with nonnegative entries by a product of two low-rank matrices, also with nonnegative entries.…

Information Retrieval · Computer Science 2008-05-02 Michael Biggs , Ali Ghodsi , Stephen Vavasis

This paper aims at a better understanding of matrix factorization (MF), factorization machines (FM), and their combination with deep algorithms' application in recommendation systems. Specifically, this paper will focus on Singular Value…

Information Retrieval · Computer Science 2022-03-22 Yuefeng Zhang

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

We propose SMMF (Square-Matricized Momentum Factorization), a memory-efficient optimizer that reduces the memory requirement of the widely used adaptive learning rate optimizers, such as Adam, by up to 96%. SMMF enables flexible and…

Machine Learning · Computer Science 2025-05-01 Kwangryeol Park , Seulki Lee

The common task in matrix completion (MC) and robust principle component analysis (RPCA) is to recover a low-rank matrix from a given data matrix. These problems gained great attention from various areas in applied sciences recently,…

Information Theory · Computer Science 2012-01-06 Hui Zhang , Jian-Feng Cai , Lizhi Cheng , Jubo Zhu

The low-complexity assumption in linear systems can often be expressed as rank deficiency in data matrices with generalized Hankel structure. This makes it possible to denoise the data by estimating the underlying structured low-rank…

Systems and Control · Electrical Eng. & Systems 2021-11-10 Mingzhou Yin , Roy S. Smith

The goal of affine matrix rank minimization problem is to reconstruct a low-rank or approximately low-rank matrix under linear constraints. In general, this problem is combinatorial and NP-hard. In this paper, a nonconvex fraction function…

Optimization and Control · Mathematics 2018-06-21 Angang Cui , Jigen Peng , Haiyang Li

In the low-rank matrix completion (LRMC) problem, the low-rank assumption means that the columns (or rows) of the matrix to be completed are points on a low-dimensional linear algebraic variety. This paper extends this thinking to cases…

Machine Learning · Statistics 2020-09-08 Greg Ongie , Daniel Pimentel-Alarcón , Laura Balzano , Rebecca Willett , Robert D. Nowak

Conventional matrix completion methods approximate the missing values by assuming the matrix to be low-rank, which leads to a linear approximation of missing values. It has been shown that enhanced performance could be attained by using…

Information Theory · Computer Science 2024-03-18 Sajad Faramarzi , Farzan Haddadi , Sajjad Amini , Masoud Ahookhosh