English
Related papers

Related papers: Fast and Robust Recursive Algorithms for Separable…

200 papers

Non-negative matrix factorization (NMF) is a popular unsupervised learning approach widely used in image clustering. However, in real-world clustering scenarios, most existing NMF methods are highly sensitive to noise corruption and are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jingjing Liu , Nian Wu , Xianchao Xiu , Jianhua Zhang

We develop a unified and systematic framework for performing online nonnegative matrix factorization under a wide variety of important divergences. The online nature of our algorithm makes it particularly amenable to large-scale data. We…

Machine Learning · Statistics 2016-08-17 Renbo Zhao , Vincent Y. F. Tan , Huan Xu

We describe a graph-based neural acceleration technique for nonnegative matrix factorization that builds upon a connection between matrices and bipartite graphs that is well-known in certain fields, e.g., sparse linear algebra, but has not…

Machine Learning · Computer Science 2022-02-02 Jens Sjölund , Maria Bånkestad

Given a matrix $M$ (not necessarily nonnegative) and a factorization rank $r$, semi-nonnegative matrix factorization (semi-NMF) looks for a matrix $U$ with $r$ columns and a nonnegative matrix $V$ with $r$ rows such that $UV$ is the best…

Numerical Analysis · Mathematics 2015-10-28 Nicolas Gillis , Abhishek Kumar

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

Information Theory · Computer Science 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

The split feasibility problem is to find an element in the intersection of a closed set $C$ and the linear preimage of another closed set $D$, assuming the projections onto $C$ and $D$ are easy to compute. This class of problems arises…

Optimization and Control · Mathematics 2020-11-05 Chen Chen , Ting Kei Pong , Lulin Tan , Liaoyuan Zeng

In the non-negative matrix factorization (NMF) problem, the input is an $m\times n$ matrix $M$ with non-negative entries and the goal is to factorize it as $M\approx AW$. The $m\times k$ matrix $A$ and the $k\times n$ matrix $W$ are both…

Data Structures and Algorithms · Computer Science 2021-03-09 Moses Charikar , Lunjia Hu

In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex…

Numerical Analysis · Computer Science 2020-01-14 Andersen Man Shun Ang , Nicolas Gillis

We consider the problem of sparse nonnegative matrix factorization (NMF) using archetypal regularization. The goal is to represent a collection of data points as nonnegative linear combinations of a few nonnegative sparse factors with…

Machine Learning · Statistics 2024-02-13 Kayhan Behdin , Rahul Mazumder

This paper proposes uni-orthogonal and bi-orthogonal nonnegative matrix factorization algorithms with robust convergence proofs. We design the algorithms based on the work of Lee and Seung [1], and derive the converged versions by utilizing…

Machine Learning · Computer Science 2011-03-17 Andri Mirzal

Based on an idea in [4] we propose a new iterative multiplicative filtering algorithm for label assignment matrices which can be used for the supervised partitioning of data. Starting with a row-normalized matrix containing the averaged…

Numerical Analysis · Mathematics 2018-12-10 Ronny Bergmann , Jan Henrik Fitschen , Johannes Persch , Gabriele Steidl

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

We consider the problem of robust matrix completion, which aims to recover a low rank matrix $L_*$ and a sparse matrix $S_*$ from incomplete observations of their sum $M=L_*+S_*\in\mathbb{R}^{m\times n}$. Algorithmically, the robust matrix…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

In this work, we consider nonnegative matrix factorization (NMF) with a regularization that promotes small volume of the convex hull spanned by the basis matrix. We present highly efficient algorithms for three different volume…

Numerical Analysis · Computer Science 2020-01-14 M. S. Ang , Nicolas Gillis

We describe a simple approach to factorize non-commutative (nc) polynomials, that is, elements in free associative algebras (over a commutative field), into atoms (irreducible elements) based on (a special form of) their minimal linear…

Rings and Algebras · Mathematics 2018-08-09 Konrad Schrempf

Polarization is a unique characteristic of transverse wave and is represented by Stokes parameters. Analysis of polarization states can reveal valuable information about the sources. In this paper, we propose a separable low-rank quaternion…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Junjun Pan , Michael K. Ng

It was recently shown that quantum annealing can be used as an effective, fast subroutine in certain types of matrix factorization algorithms. The quantum annealing algorithm performed best for quick, approximate answers, but performance…

Machine Learning · Computer Science 2021-01-13 John Golden , Daniel O'Malley

The Nonnegative Matrix Factorization (NMF) of the rating matrix has shown to be an effective method to tackle the recommendation problem. In this paper we propose new methods based on the NMF of the rating matrix and we compare them with…

Machine Learning · Computer Science 2019-08-30 Gianna M. Del Corso , Francesco Romani

In light of recent data science trends, new interest has fallen in alternative matrix factorizations. By this, we mean various ways of factorizing particular data matrices so that the factors have special properties and reveal insights into…

Optimization and Control · Mathematics 2023-02-21 Andries Steenkamp