English
Related papers

Related papers: Robust Large Scale Non-negative Matrix Factorizati…

200 papers

We propose a new variant of nonnegative matrix factorization (NMF), combining separability and sparsity assumptions. Separability requires that the columns of the first NMF factor are equal to columns of the input matrix, while sparsity…

Machine Learning · Computer Science 2020-06-16 Nicolas Nadisic , Arnaud Vandaele , Jeremy E. Cohen , Nicolas Gillis

In an effort to develop topic modeling methods that can be quickly applied to large data sets, we revisit the problem of maximum-likelihood estimation in topic models. It is known, at least informally, that maximum-likelihood estimation in…

Machine Learning · Statistics 2026-02-10 Peter Carbonetto , Abhishek Sarkar , Zihao Wang , Matthew Stephens

Non-negative matrix factorization (NMF) is a fundamental non-convex optimization problem with numerous applications in Machine Learning (music analysis, document clustering, speech-source separation etc). Despite having received extensive…

Machine Learning · Computer Science 2020-03-20 Ioannis Panageas , Stratis Skoulakis , Antonios Varvitsiotis , Xiao Wang

Non-negative matrix factorization (NMF) has previously been shown to be a useful decomposition for multivariate data. We interpret the factorization in a new way and use it to generate missing attributes from test data. We provide a joint…

Numerical Analysis · Computer Science 2010-07-05 Mithun Das Gupta

In this paper, we propose a provably correct algorithm for convolutive nonnegative matrix factorization (CNMF) under separability assumptions. CNMF is a convolutive variant of nonnegative matrix factorization (NMF), which functions as an…

Machine Learning · Computer Science 2019-11-15 Anthony Degleris , Nicolas Gillis

Nonnegative matrix factorization (NMF), which is the approximation of a data matrix as the product of two nonnegative matrices, is a key issue in machine learning and data analysis. One approach to NMF is to formulate the problem as a…

Optimization and Control · Mathematics 2016-11-02 Hideaki Iiduka , Shizuka Nishino

We present a numerical algorithm for nonnegative matrix factorization (NMF) problems under noisy separability. An NMF problem under separability can be stated as one of finding all vertices of the convex hull of data points. The research…

Machine Learning · Statistics 2015-03-06 Tomohiko Mizutani

In this paper, we introduce and provide a short overview of nonnegative matrix factorization (NMF). Several aspects of NMF are discussed, namely, the application in hyperspectral imaging, geometry and uniqueness of NMF solutions,…

Numerical Analysis · Computer Science 2017-03-03 Nicolas Gillis

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for nonnegative data, with applications such as hyperspectral unmixing and topic modeling. NMF is a difficult problem in general (NP-hard), and its…

Numerical Analysis · Mathematics 2025-11-11 Junjun Pan , Valentin Leplat , Michael Ng , Nicolas Gillis

Given a matrix $M$ (not necessarily nonnegative) and a factorization rank $r$, semi-nonnegative matrix factorization (semi-NMF) looks for a matrix $U$ with $r$ columns and a nonnegative matrix $V$ with $r$ rows such that $UV$ is the best…

Numerical Analysis · Mathematics 2015-10-28 Nicolas Gillis , Abhishek Kumar

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

Computer Vision and Pattern Recognition · Computer Science 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan

In the non-negative matrix factorization (NMF) problem, the input is an $m\times n$ matrix $M$ with non-negative entries and the goal is to factorize it as $M\approx AW$. The $m\times k$ matrix $A$ and the $k\times n$ matrix $W$ are both…

Data Structures and Algorithms · Computer Science 2021-03-09 Moses Charikar , Lunjia Hu

In this article, we study algorithms for nonnegative matrix factorization (NMF) in various applications involving streaming data. Utilizing the continual nature of the data, we develop a fast two-stage algorithm for highly efficient and…

Optimization and Control · Mathematics 2021-01-22 Ran Gu , Qiang Du , Simon J. L. Billinge

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for analyzing nonnegative data. A key aspect of NMF is the choice of the objective function that depends on the noise model (or statistics of the noise)…

Machine Learning · Computer Science 2021-02-10 Nicolas Gillis , Le Thi Khanh Hien , Valentin Leplat , Vincent Y. F. Tan

In this paper, we study the nonnegative matrix factorization problem under the separability assumption (that is, there exists a cone spanned by a small subset of the columns of the input nonnegative data matrix containing all columns),…

Machine Learning · Statistics 2014-04-07 Nicolas Gillis , Stephen A. Vavasis

Nonnegative Matrix Factorization (NMF) is an unsupervised learning algorithm that produces a linear, parts-based approximation of a data matrix. NMF constructs a nonnegative low rank basis matrix and a nonnegative low rank matrix of weights…

Machine Learning · Statistics 2020-12-08 Matthew Corsetti , Ernest Fokoué

The model described in this paper belongs to the family of non-negative matrix factorization methods designed for data representation and dimension reduction. In addition to preserving the data positivity property, it aims also to preserve…

Machine Learning · Computer Science 2022-09-23 Rachid Hedjam , Abdelhamid Abdesselam , Abderrahmane Rahiche , Mohamed Cheriet

There has been a recent critical need to study fairness and bias in machine learning (ML) algorithms. Since there is clearly no one-size-fits-all solution to fairness, ML methods should be developed alongside bias mitigation strategies that…

Machine Learning · Computer Science 2026-03-06 Lara Kassab , Erin George , Deanna Needell , Haowen Geng , Nika Jafar Nia , Aoxi Li

We show how to incorporate information from labeled examples into nonnegative matrix factorization (NMF), a popular unsupervised learning algorithm for dimensionality reduction. In addition to mapping the data into a space of lower…

Machine Learning · Computer Science 2011-12-19 Youngmin Cho , Lawrence K. Saul

This paper describes a new algorithm for computing Nonnegative Low Rank Matrix (NLRM) approximation for nonnegative matrices. Our approach is completely different from classical nonnegative matrix factorization (NMF) which has been studied…

Optimization and Control · Mathematics 2020-06-18 Guang-Jing Song , Michael Kwok-Po Ng