English
Related papers

Related papers: Two to Five Truths in Non-Negative Matrix Factoriz…

200 papers

Nonnegative matrix factorization (NMF) is a popular dimension reduction technique that produces interpretable decomposition of the data into parts. However, this decompostion is not generally identifiable (even up to permutation and…

Machine Learning · Computer Science 2016-04-05 W. Pan , F. Doshi-Velez

We describe a graph-based neural acceleration technique for nonnegative matrix factorization that builds upon a connection between matrices and bipartite graphs that is well-known in certain fields, e.g., sparse linear algebra, but has not…

Machine Learning · Computer Science 2022-02-02 Jens Sjölund , Maria Bånkestad

Despite the popularity of factor models with sparse loading matrices, little attention has been given to formally address identifiability of these models beyond standard rotation-based identification such as the positive lower triangular…

Econometrics · Economics 2025-02-12 Darjus Hosszejni , Sylvia Frühwirth-Schnatter

We develop a unified and systematic framework for performing online nonnegative matrix factorization under a wide variety of important divergences. The online nature of our algorithm makes it particularly amenable to large-scale data. We…

Machine Learning · Statistics 2016-08-17 Renbo Zhao , Vincent Y. F. Tan , Huan Xu

Non-negative matrix factorization with the generalized Kullback-Leibler divergence (NMF) and latent Dirichlet allocation (LDA) are two popular approaches for dimensionality reduction of non-negative data. Here, we show that NMF with…

Machine Learning · Computer Science 2024-06-03 Benedikt Geiger , Peter J. Park

Nonnegative matrix factorization (NMF) is a widely used linear dimensionality reduction technique for nonnegative data. NMF requires that each data point is approximated by a convex combination of basis elements. Archetypal analysis (AA),…

Signal Processing · Electrical Eng. & Systems 2020-03-31 Pierre De Handschutter , Nicolas Gillis , Arnaud Vandaele , Xavier Siebert

Approximate matrix factorization techniques with both nonnegativity and orthogonality constraints, referred to as orthogonal nonnegative matrix factorization (ONMF), have been recently introduced and shown to work remarkably well for…

Optimization and Control · Mathematics 2015-03-19 Filippo Pompili , Nicolas Gillis , P. -A. Absil , François Glineur

Non-negative matrix factorization (NMF) is an important technique for obtaining low dimensional representations of datasets. However, classical NMF does not take into account data that is collected at different times or in different…

Machine Learning · Computer Science 2023-11-21 James Chapman , Yotam Yaniv , Deanna Needell

Understanding the association between dietary patterns and health outcomes, such as the cancer risk, is crucial to inform public health guidelines and shaping future dietary interventions. However, dietary intake data present several…

Methodology · Statistics 2025-10-10 Blake Hansen , Dafne Zorzetto , Valeria Edefonti , Roberta De Vito

Lee and Seung (2000) introduced numerical solutions for non-negative matrix factorization (NMF) using iterative multiplicative update algorithms. These algorithms have been actively utilized as dimensionality reduction tools for…

Numerical Analysis · Mathematics 2025-01-23 Sungjae Cho

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications. Most existing variations of NMF only consider how each row/column vector of factorised matrices should be shaped, and…

Machine Learning · Computer Science 2019-07-09 Shuai Jiang , Kan Li , Richard Yida Xu

Linear dimensionality reduction techniques are powerful tools for image analysis as they allow the identification of important features in a data set. In particular, nonnegative matrix factorization (NMF) has become very popular as it is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-07 Gabriella Casalino , Nicolas Gillis

Single-cell RNA sequencing (scRNA-seq) is a relatively new technology that has stimulated enormous interest in statistics, data science, and computational biology due to the high dimensionality, complexity, and large scale associated with…

Machine Learning · Statistics 2023-10-25 Yuta Hozumi , Guo-Wei Wei

The clustering method based on the anchor graph has gained significant attention due to its exceptional clustering performance and ability to process large-scale data. One common approach is to learn bipartite graphs with K-connected…

Machine Learning · Computer Science 2024-10-31 Rui Wang , Jing Li , Quanxue Gao , Cheng Deng

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for nonnegative data, with applications such as hyperspectral unmixing and topic modeling. NMF is a difficult problem in general (NP-hard), and its…

Numerical Analysis · Mathematics 2025-11-11 Junjun Pan , Valentin Leplat , Michael Ng , Nicolas Gillis

Classification and topic modeling are popular techniques in machine learning that extract information from large-scale datasets. By incorporating a priori information such as labels or important features, methods have been developed to…

Machine Learning · Computer Science 2022-02-01 Pengyu Li , Christine Tseng , Yaxuan Zheng , Joyce A. Chew , Longxiu Huang , Benjamin Jarman , Deanna Needell

Data often comes in the form of an array or matrix. Matrix factorization techniques attempt to recover missing or corrupted entries by assuming that the matrix can be written as the product of two low-rank matrices. In other words, matrix…

Machine Learning · Computer Science 2015-12-16 Gintare Karolina Dziugaite , Daniel M. Roy

Non-negative matrix factorization (NMF) is a fundamental matrix decomposition technique that is used primarily for dimensionality reduction and is increasing in popularity in the biological domain. Although finding a unique NMF is generally…

Information Theory · Computer Science 2021-08-23 Rami Nasser , Yonina C. Eldar , Roded Sharan

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…