English
Related papers

Related papers: Algorithms for Nonnegative Matrix Factorization wi…

200 papers

Non-negative matrix factorization (NMF) approximates a non-negative matrix $X$ by a product of two non-negative low-rank factor matrices $W$ and $H$. NMF and its extensions minimize either the Kullback-Leibler divergence or the Euclidean…

Machine Learning · Statistics 2012-07-17 Naiyang Guan , Dacheng Tao , Zhigang Luo , John Shawe-Taylor

Poisson non-negative matrix factorization (NMF) is a widely used method to find interpretable "parts-based" decompositions of count data. While many variants of Poisson NMF exist, existing methods assume that the "parts" in the…

Machine Learning · Computer Science 2026-01-12 Eric Weine , Peter Carbonetto , Rafael A. Irizarry , Matthew Stephens

Non-negative matrix factorization (NMF) is a matrix decomposition problem with applications in unsupervised learning. The general form of this problem (along with many of its variants) is NP-hard in nature. In our work, we explore how this…

Given a symmetric nonnegative matrix $A$, symmetric nonnegative matrix factorization (symNMF) is the problem of finding a nonnegative matrix $H$, usually with much fewer columns than $A$, such that $A \approx HH^T$. SymNMF can be used for…

Numerical Analysis · Computer Science 2016-10-07 Arnaud Vandaele , Nicolas Gillis , Qi Lei , Kai Zhong , Inderjit Dhillon

Approximate matrix factorization techniques with both nonnegativity and orthogonality constraints, referred to as orthogonal nonnegative matrix factorization (ONMF), have been recently introduced and shown to work remarkably well for…

Optimization and Control · Mathematics 2015-03-19 Filippo Pompili , Nicolas Gillis , P. -A. Absil , François Glineur

Interpreting deep neural networks through concept-based explanations offers a bridge between low-level features and high-level human-understandable semantics. However, existing automatic concept discovery methods often fail to align these…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Dipkamal Bhusal , Michael Clifford , Sara Rampazzi , Nidhi Rastogi

We propose an efficient matrix rank reduction method for non-negative matrices, whose time complexity is quadratic in the number of rows or columns of a matrix. Our key insight is to formulate rank reduction as a mean-field approximation by…

Machine Learning · Statistics 2021-03-05 Kazu Ghalamkari , Mahito Sugiyama

Symmetric nonnegative matrix factorization (SNMF) is equivalent to computing a symmetric nonnegative low rank approximation of a data similarity matrix. It inherits the good data interpretability of the well-known nonnegative matrix…

Numerical Analysis · Computer Science 2017-10-11 Qingjiang Shi , Haoran Sun , Songtao Lu , Mingyi Hong , Meisam Razaviyayn

Nonnegative tensor factorization (NTF) has become an important tool for feature extraction and part-based representation with preserved intrinsic structure information from nonnegative high-order data. However, the original NTF methods…

Machine Learning · Computer Science 2024-01-04 Jianyu Wang , Linruize Tang

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures for denoising, classification,…

Machine Learning · Computer Science 2021-06-01 Jicong Fan , Chengrun Yang , Madeleine Udell

Non-negative Matrix Factorization (NMF) is a powerful technique for analyzing regularly-sampled data, i.e., data that can be stored in a matrix. For audio, this has led to numerous applications using time-frequency (TF) representations like…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-10 Krishna Subramani , Paris Smaragdis , Takuya Higuchi , Mehrez Souden

Non-negative matrix factorization (NMF) is a natural model of admixture and is widely used in science and engineering. A plethora of algorithms have been developed to tackle NMF, but due to the non-convex nature of the problem, there is…

Machine Learning · Computer Science 2015-07-09 Rong Ge , James Zou

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell

Semi-Nonnegative Matrix Factorization (semi-NMF) extends classical Nonnegative Matrix Factorization (NMF) by allowing the basis matrix to contain both positive and negative entries, making it suitable for decomposing data with mixed signs.…

Machine Learning · Computer Science 2025-08-12 Lu Chenggang

The model described in this paper belongs to the family of non-negative matrix factorization methods designed for data representation and dimension reduction. In addition to preserving the data positivity property, it aims also to preserve…

Machine Learning · Computer Science 2022-09-23 Rachid Hedjam , Abdelhamid Abdesselam , Abderrahmane Rahiche , Mohamed Cheriet

Dimensionality reduction is considered as an important step for ensuring competitive performance in unsupervised learning such as anomaly detection. Non-negative matrix factorization (NMF) is a popular and widely used method to accomplish…

Machine Learning · Computer Science 2021-02-08 Imtiaz Ahmed , Xia Ben Hu , Mithun P. Acharya , Yu Ding

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

Non-negative matrix factorization (NMF) is a new knowledge discovery method that is used for text mining, signal processing, bioinformatics, and consumer analysis. However, its basic property as a learning machine is not yet clarified, as…

Statistics Theory · Mathematics 2019-06-10 Naoki Hayashi , Sumio Watanabe

Non-negative Matrix Factorization (NMF) is an effective algorithm for multivariate data analysis, including applications to feature selection, pattern recognition, and computer vision. Its variant, Semi-Nonnegative Matrix Factorization…

Numerical Analysis · Mathematics 2024-10-23 Anthony Rhodes , Bin Jiang , Jenny Jiang

Nonnegative matrix factorization (NMF) has been widely used to learn low-dimensional representations of data. However, NMF pays the same attention to all attributes of a data point, which inevitably leads to inaccurate representation. For…

Machine Learning · Computer Science 2021-11-30 Jiao Wei , Can Tong , Bingxue Wu , Qiang He , Shouliang Qi , Yudong Yao , Yueyang Teng