English
Related papers

Related papers: Algorithms for Nonnegative Matrix Factorization wi…

200 papers

Non-Negative Matrix Factorization (NMF) is an unsupervised learning method offering low-rank representations across various domains such as audio processing, biomedical signal analysis, and image recognition. The incorporation of…

Machine Learning · Computer Science 2025-10-09 Yasaman Torabi , Shahram Shirani , James P. Reilly

Non-negative matrix factorization with the generalized Kullback-Leibler divergence (NMF) and latent Dirichlet allocation (LDA) are two popular approaches for dimensionality reduction of non-negative data. Here, we show that NMF with…

Machine Learning · Computer Science 2024-06-03 Benedikt Geiger , Peter J. Park

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…

Nonnegative matrix factorization (NMF), which is the approximation of a data matrix as the product of two nonnegative matrices, is a key issue in machine learning and data analysis. One approach to NMF is to formulate the problem as a…

Optimization and Control · Mathematics 2016-11-02 Hideaki Iiduka , Shizuka Nishino

Nonnegative Matrix Factorization (NMF), first proposed in 1994 for data analysis, has received successively much attention in a great variety of contexts such as data mining, text clustering, computer vision, bioinformatics, etc. In this…

Numerical Analysis · Mathematics 2019-03-05 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

Nonnegative Matrix Factorization (NMF) is a widely used technique for data representation. Inspired by the expressive power of deep learning, several NMF variants equipped with deep architectures have been proposed. However, these methods…

Machine Learning · Computer Science 2017-11-21 Yuning Qiu , Guoxu Zhou , Kan Xie

Nonnegative matrix factorization (NMF) is a popular dimension reduction technique that produces interpretable decomposition of the data into parts. However, this decompostion is not generally identifiable (even up to permutation and…

Machine Learning · Computer Science 2016-04-05 W. Pan , F. Doshi-Velez

Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices and has been widely used for unsupervised learning tasks such as product recommendation based on a rating matrix. However, although…

Social and Information Networks · Computer Science 2015-04-03 Junyu Xuan , Jie Lu , Xiangfeng Luo , Guangquan Zhang

Symmetric nonnegative matrix factorization (SymNMF) is a powerful tool for clustering, which typically uses the $k$-nearest neighbor ($k$-NN) method to construct similarity matrix. However, $k$-NN may mislead clustering since the neighbors…

Machine Learning · Computer Science 2024-12-06 Wenlong Lyu , Yuheng Jia

Nonnegative matrix factorization (NMF) is widely used for clustering with strong interpretability. Among general NMF problems, symmetric NMF is a special one that plays an important role in graph clustering where each element measures the…

Machine Learning · Computer Science 2023-11-07 Mengyuan Zhang , Kai Liu

Nonnegative Matrix Factorization (NMF) is a widely-used data analysis technique, and has yielded impressive results in many real-world tasks. Generally, existing NMF methods represent each sample with several centroids, and find the optimal…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Xuelong Li

Nonnegative matrix factorization (NMF) was popularized as a tool for data mining by Lee and Seung in 1999. NMF attempts to approximate a matrix with nonnegative entries by a product of two low-rank matrices, also with nonnegative entries.…

Information Retrieval · Computer Science 2008-05-02 Michael Biggs , Ali Ghodsi , Stephen Vavasis

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

Non-negative Matrix Factorization(NMF) algorithm can only be used to find low rank approximation of original non-negative data while Concept Factorization(CF) algorithm extends matrix factorization to single non-linear kernel space,…

Machine Learning · Computer Science 2024-10-29 Fei Li , Liang Du , Chaohong Ren

Non-negative matrix factorization (NMF) is a dimensionality reduction technique that has shown promise for analyzing noisy data, especially astronomical data. For these datasets, the observed data may contain negative values due to noise…

Instrumentation and Methods for Astrophysics · Physics 2024-10-04 Dylan Green , Stephen Bailey

In this paper, we propose a novel supervised single-channel speech enhancement method combing the the Kullback-Leibler divergence-based non-negative matrix factorization (NMF) and hidden Markov model (NMF-HMM). With the application of HMM,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-01 Yang Xiang , Liming Shi , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

Non-negative matrix factorization (NMF) is a fundamental non-convex optimization problem with numerous applications in Machine Learning (music analysis, document clustering, speech-source separation etc). Despite having received extensive…

Machine Learning · Computer Science 2020-03-20 Ioannis Panageas , Stratis Skoulakis , Antonios Varvitsiotis , Xiao Wang

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms. This paper…

Machine Learning · Statistics 2018-05-02 N. Benjamin Erichson , Ariana Mendible , Sophie Wihlborn , J. Nathan Kutz

Dimensionality Reduction plays a pivotal role in improving feature learning accuracy and reducing training time by eliminating redundant features, noise, and irrelevant data. Nonnegative Matrix Factorization (NMF) has emerged as a popular…

Machine Learning · Computer Science 2024-05-07 Farid Saberi-Movahed , Kamal Berahman , Razieh Sheikhpour , Yuefeng Li , Shirui Pan