English
Related papers

Related papers: Large Enforced Sparse Non-Negative Matrix Factoriz…

200 papers

We develop a unified and systematic framework for performing online nonnegative matrix factorization under a wide variety of important divergences. The online nature of our algorithm makes it particularly amenable to large-scale data. We…

Machine Learning · Statistics 2016-08-17 Renbo Zhao , Vincent Y. F. Tan , Huan Xu

Nonnegative matrix factorization (NMF) is a popular method for audio spectral unmixing. While NMF is traditionally applied to off-the-shelf time-frequency representations based on the short-time Fourier or Cosine transforms, the ability to…

Machine Learning · Statistics 2018-11-07 Pierre Ablin , Dylan Fagot , Herwig Wendt , Alexandre Gramfort , Cédric Févotte

Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices appropriate for the intended applications. The method has been widely used for unsupervised learning tasks, including recommender…

Machine Learning · Statistics 2015-07-14 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu , Xiangfeng Luo

Nonnegative matrix factorization can be used to automatically detect topics within a corpus in an unsupervised fashion. The technique amounts to an approximation of a nonnegative matrix as the product of two nonnegative matrices of lower…

Computation and Language · Computer Science 2022-12-21 Michael R. Lindstrom , Xiaofu Ding , Feng Liu , Anand Somayajula , Deanna Needell

Symmetric nonnegative matrix factorization (SNMF) has demonstrated to be a powerful method for data clustering. However, SNMF is mathematically formulated as a non-convex optimization problem, making it sensitive to the initialization of…

Machine Learning · Computer Science 2021-03-03 Yuheng Jia , Hui Liu , Junhui Hou , Sam Kwong , Qingfu Zhang

Nonnegative Matrix Factorization (NMF) models are widely used to recover linearly mixed nonnegative data. When the data is made of samplings of continuous signals, the factors in NMF can be constrained to be samples of nonnegative rational…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Cécile Hautecoeur , Lieven De Lathauwer , Nicolas Gillis , François Glineur

We consider the problem of regularized Poisson Non-negative Matrix Factorization (NMF) problem, encompassing various regularization terms such as Lipschitz and relatively smooth functions, alongside linear constraints. This problem holds…

Machine Learning · Computer Science 2024-04-26 Nathanaël Perraudin , Adrien Teutrie , Cécile Hébert , Guillaume Obozinski

We present a motivating example for matrix multiplication based on factoring a data matrix. Traditionally, matrix multiplication is motivated by applications in physics: composing rigid transformations, scaling, sheering, etc. We present an…

History and Overview · Mathematics 2018-04-04 Barak A. Pearlmutter , Helena Šmigoc

Nonnegative matrix factorization (NMF) is a standard linear dimensionality reduction technique for nonnegative data sets. In order to measure the discrepancy between the input data and the low-rank approximation, the Kullback-Leibler (KL)…

Optimization and Control · Mathematics 2021-05-12 Le Thi Khanh Hien , Nicolas Gillis

Nonnegative matrix factorization (NMF), which is the approximation of a data matrix as the product of two nonnegative matrices, is a key issue in machine learning and data analysis. One approach to NMF is to formulate the problem as a…

Optimization and Control · Mathematics 2016-11-02 Hideaki Iiduka , Shizuka Nishino

Nonnegative matrix factorization (NMF) has been actively investigated and used in a wide range of problems in the past decade. A significant amount of attention has been given to develop NMF algorithms that are suitable to model time series…

Machine Learning · Computer Science 2017-09-04 Nasser Mohammadiha , Paris Smaragdis , Ghazaleh Panahandeh , Simon Doclo

Lee and Seung (2000) introduced numerical solutions for non-negative matrix factorization (NMF) using iterative multiplicative update algorithms. These algorithms have been actively utilized as dimensionality reduction tools for…

Numerical Analysis · Mathematics 2025-01-23 Sungjae Cho

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures for denoising, classification,…

Machine Learning · Computer Science 2021-06-01 Jicong Fan , Chengrun Yang , Madeleine Udell

Nonnegative matrix factorization (NMF) has been shown to be identifiable under the separability assumption, under which all the columns(or rows) of the input data matrix belong to the convex cone generated by only a few of these columns(or…

Machine Learning · Statistics 2014-03-25 Jason Gejie Liu , Shuchin Aeron

In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex…

Numerical Analysis · Computer Science 2020-01-14 Andersen Man Shun Ang , Nicolas Gillis

Non-negative Matrix Factorization (NMF) is a popular tool for data exploration. Bayesian NMF promises to also characterize uncertainty in the factorization. Unfortunately, current inference approaches such as MCMC mix slowly and tend to get…

Machine Learning · Statistics 2016-10-28 M. Arjumand Masood , Finale Doshi-Velez

Nonnegative matrix factorization arises widely in machine learning and data analysis. In this paper, for a given factorization of rank r, we consider the sparse stochastic matrix factorization (SSMF) of decomposing a prescribed m-by-n…

Numerical Analysis · Mathematics 2022-07-19 Guiyun Xiao , Zheng-Jian Bai , Wai-Ki Ching

Nonnegative matrix factorization (NMF) is the problem of decomposing a given nonnegative $n \times m$ matrix $M$ into a product of a nonnegative $n \times d$ matrix $W$ and a nonnegative $d \times m$ matrix $H$. Restricted NMF requires in…

Formal Languages and Automata Theory · Computer Science 2016-05-24 Dmitry Chistikov , Stefan Kiefer , Ines Marušić , Mahsa Shirmohammadi , James Worrell

Dimensionality reduction is considered as an important step for ensuring competitive performance in unsupervised learning such as anomaly detection. Non-negative matrix factorization (NMF) is a popular and widely used method to accomplish…

Machine Learning · Computer Science 2021-02-08 Imtiaz Ahmed , Xia Ben Hu , Mithun P. Acharya , Yu Ding

Non-negative matrix factorization (NMF) is widely used for parts-based representations, yet formal inference for covariate effects is rarely available when the basis is learned under non-negativity. We introduce non-negative matrix…

Methodology · Statistics 2026-03-03 Kenichi Satoh