English
Related papers

Related papers: A Globally Optimal Analytic Solution for Semi-Nonn…

200 papers

This paper provides a theoretical support for clustering aspect of the nonnegative matrix factorization (NMF). By utilizing the Karush-Kuhn-Tucker optimality conditions, we show that NMF objective is equivalent to graph clustering…

Machine Learning · Computer Science 2011-12-20 Andri Mirzal

Using nonnegative/binary matrix factorization (NBMF), a matrix can be decomposed into a nonnegative matrix and a binary matrix. Our analysis of facial images, based on NBMF and using the Fujitsu Digital Annealer, leads to successful image…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Hinako Asaoka , Kazue Kudo

How can we process a piece of recorded music to detect and visualize the onset of each instrument? A simple, interpretable approach is based on partially fixed nonnegative matrix factorization (NMF). Yet despite the method's simplicity,…

Numerical Analysis · Mathematics 2026-01-16 Alisha L. Foster , Robert J. Webber

The backpropagation algorithm for calculating gradients has been widely used in computation of weights for deep neural networks (DNNs). This method requires derivatives of objective functions and has some difficulties finding appropriate…

Machine Learning · Computer Science 2016-05-17 Tetsuya Sakurai , Akira Imakura , Yuto Inoue , Yasunori Futamura

The nonnegative matrix factorization (NMF) is widely used in signal and image processing, including bio-informatics, blind source separation and hyperspectral image analysis in remote sensing. A great challenge arises when dealing with a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Fei Zhu , Paul Honeine , Maya Kallas

Nonnegative matrix factorization (NMF) has become a workhorse for signal and data analytics, triggered by its model parsimony and interpretability. Perhaps a bit surprisingly, the understanding to its model identifiability---the major…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Xiao Fu , Kejun Huang , Nicholas D. Sidiropoulos , Wing-Kin Ma

Non-Negative Matrix Factorization, NMF, attempts to find a number of archetypal response profiles, or parts, such that any sample profile in the dataset can be approximated by a close profile among these archetypes or a linear combination…

Applications · Statistics 2013-12-19 Paul Fogel

Recently, many works have demonstrated that Symmetric Non-negative Matrix Factorization~(SymNMF) enjoys a great superiority for various clustering tasks. Although the state-of-the-art algorithms for SymNMF perform well on synthetic data,…

Machine Learning · Computer Science 2022-05-27 Mingjie Li , Hao Kong , Zhouchen Lin

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample…

Machine Learning · Statistics 2017-03-06 Rui Zhu , Di Niu , Linglong Kong , Zongpeng Li

Non-negative Matrix Factorization (NMF) is a useful method to extract features from multivariate data, but an important and sometimes neglected concern is that NMF can result in non-unique solutions. Often, there exist a Set of Feasible…

Applications · Statistics 2021-01-20 Ragnhild Laursen , Asger Hobolth

Non-negative matrix factorization (NMF) is widely used for dimensionality reduction and interpretable analysis, but standard formulations are unsupervised and cannot directly exploit class labels. Existing supervised or semi-supervised…

Machine Learning · Computer Science 2025-10-14 Kenichi Satoh

Non-negative matrix factorisation (NMF) has been extensively applied to the problem of corrupted image data. Standard NMF approach minimises Euclidean distance between data matrix and factorised approximation. The traditional NMF technique…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Pengwei Yang , Chongyangzi Teng , Jack George Mangos

The problem of finding overlapping communities in networks has gained much attention recently. Optimization-based approaches use non-negative matrix factorization (NMF) or variants, but the global optimum cannot be provably attained in…

Machine Learning · Statistics 2017-06-26 Xueyu Mao , Purnamrita Sarkar , Deepayan Chakrabarti

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

Learning approaches rely on hyperparameters that impact the algorithm's performance and affect the knowledge extraction process from data. Recently, Nonnegative Matrix Factorization (NMF) has attracted a growing interest as a learning…

Numerical Analysis · Mathematics 2023-06-29 Nicoletta Del Buono , Flavia Esposito , Laura Selicato , Rafal Zdunek

Positive semidefinite matrix factorization (PSDMF) expresses each entry of a nonnegative matrix as the inner product of two positive semidefinite (psd) matrices. When all these psd matrices are constrained to be diagonal, this model is…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Dana Lahat , Yanbin Lang , Vincent Y. F. Tan , Cédric Févotte

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

Machine Learning · Statistics 2014-01-10 Jason Gejie Liu , Shuchin Aeron

We present a general-purpose data compression algorithm, Regularized L21 Semi-NonNegative Matrix Factorization (L21 SNF). L21 SNF provides robust, parts-based compression applicable to mixed-sign data for which high fidelity, individualdata…

Machine Learning · Computer Science 2020-05-12 Anthony D. Rhodes , Bin Jiang

In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex…

Numerical Analysis · Computer Science 2020-01-14 Andersen Man Shun Ang , Nicolas Gillis

A convergent algorithm for nonnegative matrix factorization with orthogonality constraints imposed on both factors is proposed in this paper. This factorization concept was first introduced by Ding et al. with intent to further improve…

Machine Learning · Computer Science 2018-11-16 Andri Mirzal