English
Related papers

Related papers: Accelerated Parallel and Distributed Algorithm usi…

200 papers

Dimensionality reduction is considered as an important step for ensuring competitive performance in unsupervised learning such as anomaly detection. Non-negative matrix factorization (NMF) is a popular and widely used method to accomplish…

Machine Learning · Computer Science 2021-02-08 Imtiaz Ahmed , Xia Ben Hu , Mithun P. Acharya , Yu Ding

We introduce a new method based on nonnegative matrix factorization, Neural NMF, for detecting latent hierarchical structure in data. Datasets with hierarchical structure arise in a wide variety of fields, such as document classification,…

Machine Learning · Computer Science 2023-03-02 Tyler Will , Runyu Zhang , Eli Sadovnik , Mengdi Gao , Joshua Vendrow , Jamie Haddock , Denali Molitor , Deanna Needell

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

Matrix factorization is a common machine learning technique for recommender systems. Despite its high prediction accuracy, the Bayesian Probabilistic Matrix Factorization algorithm (BPMF) has not been widely used on large scale data because…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-12 Tom Vander Aa , Imen Chakroun , Tom Haber

Nonsmooth Nonnegative Matrix Factorization (nsNMF) is capable of producing more localized, less overlapped feature representations than other variants of NMF while keeping satisfactory fit to data. However, nsNMF as well as other existing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Jinshi Yu , Guoxu Zhou , Andrzej Cichocki , Shengli Xie

Lee and Seung (2000) introduced numerical solutions for non-negative matrix factorization (NMF) using iterative multiplicative update algorithms. These algorithms have been actively utilized as dimensionality reduction tools for…

Numerical Analysis · Mathematics 2025-01-23 Sungjae Cho

Symmetric nonnegative matrix factorization (symNMF) is a variant of nonnegative matrix factorization (NMF) that allows to handle symmetric input matrices and has been shown to be particularly well suited for clustering tasks. In this paper,…

Numerical Analysis · Mathematics 2020-03-11 François Moutier , Arnaud Vandaele , Nicolas Gillis

Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations. For NMF, a sparser solution implies better parts-based…

Machine Learning · Computer Science 2022-04-25 Chong Peng , Yiqun Zhang , Yongyong Chen , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Low-rank matrix factorization (MF) is an important technique in data science. The key idea of MF is that there exists latent structures in the data, by uncovering which we could obtain a compressed representation of the data. By factorizing…

Numerical Analysis · Computer Science 2016-05-09 Yuan Lu , Jie Yang

In this work, we consider nonnegative matrix factorization (NMF) with a regularization that promotes small volume of the convex hull spanned by the basis matrix. We present highly efficient algorithms for three different volume…

Numerical Analysis · Computer Science 2020-01-14 M. S. Ang , Nicolas Gillis

In this paper, we introduce and provide a short overview of nonnegative matrix factorization (NMF). Several aspects of NMF are discussed, namely, the application in hyperspectral imaging, geometry and uniqueness of NMF solutions,…

Numerical Analysis · Computer Science 2017-03-03 Nicolas Gillis

We present a novel game-theoretic formulation of Non-Negative Matrix Factorization (NNMF), a popular data-analysis method with many scientific and engineering applications. The game-theoretic formulation is shown to have favorable scaling…

Computer Science and Game Theory · Computer Science 2021-04-13 Satpreet H. Singh

In this work we introduce a comprehensive algorithmic pipeline for multiple parametric model estimation. The proposed approach analyzes the information produced by a random sampling algorithm (e.g., RANSAC) from a machine…

Computer Vision and Pattern Recognition · Computer Science 2016-11-14 Mariano Tepper , Guillermo Sapiro

We propose a fast non-gradient-based method of rank-1 non-negative matrix factorization (NMF) for missing data, called A1GM, that minimizes the KL divergence from an input matrix to the reconstructed rank-1 matrix. Our method is based on…

Machine Learning · Statistics 2022-02-21 Kazu Ghalamkari , Mahito Sugiyama

A distributed adaptive algorithm for estimation of sparse unknown parameters in the presence of nonGaussian noise is proposed in this paper based on normalized least mean fourth (NLMF) criterion. At the first step, local adaptive NLMF…

Information Theory · Computer Science 2015-12-09 Mojtaba Hajiabadi

Non-negative matrix factorization (NMF) minimizes the Euclidean distance between the data matrix and its low rank approximation, and it fails when applied to corrupted data because the loss function is sensitive to outliers. In this paper,…

Machine Learning · Computer Science 2019-06-04 Naiyang Guan , Tongliang Liu , Yangmuzi Zhang , Dacheng Tao , Larry S. Davis

Matrix Factorization (MF) on large scale data takes substantial time on a Central Processing Unit (CPU). While Graphical Processing Unit (GPU)s could expedite the computation of MF, the available memory on a GPU is finite. Leveraging GPUs…

Machine Learning · Computer Science 2023-04-28 Prasad Bhavana , Vineet Padmanabhan

We apply the vectorized Non-negative Matrix Factorization (NMF) method to post-processing of direct imaging data for exoplanetary systems such as circumstellar disks. NMF is an iterative approach, which first creates a non-orthogonal and…

Instrumentation and Methods for Astrophysics · Physics 2018-03-20 Bīn Rén , Laurent Pueyo , Guangtun Ben Zhu , John Debes , Gaspard Duchêne

Non-negative matrix factorization (NMF) is widely used for dimensionality reduction and interpretable analysis, but standard formulations are unsupervised and cannot directly exploit class labels. Existing supervised or semi-supervised…

Machine Learning · Computer Science 2025-10-14 Kenichi Satoh

Nonnegative matrix factorization (NMF) has been successfully applied to many areas for classification and clustering. Commonly-used NMF algorithms mainly target on minimizing the $l_2$ distance or Kullback-Leibler (KL) divergence, which may…

Information Retrieval · Computer Science 2014-10-07 Le Li , Jianjun Yang , Yang Xu , Zhen Qin , Honggang Zhang