English
Related papers

Related papers: First Order Methods for Robust Non-negative Matrix…

200 papers

Inthischapterwediscusshowtolearnanoptimalmanifoldpresentationto regularize nonegative matrix factorization (NMF) for data representation problems. NMF,whichtriestorepresentanonnegativedatamatrixasaproductoftwolowrank nonnegative matrices,…

Machine Learning · Computer Science 2014-10-09 Jim Jing-Yan Wang , Xin Gao

We propose an efficient distributed out-of-memory implementation of the Non-negative Matrix Factorization (NMF) algorithm for heterogeneous high-performance-computing (HPC) systems. The proposed implementation is based on prior work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-14 Ismael Boureima , Manish Bhattarai , Maksim Eren , Erik Skau , Philip Romero , Stephan Eidenbenz , Boian Alexandrov

Non-negative matrix factorization (NMF) is a key technique for feature extraction and widely used in source separation. However, existing algorithms may converge to poor local minima, or to one of several minima with similar objective value…

Machine Learning · Computer Science 2024-10-30 Youdong Guo , Timothy E. Holy

This article presents a novel approach to solving the sparsity-constrained Orthogonal Nonnegative Matrix Factorization (SCONMF) problem, which requires decomposing a non-negative data matrix into the product of two lower-rank non-negative…

Data Structures and Algorithms · Computer Science 2025-04-07 Salar Basiri , Alisina Bayati , Srinivasa Salapaka

Machine learning algorithms typically perform optimization over a class of non-convex functions. In this work, we provide bounds on the fundamental hardness of identifying the global minimizer of a non convex function. Specifically, we…

Machine Learning · Computer Science 2021-07-07 Krishna Reddy Kesari , Jean Honorio

Nonnegative Matrix Factorization (NMF) is an unsupervised learning algorithm that produces a linear, parts-based approximation of a data matrix. NMF constructs a nonnegative low rank basis matrix and a nonnegative low rank matrix of weights…

Machine Learning · Statistics 2020-12-08 Matthew Corsetti , Ernest Fokoué

Nonnegative matrix factorization (NMF) is a popular method for audio spectral unmixing. While NMF is traditionally applied to off-the-shelf time-frequency representations based on the short-time Fourier or Cosine transforms, the ability to…

Machine Learning · Statistics 2018-11-07 Pierre Ablin , Dylan Fagot , Herwig Wendt , Alexandre Gramfort , Cédric Févotte

How can we process a piece of recorded music to detect and visualize the onset of each instrument? A simple, interpretable approach is based on partially fixed nonnegative matrix factorization (NMF). Yet despite the method's simplicity,…

Numerical Analysis · Mathematics 2026-01-16 Alisha L. Foster , Robert J. Webber

Nonnegative matrix factorization (NMF) is a powerful class of feature extraction techniques that has been successfully applied in many fields, namely in signal and image processing. Current NMF techniques have been limited to a…

Machine Learning · Statistics 2015-01-26 Paul Honeine , Fei Zhu

We investigate the use of low-precision first-order methods (FOMs) within a fix-and-propagate (FP) framework for solving mixed-integer programming problems (MIPs). We employ GPU-accelerated PDLP, a variant of the Primal-Dual Hybrid Gradient…

Optimization and Control · Mathematics 2026-03-05 Nils-Christian Kempke , Thorsten Koch

Non-negative Matrix Factorization (NMF) is an effective algorithm for multivariate data analysis, including applications to feature selection, pattern recognition, and computer vision. Its variant, Semi-Nonnegative Matrix Factorization…

Numerical Analysis · Mathematics 2024-10-23 Anthony Rhodes , Bin Jiang , Jenny Jiang

Motivated by the reconstruction and the prediction of electricity consumption, we extend Nonnegative Matrix Factorization~(NMF) to take into account side information (column or row features). We consider general linear measurement settings,…

Machine Learning · Statistics 2017-09-20 Jiali Mei , Yohann De Castro , Yannig Goude , Jean-Marc Azaïs , Georges Hébrail

Although many techniques have been applied to matrix factorization (MF), they may not fully exploit the feature structure. In this paper, we incorporate the grouping effect into MF and propose a novel method called Robust Matrix…

Machine Learning · Computer Science 2021-07-09 Haiyan Jiang , Shuyu Li , Luwei Zhang , Haoyi Xiong , Dejing Dou

Non-negative matrix factorization (NMF) has proved effective in many clustering and classification tasks. The classic ways to measure the errors between the original and the reconstructed matrix are $l_2$ distance or Kullback-Leibler (KL)…

Computer Vision and Pattern Recognition · Computer Science 2014-05-12 Le Li , Jianjun Yang , Kaili Zhao , Yang Xu , Honggang Zhang , Zhuoyi Fan

Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices and has been widely used for unsupervised learning tasks such as product recommendation based on a rating matrix. However, although…

Social and Information Networks · Computer Science 2015-04-03 Junyu Xuan , Jie Lu , Xiangfeng Luo , Guangquan Zhang

In this letter, we propose a new identification criterion that guarantees the recovery of the low-rank latent factors in the nonnegative matrix factorization (NMF) model, under mild conditions. Specifically, using the proposed criterion, it…

Machine Learning · Computer Science 2018-03-14 Xiao Fu , Kejun Huang , Nicholas D. Sidiropoulos

We introduce a new method based on nonnegative matrix factorization, Neural NMF, for detecting latent hierarchical structure in data. Datasets with hierarchical structure arise in a wide variety of fields, such as document classification,…

Machine Learning · Computer Science 2023-03-02 Tyler Will , Runyu Zhang , Eli Sadovnik , Mengdi Gao , Joshua Vendrow , Jamie Haddock , Denali Molitor , Deanna Needell

Factorization machines (FMs) are a supervised learning approach that can use second-order feature combinations even when the data is very high-dimensional. Unfortunately, despite increasing interest in FMs, there exists to date no efficient…

Machine Learning · Statistics 2016-10-17 Mathieu Blondel , Akinori Fujino , Naonori Ueda , Masakazu Ishihata

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

Nowadays, the availability of large-scale data in disparate application domains urges the deployment of sophisticated tools for extracting valuable knowledge out of this huge bulk of information. In that vein, low-rank representations…

Machine Learning · Computer Science 2017-10-06 Paris V. Giampouras , Athanasios A. Rontogiannis , Konstantinos D. Koutroumbas