English
Related papers

Related papers: Regularized L21-Based Semi-NonNegative Matrix Fact…

200 papers

Nonnegative matrix factorization (NMF) is widely used for clustering with strong interpretability. Among general NMF problems, symmetric NMF is a special one that plays an important role in graph clustering where each element measures the…

Machine Learning · Computer Science 2023-11-07 Mengyuan Zhang , Kai Liu

Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Zhenxing Guo , Shihua Zhang

Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations. For NMF, a sparser solution implies better parts-based…

Machine Learning · Computer Science 2022-04-25 Chong Peng , Yiqun Zhang , Yongyong Chen , Zhao Kang , Chenglizhao Chen , Qiang Cheng

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

In this paper, we apply the Feature Space Decomposition (FSD) method developed in [LS24, GLS25, LSSW26, ALSS26] to obtain, under fairly general conditions, matching upper and lower bounds for the population excess risk of spectral methods…

Statistics Theory · Mathematics 2026-05-18 Guillaume Lecué , Zhifan Li , Zong Shang

Non-negative matrix factorization (NMF) is a fundamental matrix decomposition technique that is used primarily for dimensionality reduction and is increasing in popularity in the biological domain. Although finding a unique NMF is generally…

Information Theory · Computer Science 2021-08-23 Rami Nasser , Yonina C. Eldar , Roded Sharan

Nonnegative Matrix Factorization (NMF) is a widely used technique for data representation. Inspired by the expressive power of deep learning, several NMF variants equipped with deep architectures have been proposed. However, these methods…

Machine Learning · Computer Science 2017-11-21 Yuning Qiu , Guoxu Zhou , Kan Xie

Non-negative Matrix Factorization (NMF) is one of the most popular techniques for data representation and clustering, and has been widely used in machine learning and data analysis. NMF concentrates the features of each sample into a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Maoguo Gong , Xuelong Li

Recurrent neural networks (RNNs) are powerful tools for sequential modeling, but typically require significant overparameterization and regularization to achieve optimal performance. This leads to difficulties in the deployment of large…

Machine Learning · Computer Science 2021-11-11 Charles C. Onu , Jacob E. Miller , Doina Precup

The symmetric Nonnegative Matrix Factorization (NMF), a special but important class of the general NMF, has found numerous applications in data analysis such as various clustering tasks. Unfortunately, designing fast algorithms for the…

Machine Learning · Computer Science 2023-01-26 Xiao Li , Zhihui Zhu , Qiuwei Li , Kai Liu

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…

In this work, we introduce a highly efficient algorithm to address the nonnegative matrix underapproximation (NMU) problem, i.e., nonnegative matrix factorization (NMF) with an additional underapproximation constraint. NMU results are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Mariano Tepper , Guillermo Sapiro

Non-negative matrix factorization (NMF) has become a popular machine learning approach to many problems in text mining, speech and image processing, bio-informatics and seismic data analysis to name a few. In NMF, a matrix of non-negative…

Numerical Analysis · Computer Science 2013-03-19 Hugo Van hamme

Low-rank matrix completion has achieved great success in many real-world data applications. A matrix factorization model that learns latent features is usually employed and, to improve prediction performance, the similarities between latent…

Machine Learning · Statistics 2020-01-28 Kaiyi Ji , Jian Tan , Jinfeng Xu , Yuejie Chi

Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for…

Machine Learning · Computer Science 2018-11-15 Zhihui Zhu , Xiao Li , Kai Liu , Qiuwei Li

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized…

Machine Learning · Computer Science 2023-12-13 Ke Hu , WeiDong Qiu , Peng Tang

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Low-Rank Factorization (LRF) is a widely adopted technique for compressing deep neural networks (DNNs). However, it faces several challenges, including optimal rank selection, a vast design space, long fine-tuning times, and limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 M. Kokhazadeh , G. Keramidas , V. Kelefouras

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes