English
Related papers

Related papers: Fast and Effective Algorithms for Symmetric Nonneg…

200 papers

Non-negative matrix factorization (NMF) and non-negative tensor factorization (NTF) decompose non-negative high-dimensional data into non-negative low-rank components. NMF and NTF methods are popular for their intrinsic interpretability and…

Machine Learning · Computer Science 2024-12-02 Alexander Sietsema , Zerrin Vural , James Chapman , Yotam Yaniv , Deanna Needell

We study the sparse non-negative least squares (S-NNLS) problem. S-NNLS occurs naturally in a wide variety of applications where an unknown, non-negative quantity must be recovered from linear measurements. We present a unified framework…

Machine Learning · Statistics 2018-01-03 Igor Fedorov , Alican Nalci , Ritwik Giri , Bhaskar D. Rao , Truong Q. Nguyen , Harinath Garudadri

Given a collection of data points, non-negative matrix factorization (NMF) suggests to express them as convex combinations of a small set of `archetypes' with non-negative entries. This decomposition is unique only if the true archetypes…

Machine Learning · Statistics 2017-05-09 Hamid Javadi , Andrea Montanari

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

The stable principal component pursuit (SPCP) is a non-smooth convex optimization problem, the solution of which enables one to reliably recover the low rank and sparse components of a data matrix which is corrupted by a dense noise matrix,…

Optimization and Control · Mathematics 2015-02-10 Necdet Serhat Aybat , Garud Iyengar

Nonnegative matrix factorization (NMF) is a popular data embedding technique. Given a nonnegative data matrix $X$, it aims at finding two lower dimensional matrices, $W$ and $H$, such that $X\approx WH$, where the factors $W$ and $H$ are…

Machine Learning · Computer Science 2026-02-06 Olivier Vu Thanh , Nicolas Gillis

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

Numerical Analysis · Computer Science 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

We introduce fast algorithms for correlation clustering with respect to the Min Max objective that provide constant factor approximations on complete graphs. Our algorithms are the first purely combinatorial approximation algorithms for…

Data Structures and Algorithms · Computer Science 2023-01-31 Sami Davies , Benjamin Moseley , Heather Newman

The multiplicative update (MU) algorithm has been extensively used to estimate the basis and coefficient matrices in nonnegative matrix factorization (NMF) problems under a wide range of divergences and regularizers. However, theoretical…

Optimization and Control · Mathematics 2017-06-08 Renbo Zhao , Vincent Y. F. Tan

Despite our extensive knowledge of biophysical properties of neurons, there is no commonly accepted algorithmic theory of neuronal function. Here we explore the hypothesis that single-layer neuronal networks perform online symmetric…

Neurons and Cognition · Quantitative Biology 2015-05-06 Cengiz Pehlevan , Dmitri B. Chklovskii

This article presents a novel approach to solving the sparsity-constrained Orthogonal Nonnegative Matrix Factorization (SCONMF) problem, which requires decomposing a non-negative data matrix into the product of two lower-rank non-negative…

Data Structures and Algorithms · Computer Science 2025-04-07 Salar Basiri , Alisina Bayati , Srinivasa Salapaka

In order to solve large matrix completion problems with practical computational cost, an approximate approach based on matrix factorization has been widely used. Alternating least squares (ALS) and stochastic gradient descent (SGD) are two…

Numerical Analysis · Mathematics 2020-01-08 Chihiro Noguchi , Yoshiyuki Kabashima

Non-negative matrix factorization (NMF) is widely used for dimensionality reduction and interpretable analysis, but standard formulations are unsupervised and cannot directly exploit class labels. Existing supervised or semi-supervised…

Machine Learning · Computer Science 2025-10-14 Kenichi Satoh

Nonnegative Matrix Factorization (NMF) is a data analysis technique which allows compression and interpretation of nonnegative data. NMF became widely studied after the publication of the seminal paper by Lee and Seung (Learning the Parts…

Numerical Analysis · Mathematics 2008-10-24 Nicolas Gillis , François Glineur

We apply the vectorized Non-negative Matrix Factorization (NMF) method to post-processing of direct imaging data for exoplanetary systems such as circumstellar disks. NMF is an iterative approach, which first creates a non-orthogonal and…

Instrumentation and Methods for Astrophysics · Physics 2018-03-20 Bīn Rén , Laurent Pueyo , Guangtun Ben Zhu , John Debes , Gaspard Duchêne

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex…

Machine Learning · Computer Science 2021-11-04 Truong Son Hy , Risi Kondor

Non-negative matrix factorization (NMF) approximates a given matrix as a product of two non-negative matrices. Multiplicative algorithms deliver reliable results, but they show slow convergence for high-dimensional data and may be stuck…

Machine Learning · Computer Science 2014-12-05 Felipe Yanez , Francis Bach

This article proposes new multiplicative updates for nonnegative matrix factorization (NMF) with the $\beta$-divergence objective function. Our new updates are derived from a joint majorization-minimization (MM) scheme, in which an…

Machine Learning · Computer Science 2023-04-18 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

We present a matrix factorization algorithm that scales to input matrices that are large in both dimensions (i.e., that contains morethan 1TB of data). The algorithm streams the matrix columns while subsampling them, resulting in low…

Optimization and Control · Mathematics 2016-12-04 Arthur Mensch , Julien Mairal , Gaël Varoquaux , Bertrand Thirion

The exact nonnegative matrix factorization (exact NMF) problem is the following: given an $m$-by-$n$ nonnegative matrix $X$ and a factorization rank $r$, find, if possible, an $m$-by-$r$ nonnegative matrix $W$ and an $r$-by-$n$ nonnegative…

Optimization and Control · Mathematics 2016-10-07 Arnaud Vandaele , Nicolas Gillis , François Glineur , Daniel Tuyttens
‹ Prev 1 8 9 10 Next ›