English
Related papers

Related papers: Robust Near-Separable Nonnegative Matrix Factoriza…

200 papers

Nonnegative matrix factorization (NMF) has been widely used in machine learning and signal processing because of its non-subtractive, part-based property which enhances interpretability. It is often assumed that the latent dimensionality…

Machine Learning · Statistics 2018-10-25 Zhaoqiang Liu

Binary data matrices can represent many types of data such as social networks, votes, or gene expression. In some cases, the analysis of binary matrices can be tackled with nonnegative matrix factorization (NMF), where the observed data…

Machine Learning · Statistics 2020-06-23 Alberto Lumbreras , Louis Filstroff , Cédric Févotte

Existing nonnegative matrix factorization methods focus on learning global structure of the data to construct basis and coefficient matrices, which ignores the local structure that commonly exists among data. In this paper, we propose a new…

Machine Learning · Computer Science 2019-07-10 Chong Peng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Nonnegative matrix factorization (NMF) is a widely used linear dimensionality reduction technique for nonnegative data. NMF requires that each data point is approximated by a convex combination of basis elements. Archetypal analysis (AA),…

Signal Processing · Electrical Eng. & Systems 2020-03-31 Pierre De Handschutter , Nicolas Gillis , Arnaud Vandaele , Xavier Siebert

In this paper, we study the general problem of optimizing a convex function $F(L)$ over the set of $p \times p$ matrices, subject to rank constraints on $L$. However, existing first-order methods for solving such problems either are too…

Machine Learning · Statistics 2017-12-12 Mohammadreza Soltani , Chinmay Hegde

Referring back to the original text in the course of hierarchical learning is a common human trait that ensures the right direction of learning. The models developed based on the concept of Non-negative Matrix Factorization (NMF), in this…

Machine Learning · Computer Science 2024-05-24 Prasun Dutta , Rajat K. De

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

We present a motivating example for matrix multiplication based on factoring a data matrix. Traditionally, matrix multiplication is motivated by applications in physics: composing rigid transformations, scaling, sheering, etc. We present an…

History and Overview · Mathematics 2018-04-04 Barak A. Pearlmutter , Helena Šmigoc

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Given a symmetric nonnegative matrix $A$, symmetric nonnegative matrix factorization (symNMF) is the problem of finding a nonnegative matrix $H$, usually with much fewer columns than $A$, such that $A \approx HH^T$. SymNMF can be used for…

Numerical Analysis · Computer Science 2016-10-07 Arnaud Vandaele , Nicolas Gillis , Qi Lei , Kai Zhong , Inderjit Dhillon

Non-negative matrix factorization (NMF) is a technique for finding latent representations of data. The method has been applied to corpora to construct topic models. However, NMF has likelihood assumptions which are often violated by real…

Machine Learning · Statistics 2017-11-22 Skyler Seto , Sarah Tan , Giles Hooker , Martin T. Wells

We present a novel graphical framework for modeling non-negative sequential data with hierarchical structure. Our model corresponds to a network of coupled non-negative matrix factorization (NMF) modules, which we refer to as a positive…

Machine Learning · Computer Science 2009-07-16 Brian K. Vogel

We consider the problem of regularized Poisson Non-negative Matrix Factorization (NMF) problem, encompassing various regularization terms such as Lipschitz and relatively smooth functions, alongside linear constraints. This problem holds…

Machine Learning · Computer Science 2024-04-26 Nathanaël Perraudin , Adrien Teutrie , Cécile Hébert , Guillaume Obozinski

Nonnegative matrix factorization (NMF), which is the approximation of a data matrix as the product of two nonnegative matrices, is a key issue in machine learning and data analysis. One approach to NMF is to formulate the problem as a…

Optimization and Control · Mathematics 2016-11-02 Hideaki Iiduka , Shizuka Nishino

Dimensionality reduction and matrix factorization techniques are important and useful machine-learning techniques in many fields. Nonnegative matrix factorization (NMF) is particularly useful for spectral analysis and image processing in…

Instrumentation and Methods for Astrophysics · Physics 2016-12-20 Guangtun Zhu

Non-negative matrix factorization is a popular tool for decomposing data into feature and weight matrices under non-negativity constraints. It enjoys practical success but is poorly understood theoretically. This paper proposes an algorithm…

Machine Learning · Computer Science 2016-11-15 Yuanzhi Li , Yingyu Liang , Andrej Risteski

Nonnegative matrix factorization (NMF), a dimensionality reduction and factor analysis method, is a special case in which factor matrices have low-rank nonnegative constraints. Considering the stochastic learning in NMF, we specifically…

Numerical Analysis · Computer Science 2018-04-05 Hiroyuki Kasai

By combining related objects, unsupervised machine learning techniques aim to reveal the underlying patterns in a data set. Non-negative Matrix Factorization (NMF) is a data mining technique that splits data matrices by imposing…

Artificial Intelligence · Computer Science 2023-08-10 Yasser Khalafaoui , Nistor Grozavu , Basarab Matei , Laurent-Walter Goix

Non-negative matrix factorization (NMF) approximates a non-negative endogenous data matrix as $Y_1 \approx XB$, with non-negative latent components $X$ and coefficients $B$. Standard covariate-aware NMF is feedforward: $B$ depends only on…

Methodology · Statistics 2026-05-18 Kenichi Satoh

In recent years, a number of methods have been developed for the dimension reduction and decomposition of multiple linked high-content data matrices. Typically these methods assume that just one dimension, rows or columns, is shared among…

Methodology · Statistics 2020-02-10 Michael J. O'Connell , Eric F. Lock