English
Related papers

Related papers: A Globally Optimal Analytic Solution for Semi-Nonn…

200 papers

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

Symmetric nonnegative matrix factorization (SNMF) is equivalent to computing a symmetric nonnegative low rank approximation of a data similarity matrix. It inherits the good data interpretability of the well-known nonnegative matrix…

Numerical Analysis · Computer Science 2017-10-11 Qingjiang Shi , Haoran Sun , Songtao Lu , Mingyi Hong , Meisam Razaviyayn

Non-negative matrix factorization (NMF) approximates a non-negative endogenous data matrix as $Y_1 \approx XB$, with non-negative latent components $X$ and coefficients $B$. Standard covariate-aware NMF is feedforward: $B$ depends only on…

Methodology · Statistics 2026-05-18 Kenichi Satoh

Completely positive factorization (CPF) is a critical task with applications in many fields. This paper proposes a novel method for the CPF. Based on the idea of exterior point iteration, an optimization model is given, which aims to…

Optimization and Control · Mathematics 2021-02-17 Zhenyue Zhang , Bingjie Li

In this report, we discuss a simple model for RGB color and polarization images under a unified framework of quaternion nonnegative matrix factorization (QNMF) and present a hierarchical nonnegative least squares method to solve the factor…

Numerical Analysis · Mathematics 2024-07-23 Junjun Pan

Nonnegative matrix factorization arises widely in machine learning and data analysis. In this paper, for a given factorization of rank r, we consider the sparse stochastic matrix factorization (SSMF) of decomposing a prescribed m-by-n…

Numerical Analysis · Mathematics 2022-07-19 Guiyun Xiao , Zheng-Jian Bai , Wai-Ki Ching

In this paper we consider a general matrix factorization model which covers a large class of existing models with many applications in areas such as machine learning and imaging sciences. To solve this possibly nonconvex, nonsmooth and…

Optimization and Control · Mathematics 2018-05-16 Lei Yang , Ting Kei Pong , Xiaojun Chen

Nonnegative matrix factorization (NMF) has been widely used to dimensionality reduction in machine learning. However, the traditional NMF does not properly handle outliers, so that it is sensitive to noise. In order to improve the…

Machine Learning · Computer Science 2022-06-08 Tingting Shen , Junhang Li , Can Tong , Qiang He , Chen Li , Yudong Yao , Yueyang Teng

Nonnegative matrix factorization (NMF) is one of the most frequently-used matrix factorization models in data analysis. A significant reason to the popularity of NMF is its interpretability and the `parts of whole' interpretation of its…

Machine Learning · Computer Science 2018-01-19 Sanjar Karaev , James Hook , Pauli Miettinen

Nonnegative matrix factorization (NMF) has been widely used in machine learning and signal processing because of its non-subtractive, part-based property which enhances interpretability. It is often assumed that the latent dimensionality…

Machine Learning · Statistics 2018-10-25 Zhaoqiang Liu

Lee and Seung (2000) introduced numerical solutions for non-negative matrix factorization (NMF) using iterative multiplicative update algorithms. These algorithms have been actively utilized as dimensionality reduction tools for…

Numerical Analysis · Mathematics 2025-01-23 Sungjae Cho

Nonnegative matrix factorization (NMF) has been successfully applied to many areas for classification and clustering. Commonly-used NMF algorithms mainly target on minimizing the $l_2$ distance or Kullback-Leibler (KL) divergence, which may…

Information Retrieval · Computer Science 2014-10-07 Le Li , Jianjun Yang , Yang Xu , Zhen Qin , Honggang Zhang

We present a numerical algorithm for nonnegative matrix factorization (NMF) problems under noisy separability. An NMF problem under separability can be stated as one of finding all vertices of the convex hull of data points. The research…

Machine Learning · Statistics 2015-03-06 Tomohiko Mizutani

In this paper, we study the nonnegative matrix factorization problem under the separability assumption (that is, there exists a cone spanned by a small subset of the columns of the input nonnegative data matrix containing all columns),…

Machine Learning · Statistics 2014-04-07 Nicolas Gillis , Stephen A. Vavasis

The exact nonnegative matrix factorization (exact NMF) problem is the following: given an $m$-by-$n$ nonnegative matrix $X$ and a factorization rank $r$, find, if possible, an $m$-by-$r$ nonnegative matrix $W$ and an $r$-by-$n$ nonnegative…

Optimization and Control · Mathematics 2016-10-07 Arnaud Vandaele , Nicolas Gillis , François Glineur , Daniel Tuyttens

We propose an efficient distributed out-of-memory implementation of the Non-negative Matrix Factorization (NMF) algorithm for heterogeneous high-performance-computing (HPC) systems. The proposed implementation is based on prior work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-14 Ismael Boureima , Manish Bhattarai , Maksim Eren , Erik Skau , Philip Romero , Stephan Eidenbenz , Boian Alexandrov

Nonnegative matrix factorization (NMF) is a standard linear dimensionality reduction technique for nonnegative data sets. In order to measure the discrepancy between the input data and the low-rank approximation, the Kullback-Leibler (KL)…

Optimization and Control · Mathematics 2021-05-12 Le Thi Khanh Hien , Nicolas Gillis

Dimensionality reduction is considered as an important step for ensuring competitive performance in unsupervised learning such as anomaly detection. Non-negative matrix factorization (NMF) is a popular and widely used method to accomplish…

Machine Learning · Computer Science 2021-02-08 Imtiaz Ahmed , Xia Ben Hu , Mithun P. Acharya , Yu Ding

Collaborative filtering generates recommendations by exploiting user-item similarities based on rating data, which often contains numerous unrated items. To predict scores for unrated items, matrix factorization techniques such as…

Statistical Mechanics · Physics 2025-07-30 Yukino Terui , Yuka Inoue , Yohei Hamakawa , Kosuke Tatsumura , Kazue Kudo

To address the non-negativity dropout problem of quaternion models, a novel quasi non-negative quaternion matrix factorization (QNQMF) model is presented for color image processing. To implement QNQMF, the quaternion projected gradient…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yifen Ke , Changfeng Ma , Zhigang Jia , Yajun Xie , Riwei Liao