English
Related papers

Related papers: Fast and Robust Recursive Algorithms for Separable…

200 papers

Non-negative matrix factorization (NMF) is the problem of determining two non-negative low rank factors $W$ and $H$, for the given input matrix $A$, such that $A \approx W H$. NMF is a useful tool for many applications in different domains…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-01 Ramakrishnan Kannan , Grey Ballard , Haesun Park

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

Machine Learning · Computer Science 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

Non-negative matrix factorization is a basic tool for decomposing data into the feature and weight matrices under non-negativity constraints, and in practice is often solved in the alternating minimization framework. However, it is unclear…

Machine Learning · Computer Science 2017-06-14 Yuanzhi Li , Yingyu Liang

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Hyperspectral unmixing has been an important technique that estimates a set of endmembers and their corresponding abundances from a hyperspectral image (HSI). Nonnegative matrix factorization (NMF) plays an increasingly significant role in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Xin-Ru Feng , Heng-Chao Li , Rui Wang , Qian Du , Xiuping Jia , Antonio Plaza

Existing nonnegative matrix factorization methods focus on learning global structure of the data to construct basis and coefficient matrices, which ignores the local structure that commonly exists among data. In this paper, we propose a new…

Machine Learning · Computer Science 2019-07-10 Chong Peng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$…

Optimization and Control · Mathematics 2014-07-08 Lorenzo Finesso , Peter Spreij

This paper studies the open problem of conformalized entry prediction in a row/column-exchangeable matrix. The matrix setting presents novel and unique challenges, but there exists little work on this interesting topic. We meticulously…

Machine Learning · Computer Science 2023-06-07 Meijia Shao , Yuan Zhang

A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed. A family of algorithms is developed using this…

Machine Learning · Statistics 2019-05-20 Karthik Devarajan

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Rina Panigrahy

This paper considers a restriction to non-negative matrix factorization in which at least one matrix factor is stochastic. That is, the elements of the matrix factors are non-negative and the columns of one matrix factor sum to 1. This…

Machine Learning · Statistics 2016-09-20 Christopher Adams

Nonnegative (linear) least square problems are a fundamental class of problems that is well-studied in statistical learning and for which solvers have been implemented in many of the standard programming languages used within the machine…

Optimization and Control · Mathematics 2022-03-09 Jelena Diakonikolas , Chenghui Li , Swati Padmanabhan , Chaobing Song

Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals…

Machine Learning · Computer Science 2015-05-05 Nirav Bhatt , Arun Ayyar

In this paper, we introduce novel fast matrix inversion algorithms that leverage triangular decomposition and recurrent formalism, incorporating Strassen's fast matrix multiplication. Our research places particular emphasis on triangular…

Numerical Analysis · Mathematics 2026-02-05 Mohamed Kamel Riahi

This paper provides a theoretical explanation on the clustering aspect of nonnegative matrix factorization (NMF). We prove that even without imposing orthogonality nor sparsity constraint on the basis and/or coefficient matrix, NMF still…

Machine Learning · Computer Science 2010-06-15 Andri Mirzal , Masashi Furukawa

We present a matrix factorization algorithm that scales to input matrices that are large in both dimensions (i.e., that contains morethan 1TB of data). The algorithm streams the matrix columns while subsampling them, resulting in low…

Optimization and Control · Mathematics 2016-12-04 Arthur Mensch , Julien Mairal , Gaël Varoquaux , Bertrand Thirion

Semi-Nonnegative Matrix Factorization (semi-NMF) extends classical Nonnegative Matrix Factorization (NMF) by allowing the basis matrix to contain both positive and negative entries, making it suitable for decomposing data with mixed signs.…

Machine Learning · Computer Science 2025-08-12 Lu Chenggang

We propose a strategy for the generation of fast and accurate versions of non-commutative recursive matrix multiplication algorithms. To generate these algorithms, we consider matrix and tensor norm bounds governing the stability and…

Numerical Analysis · Mathematics 2025-06-25 Jean-Guillaume Dumas , Clément Pernet , Alexandre Sedoglavic

The problem of matrix factorization motivated by diffraction or elasticity is studied. A powerful tool for analyzing its solutions is introduced, namely analytical continuation formulae are derived. Necessary condition for commutative…

Analysis of PDEs · Mathematics 2012-11-20 Andrey V. Shanin , Eugeny M. Doubravsky

Hyperspectral analysis has gained popularity over recent years as a way to infer what materials are displayed on a picture whose pixels consist of a mixture of spectral signatures. Computing both signatures and mixture coefficients is known…

Optimization and Control · Mathematics 2017-06-29 Adrien Faivre , Clément Dombry