English
Related papers

Related papers: Stochastic Matrix Factorization

200 papers

The standard theorem for regular stochastic matrices is generalized to matrices with no sign restriction on the entries. The condition that column sums be equal to 1 is kept, but the regularity condition is replaced by a condition on the…

Rings and Algebras · Mathematics 2007-09-05 Branko Ćurgus , Robert I. Jewett

Matrix Factorization has emerged as a widely adopted framework for modeling data exhibiting low-rank structures. To address challenges in manifold learning, this paper presents a subspace-constrained quadratic matrix factorization model.…

Machine Learning · Computer Science 2024-11-08 Zheng Zhai , Xiaohui Li

Nonnegative matrix factorization (NMF) is a popular dimension reduction technique that produces interpretable decomposition of the data into parts. However, this decompostion is not generally identifiable (even up to permutation and…

Machine Learning · Computer Science 2016-04-05 W. Pan , F. Doshi-Velez

Numerous algorithms are used for nonnegative matrix factorization under the assumption that the matrix is nearly separable. In this paper, we show how to make these algorithms efficient for data matrices that have many more rows than…

Machine Learning · Computer Science 2018-01-08 Austin R. Benson , Jason D. Lee , Bartek Rajwa , David F. Gleich

In this work we perform some mathematical analysis on non-negative matrix factorizations (NMF) and apply NMF to some imaging and inverse problems. We will propose a sparse low-rank approximation of big positive data and images in terms of…

Optimization and Control · Mathematics 2015-04-24 Yat Tin Chow , Kazufumi Ito , Jun Zou

Nonnegative matrix factorization (NMF) is a linear dimensionality technique for nonnegative data with applications such as image analysis, text mining, audio source separation and hyperspectral unmixing. Given a data matrix $M$ and a…

Machine Learning · Computer Science 2021-04-14 Junjun Pan , Nicolas Gillis

We derive approximation algorithms for the nonnegative matrix factorization problem, i.e. the problem of factorizing a matrix as the product of two matrices with nonnegative coefficients. We form convex approximations of this problem which…

Optimization and Control · Mathematics 2012-07-03 Vijay Krishnamurthy , Alexandre d'Aspremont

In this paper we consider a general matrix factorization model which covers a large class of existing models with many applications in areas such as machine learning and imaging sciences. To solve this possibly nonconvex, nonsmooth and…

Optimization and Control · Mathematics 2018-05-16 Lei Yang , Ting Kei Pong , Xiaojun Chen

Factor analysis aims to describe high dimensional random vectors by means of a small number of unknown common factors. In mathematical terms, it is required to decompose the covariance matrix $\Sigma$ of the random vector as the sum of a…

Optimization and Control · Mathematics 2017-08-02 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

Factorization models express a statistical object of interest in terms of a collection of simpler objects. For example, a matrix or tensor can be expressed as a sum of rank-one components. However, in practice, it can be challenging to…

Methodology · Statistics 2022-12-06 Lorenzo Schiavon , Antonio Canale , David B. Dunson

Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Zhenxing Guo , Shihua Zhang

Nonnegative matrix factorization (NMF) is a popular model in the field of pattern recognition. It aims to find a low rank approximation for nonnegative data M by a product of two nonnegative matrices W and H. In general, NMF is NP-hard to…

Machine Learning · Computer Science 2021-09-07 Junjun Pan , Michael K. Ng

We give an algorithm for computing approximate PSD factorizations of nonnegative matrices. The running time of the algorithm is polynomial in the dimensions of the input matrix, but exponential in the PSD rank and the approximation error.…

Data Structures and Algorithms · Computer Science 2016-02-25 Amitabh Basu , Michael Dinitz , Xin Li

Nonnegative Matrix Factorization (NMF), first proposed in 1994 for data analysis, has received successively much attention in a great variety of contexts such as data mining, text clustering, computer vision, bioinformatics, etc. In this…

Numerical Analysis · Mathematics 2019-03-05 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…

Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals…

Machine Learning · Computer Science 2015-05-05 Nirav Bhatt , Arun Ayyar

We propose a new variant of nonnegative matrix factorization (NMF), combining separability and sparsity assumptions. Separability requires that the columns of the first NMF factor are equal to columns of the input matrix, while sparsity…

Machine Learning · Computer Science 2020-06-16 Nicolas Nadisic , Arnaud Vandaele , Jeremy E. Cohen , Nicolas Gillis

Non-negative matrix factorization (NMF) is an important technique for obtaining low dimensional representations of datasets. However, classical NMF does not take into account data that is collected at different times or in different…

Machine Learning · Computer Science 2023-11-21 James Chapman , Yotam Yaniv , Deanna Needell

Manifold regularization methods for matrix factorization rely on the cluster assumption, whereby the neighborhood structure of data in the input space is preserved in the factorization space. We argue that using the k-neighborhoods of all…

Machine Learning · Computer Science 2020-10-21 Priya Mani , Carlotta Domeniconi , Igor Griva

Factor analysis models explain dependence among observed variables by a smaller number of unobserved factors. A main challenge in confirmatory factor analysis is determining whether the factor loading matrix is identifiable from the…

Statistics Theory · Mathematics 2026-01-21 Nils Sturma , Miriam Kranzlmueller , Irem Portakal , Mathias Drton