English
Related papers

Related papers: Fifty Three Matrix Factorizations: A systematic ap…

200 papers

LU-factorization of matrices is one of the fundamental algorithms of linear algebra. The widespread use of supercomputers with distributed memory requires a review of traditional algorithms, which were based on the common memory of a…

Symbolic Computation · Computer Science 2020-11-10 Gennadi Malaschonok

Constrained low-rank matrix approximations have been known for decades as powerful linear dimensionality reduction techniques to be able to extract the information contained in large data sets in a relevant way. However, such low-rank…

Machine Learning · Computer Science 2021-12-20 Pierre De Handschutter , Nicolas Gillis , Xavier Siebert

The tensor Singular Value Decomposition (t-SVD) for third order tensors that was proposed by Kilmer and Martin~\cite{2011kilmer} has been applied successfully in many fields, such as computed tomography, facial recognition, and video…

Numerical Analysis · Mathematics 2016-09-23 Jiani Zhang , Arvind K. Saibaba , Misha Kilmer , Shuchin Aeron

In this work we consider the Takagi factorization of a matrix valued function depending on parameters. We give smoothness and genericity results and pay particular attention to the concerns caused by having either a singular value equal to…

Numerical Analysis · Mathematics 2024-02-13 Luca Dieci , Alessandra Papini , Alessandro Pugliese

In this paper, we revisit implicit regularization from the ground up using notions from dynamical systems and invariant subspaces of Morse functions. The key contributions are a new criterion for implicit regularization---a leading…

Machine Learning · Computer Science 2020-02-04 Mohamed Ali Belabbas

Singular value decomposition (SVD) is a widely used technique for dimensionality reduction and computation of basis vectors. In many applications, especially in fluid mechanics and image processing the matrices are dense, but low-rank…

Numerical Analysis · Computer Science 2019-05-13 Vinita Vasudevan , M. Ramakrishna

Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental…

Disordered Systems and Neural Networks · Physics 2023-08-01 Francesco Camilli , Marc Mézard

The nonnegative matrix factorization is a widely used, flexible matrix decomposition, finding applications in biology, image and signal processing and information retrieval, among other areas. Here we present a related matrix factorization.…

Machine Learning · Statistics 2017-12-12 David W Dreisigmeyer

Matrix Factorization is a widely adopted technique in the field of recommender system. Matrix Factorization techniques range from SVD, LDA, pLSA, SVD++, MatRec, Zipf Matrix Factorization and Item2Vec. In recent years, distributed word…

Information Retrieval · Computer Science 2022-04-28 Hao Wang

Singular Value Decomposition (SVD) is a powerful tool for multivariate analysis. However, independent computation of the SVD for each sample taken from a bandlimited matrix random process will result in singular value sample paths whose…

Statistics Theory · Mathematics 2007-06-13 D. W. Browne , M. W. Browne , M. P. Fitz

Finite dimensional modular Lie superalgebras over algebraically closed fields with indecomposable Cartan matrices are classified under some technical, most probably inessential, hypotheses. If the Cartan matrix is invertible, the…

Representation Theory · Mathematics 2009-06-11 Sofiane Bouarroudj , Pavel Grozman , Dimitry Leites

We generalize several important results from the perturbation theory of linear operators to the setting of semisimple orthogonal symmetric Lie algebras. These Lie algebras provide a unifying framework for various notions of matrix…

Representation Theory · Mathematics 2023-07-04 Emanuel Malvetti , Gunther Dirr , Frederik vom Ende , Thomas Schulte-Herbrüggen

We present a matrix version of a known method of constructing common eigenvectors of two diagonalizable commuting matrices, thus enabling their simultaneous diagonalization. The matrices may have simple eigenvalues of multiplicity greater…

General Mathematics · Mathematics 2020-07-01 Ronald P. Nordgren

There are two problems need to be dealt with for Non-negative Matrix Factorization (NMF): choose a suitable rank of the factorization and provide a good initialization method for NMF algorithms. This paper aims to solve these two problems…

Machine Learning · Computer Science 2014-10-13 Hanli Qiao

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

Jacobi-type iterative algorithms for the eigenvalue decomposition, singular value decomposition, and Takagi factorization of complex matrices are presented. They are implemented as compact Fortran 77 subroutines in a freely available…

Computational Physics · Physics 2007-10-23 T. Hahn

Learning rich and compact representations is an open topic in many fields such as object recognition or image retrieval. Deep neural networks have made a major breakthrough during the last few years for these tasks but their representations…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Pierre Jacob , David Picard , Aymeric Histace , Edouard Klein

Data often comes in the form of an array or matrix. Matrix factorization techniques attempt to recover missing or corrupted entries by assuming that the matrix can be written as the product of two low-rank matrices. In other words, matrix…

Machine Learning · Computer Science 2015-12-16 Gintare Karolina Dziugaite , Daniel M. Roy

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey