English
Related papers

Related papers: Fast Eigen Decomposition for Low-Rank Matrix Appro…

200 papers

This paper is concerned with computations of a few smaller eigenvalues (in absolute value) of a large extremely ill-conditioned matrix. It is shown that smaller eigenvalues can be accurately computed for a diagonally dominant matrix or a…

Numerical Analysis · Mathematics 2017-05-16 Qiang Ye

We consider the problem of recovering a unitary eigendecomposition of a complex unitary matrix from that of its embedded real-valued formulation. Such formulations arise naturally in scientific computing workflows that employ…

Numerical Analysis · Mathematics 2026-05-20 Stefanie Günther , N. Anders Petersson

The affine inverse eigenvalue problem consists of identifying a real symmetric matrix with a prescribed set of eigenvalues in an affine space. Due to its ubiquity in applications, various instances of the problem have been widely studied in…

Optimization and Control · Mathematics 2019-11-07 Utkan Candogan , Yong Sheng Soh , Venkat Chandrasekaran

Low-rank matrix completion is an important problem with extensive real-world applications. When observations are uniformly sampled from the underlying matrix entries, existing methods all require the matrix to be incoherent. This paper…

Machine Learning · Computer Science 2015-02-11 Shusen Wang , Tong Zhang , Zhihua Zhang

We give an efficient algorithm which can obtain a relative error approximation to the spectral norm of a matrix, combining the power iteration method with some techniques from matrix reconstruction which use random sampling.

Data Structures and Algorithms · Computer Science 2011-04-13 Malik Magdon-Ismail

We consider the problem of determining the weights of a quantum ensemble. That is to say, given a quantum system that is in a set of possible known states according to an unknown probability law, we give strategies to estimate the…

Quantum Physics · Physics 2010-02-01 J. I. de Vicente , J. Calsamiglia , R. Munoz-Tapia , E. Bagan

In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan…

Machine Learning · Statistics 2021-09-07 Reza Godaz , Reza Monsefi , Faezeh Toutounian , Reshad Hosseini

We present a new power method to obtain solutions of eigenvalue problems. The method can determine not only the dominant or lowest eigenvalues but also all eigenvalues without the need for a deflation procedure. The method uses a functional…

Numerical Analysis · Mathematics 2024-10-08 I Wayan Sudiarta , Hadi Susanto

We propose a new iterative algorithm for generating a subset of eigenvalues and eigenvectors of large matrices which generalizes the method of optimal relaxations. We also give convergence criteria for the iterative process, investigate its…

General Physics · Physics 2009-11-07 F. Andreozzi , A. Porrino , N. Lo Iudice

EigenDecomposition (ED) is at the heart of many computer vision algorithms and applications. One crucial bottleneck limiting its usage is the expensive computation cost, particularly for a mini-batch of matrices in deep neural networks. Our…

Machine Learning · Computer Science 2026-05-01 Yue Song

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

An algorithm for computing an analytic function of a matrix $A$ is described. The algorithm is intended for the case where $A$ has some close eigenvalues, and clusters (subsets) of close eigenvalues are separated from each other. This…

Numerical Analysis · Mathematics 2023-12-13 V. G. Kurbatov , I. V. Kurbatova

In this work we describe an efficient implementation of a hierarchy of algorithms for the decomposition of dense matrices over the field with two elements (GF(2)). Matrix decomposition is an essential building block for solving dense…

Mathematical Software · Computer Science 2010-06-10 Martin R. Albrecht , Clément Pernet

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

Two methods to decompose block matrices analogous to Singular Matrix Decomposition are proposed, one yielding the so called economy decomposition, and other yielding the full decomposition. This method is devised to avoid handling matrices…

Numerical Analysis · Mathematics 2008-06-07 Alvaro Francisco Huertas-Rosero

In this work, we discuss two modifications that can be made to a known variational quantum singular value decomposition algorithm popular in the literature. The first is a change to the objective function which hints at improved performance…

Quantum Physics · Physics 2024-12-05 Jezer Jojo , Ankit Khandelwal , M Girish Chandra

Covariance matrix estimates are an essential part of many signal processing algorithms, and are often used to determine a low-dimensional principal subspace via their spectral decomposition. However, exact eigenanalysis is computationally…

Applications · Statistics 2011-12-01 Nicholas Arcolano , Patrick J. Wolfe

Non-negative matrix factorization is a basic tool for decomposing data into the feature and weight matrices under non-negativity constraints, and in practice is often solved in the alternating minimization framework. However, it is unclear…

Machine Learning · Computer Science 2017-06-14 Yuanzhi Li , Yingyu Liang

It is well-known that every non-negative univariate real polynomial can be written as the sum of two polynomial squares with real coefficients. When one allows a weighted sum of finitely many squares instead of a sum of two squares, then…

Symbolic Computation · Computer Science 2017-06-14 Victor Magron , Mohab Safey El Din , Markus Schweighofer

In this paper, we present and analyze a new set of low-rank recovery algorithms for linear inverse problems within the class of hard thresholding methods. We provide strategies on how to set up these algorithms via basic ingredients for…

Numerical Analysis · Computer Science 2013-01-15 Anastasios Kyrillidis , Volkan Cevher