English
Related papers

Related papers: QR and LQ Decomposition Matrix Backpropagation Alg…

200 papers

The QR-algorithm is one of the most important algorithms in linear algebra. Its several variants make feasible the computation of the eigenvalues and eigenvectors of a numerical real or complex matrix, even when the dimensions of the matrix…

Numerical Analysis · Mathematics 2020-09-02 Avinash Kulkarni , Tristan Vaccon

CUR matrix decomposition computes the low rank approximation of a given matrix by using the actual rows and columns of the matrix. It has been a very useful tool for handling large matrices. One limitation with the existing algorithms for…

Machine Learning · Computer Science 2014-11-05 Miao Xu , Rong Jin , Zhi-Hua Zhou

When applying eigenvalue decomposition on the quadratic term matrix in a type of linear equally constrained quadratic programming (EQP), there exists a linear mapping to project optimal solutions between the new EQP formulation where $Q$ is…

Optimization and Control · Mathematics 2020-10-22 Shi Yu

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

Color image completion is a challenging problem in computer vision, but recent research has shown that quaternion representations of color images perform well in many areas. These representations consider the entire color image and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Juan Han , Kit Ian Kou , Jifei Miao , Lizhi Liu , Haojiang Li

We address the task of higher-order derivative evaluation of computer programs that contain QR decompositions and real symmetric eigenvalue decompositions. The approach is a combination of univariate Taylor polynomial arithmetic and matrix…

Numerical Analysis · Mathematics 2010-10-01 Sebastian F. Walter , Lutz Lehmann , René Lamour

This paper provides a comprehensive and detailed derivation of the backpropagation algorithm for graph convolutional neural networks using matrix calculus. The derivation is extended to include arbitrary element-wise activation functions…

Machine Learning · Computer Science 2024-08-05 Yen-Che Hsiao , Rongting Yue , Abhishek Dutta

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be tackled by solving a linear least-square problem, which can be done by finding the eigenvector…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Zheng Dang , Kwang Moo Yi , Yinlin Hu , Fei Wang , Pascal Fua , Mathieu Salzmann

The QR factorization and the SVD are two fundamental matrix decompositions with applications throughout scientific computing and data analysis. For matrices with many more rows than columns, so-called "tall-and-skinny matrices," there is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-08 Austin R. Benson , David F. Gleich , James Demmel

The CUR decomposition is a technique for low-rank approximation that selects small subsets of the columns and rows of a given matrix to use as bases for its column and rowspaces. It has recently attracted much interest, as it has several…

Numerical Analysis · Mathematics 2022-06-06 Yijun Dong , Per-Gunnar Martinsson

Making new methods for quantum problems often relies on using basic operations in linear algebra. Often these routines are hidden behind well-known libraries that have been optimized over decades. Attempting to improve on those basic…

Computational Physics · Physics 2026-04-29 Aaron Dayton , Kiana Gallagher , Sarah E. Huber , Thomas E. Baker

Although QR iterations dominate in eigenvalue computations, there are several important cases when alternative LR-type algorithms may be preferable. In particular, in the symmetric tridiagonal case where differential qd algorithm with…

Numerical Analysis · Mathematics 2012-08-20 Pavel Zhlobich

Backpropagation algorithm is the cornerstone for neural network analysis. Paper extends it for training any derivatives of neural network's output with respect to its input. By the dint of it feedforward networks can be used to solve or…

Neural and Evolutionary Computing · Computer Science 2017-12-13 V. I. Avrutskiy

Many data analysis applications deal with large matrices and involve approximating the matrix using a small number of ``components.'' Typically, these components are linear combinations of the rows and columns of the matrix, and are thus…

Data Structures and Algorithms · Computer Science 2007-08-29 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan

This article discusses a useful tool in dimensionality reduction and low-rank matrix approximation called the CUR decomposition. Various viewpoints of this method in the literature are synergized and are compared and contrasted; included in…

Numerical Analysis · Mathematics 2019-04-04 Keaton Hamm , Longxiu Huang

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

A fast implicit QR algorithm for eigenvalue computation of low rank corrections of unitary matrices is adjusted to work with matrix pencils arising from polynomial zerofinding problems . The modified QZ algorithm computes the generalized…

Numerical Analysis · Mathematics 2014-10-09 Paola Boito , Yuli Eidelman , Luca Gemignani

We introduce meta-factorization, a theory that describes matrix decompositions as solutions of linear matrix equations: the projector and the reconstruction equation. Meta-factorization reconstructs known factorizations, reveals their…

Numerical Analysis · Mathematics 2022-07-15 Michał P. Karpowicz

Recent studies on quantum computing algorithms focus on excavating features of quantum computers which have potential for contributing to computational model enhancements. Among various approaches, quantum annealing methods effectively…

Quantum Physics · Physics 2021-11-02 Sun Woo Park , Hyunju Lee , Byung Chun Kim , Youngho Woo , Kyungtaek Jun

Quantum computing (QC) promises significant advantages on certain hard computational tasks over classical computers. However, current quantum hardware, also known as noisy intermediate-scale quantum computers (NISQ), are still unable to…

Quantum Physics · Physics 2022-12-23 Elisha Siddiqui Matekole , Esther Ye , Ramya Iyer , Samuel Yen-Chi Chen