English
Related papers

Related papers: Two harmonic Jacobi--Davidson methods for computin…

200 papers

Sparsity regularization has garnered significant interest across multiple disciplines, including statistics, imaging, and signal processing. Standard techniques for addressing sparsity regularization include iterative soft thresholding…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

In this work, we develop deterministic and random sketching-based algorithms for two types of tensor interpolative decompositions (ID): the core interpolative decomposition (CoreID, also known as the structure-preserving HOSVD) and the…

Numerical Analysis · Mathematics 2025-03-25 Yifan Zhang , Mark Fornace , Michael Lindsey

Jacobian-vector products (JVPs) form the backbone of many recent developments in Deep Networks (DNs), with applications including faster constrained optimization, regularization with generalization guarantees, and adversarial example…

Machine Learning · Computer Science 2021-04-02 Randall Balestriero , Richard Baraniuk

We propose a new method for computing the eigenvalue decomposition of a dense real normal matrix $A$ through the decomposition of its skew-symmetric part. The method relies on algorithms that are known to be efficiently implemented, such as…

Numerical Analysis · Mathematics 2026-03-31 Simon Mataigne , Kyle A. Gallivan

Most nonlinear partial differential equation (PDE) solvers require the Jacobian matrix associated to the differential operator. In PETSc, this is typically achieved by either an analytic derivation or numerical approximation method such as…

Mathematical Software · Computer Science 2019-09-09 J. G. Wallwork , P. Hovland , H. Zhang , O. Marin

Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular…

Numerical Analysis · Mathematics 2023-03-08 Robin Herkert , Patrick Buchfink , Bernard Haasdonk , Johannes Rettberg , Jörg Fehr

We present a generalisation of the pseudoinverse operation to pairs of matrices, as opposed to single matrices alone. We note the fact that the Singular Value Decomposition can be used to compute the ordinary Moore-Penrose pseudoinverse. We…

Rings and Algebras · Mathematics 2021-12-07 Ran Gutin

Evaluating the entanglement spectrum is essential for characterizing exotic quantum phases such as quantum criticality and topological order. However, for large quantum many-body systems, this task is hindered by the exponential measurement…

Quantum Physics · Physics 2026-05-12 Shohei Miyakoshi , Takanori Sugimoto , Tomonori Shirakawa , Seiji Yunoki , Hiroshi Ueda

RSVDPACK is a library of functions for computing low rank approximations of matrices. The library includes functions for computing standard (partial) factorizations such as the Singular Value Decomposition (SVD), and also so called…

Numerical Analysis · Mathematics 2016-08-30 Sergey Voronin , Per-Gunnar Martinsson

Singular Value Decomposition (SVD) is a powerful tool for multivariate analysis. However, independent computation of the SVD for each sample taken from a bandlimited matrix random process will result in singular value sample paths whose…

Statistics Theory · Mathematics 2007-06-13 D. W. Browne , M. W. Browne , M. P. Fitz

In this paper, we present a class of high order methods to approximate the singular value decomposition of a given complex matrix (SVD). To the best of our knowledge, only methods up to order three appear in the the literature. A first part…

Numerical Analysis · Mathematics 2023-09-13 Diego Armentano , Jean-Claude Yakoubsohn

Fast computation of singular value decomposition (SVD) is of great interest in various machine learning tasks. Recently, SVD methods based on randomized linear algebra have shown significant speedup in this regime. This paper attempts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Yuechao Lu , Fumihiko Ino , Yasuyuki Matsushita

Recursive adaptive filtering methods are often used for solving the problem of simultaneous state and parameters estimation arising in many areas of research. The gradient-based schemes for adaptive Kalman filtering (KF) require the…

Systems and Control · Computer Science 2017-09-12 Julia V. Tsyganova , Maria V. Kulikova

A fast algorithm (linear in the degrees of freedom) for the solution of linear variable-coefficient rational-order fractional integral and differential equations is described. The approach is related to the ultraspherical method for…

Numerical Analysis · Mathematics 2017-12-04 Nicholas Hale , Sheehan Olver

In singular value decomposition (SVD) of a complex matrix A, the singular vectors or the eigenvectors of AA{\dag} and A{\dag}A are unique up to complex phase factors. Thus, the two unitary matrices in SVD are unique up to diagonal matrices…

Numerical Analysis · Mathematics 2022-03-24 Chu Ryang Wie

To analyze the abundance of multidimensional data, tensor-based frameworks have been developed. Traditionally, the matrix singular value decomposition (SVD) is used to extract the most dominant features from a matrix containing the…

Machine Learning · Computer Science 2021-11-02 Katherine Keegan , Tanvi Vishwanath , Yihua Xu

In this paper, we show that the SVD of a matrix can be constructed efficiently in a hierarchical approach. Our algorithm is proven to recover the singular values and left singular vectors if the rank of the input matrix $A$ is known.…

Numerical Analysis · Mathematics 2017-01-09 M. A. Iwen , B. W. Ong

The Semi-Algebraic framework for the approximate Canonical Polyadic (CP) decomposition via SImultaneaous matrix diagonalization (SECSI) is an efficient tool for the computation of the CP decomposition. The SECSI framework reformulates the…

Information Theory · Computer Science 2017-10-19 Sher Ali Cheema , Emilio Rafael Balda , Yao Cheng , Martin Haardt , Amir Weiss , Arie Yeredor

We analyze sparse frame based regularization of inverse problems by means of a diagonal frame decomposition (DFD) for the forward operator, which generalizes the SVD. The DFD allows to define a non-iterative (direct) operator-adapted frame…

Numerical Analysis · Mathematics 2019-12-13 Jürgen Frikel , Markus Haltmeier

Each iteration in Jacobi-Davidson method for solving large sparse eigenvalue problems involves two phases, called subspace expansion and eigen pair extraction. The subspace expansion phase involves solving a correction equation. We propose…

Numerical Analysis · Mathematics 2019-02-07 Mashetti Ravibabu