English
Related papers

Related papers: A residual concept for Krylov subspace evaluation …

200 papers

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

We provide a framework for speeding up algorithms for time-bounded reachability analysis of continuous-time Markov decision processes. The principle is to find a small, but almost equivalent subsystem of the original system and only analyse…

Systems and Control · Computer Science 2018-07-26 Pranav Ashok , Yuliya Butkova , Holger Hermanns , Jan Křetínský

The overlap operator in lattice QCD requires the computation of the sign function of a matrix, which is non-Hermitian in the presence of a quark chemical potential. In previous work we introduced an Arnoldi-based Krylov subspace…

High Energy Physics - Lattice · Physics 2014-11-20 Jacques C. R. Bloch , Tobias Breu , Andreas Frommer , Simon Heybrock , Katrin Schäfer , Tilo Wettig

We present variants of the Conjugate Gradient (CG), Conjugate Residual (CR), and Generalized Minimal Residual (GMRES) methods which are both pipelined and flexible. These allow computation of inner products and norms to be overlapped with…

Numerical Analysis · Mathematics 2016-09-16 Patrick Sanan , Sascha M. Schnepp , Dave. A. May

Given a limited amount of memory and a target accuracy, we propose and compare several polynomial Krylov methods for the approximation of f(A)b, the action of a Stieltjes matrix function of a large Hermitian matrix on a vector. Using new…

Numerical Analysis · Mathematics 2020-11-04 Stefan Güttel , Marcel Schweitzer

High frequency integral equation methodologies display the capability of reproducing single-scattering returns in frequency-independent computational times and employ a Neumann series formulation to handle multiple-scattering effects. This…

Numerical Analysis · Mathematics 2018-01-16 Yassine Boubendir , Fatih Ecevit , Fernando Reitich

We improve the current best running time value to invert sparse matrices over finite fields, lowering it to an expected $O\big(n^{2.2131}\big)$ time for the current values of fast rectangular matrix multiplication. We achieve the same…

Data Structures and Algorithms · Computer Science 2022-12-13 Sílvia Casacuberta , Rasmus Kyng

The discretization of convection-diffusion equations by implicit or semi-implicit methods leads to a sequence of linear systems usually solved by iterative linear solvers such as GMRES. Many techniques bearing the name of \emph{recycling…

Numerical Analysis · Mathematics 2018-07-26 Giuseppe Pitton , Luca Heltai

Quantum subspace diagonalization (QSD) algorithms have emerged as a competitive family of algorithms that avoid many of the optimization pitfalls associated with parameterized quantum circuit algorithms. While the vast majority of the QSD…

Quantum Physics · Physics 2022-10-19 Cristian L. Cortes , A. Eugene DePrince , Stephen K. Gray

In this paper, we develop efficient and accurate algorithms for evaluating $\varphi(A)$ and $\varphi(A)b$, where $A$ is an $N\times N$ matrix, $b$ is an $N$ dimensional vector and $\varphi$ is the function defined by…

Numerical Analysis · Mathematics 2021-01-26 Siyu Yang , Dongping Li

In this paper, we propose a novel reduced-rank adaptive filtering algorithm by blending the idea of the Krylov subspace methods with the set-theoretic adaptive filtering framework. Unlike the existing Krylov-subspace-based reduced-rank…

Information Theory · Computer Science 2013-06-28 R. C. de Lamare , M. Yukawa , I. Yamada

Parallel implementations of Krylov subspace methods often help to accelerate the procedure of finding an approximate solution of a linear system. However, such parallelization coupled with asynchronous and out-of-order execution often…

Mathematical Software · Computer Science 2023-02-09 Roman Iakymchuk , Jose I. Aliaga

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

In recent years, randomized algorithms have established themselves as fundamental tools in computational linear algebra, with applications in scientific computing, machine learning, and quantum information science. Many randomized matrix…

Numerical Analysis · Mathematics 2025-12-19 Ethan N. Epperly

Low-rank Krylov methods are one of the few options available in the literature to address the numerical solution of large-scale general linear matrix equations. These routines amount to well-known Krylov schemes that have been equipped with…

Numerical Analysis · Mathematics 2020-01-28 Davide Palitta , Patrick Kürschner

We propose two methods to find a proper shift parameter in the shift-and-invert method for computing matrix exponential matrix-vector products. These methods are useful in the case of matrix exponential action has to be computed for a…

Numerical Analysis · Mathematics 2019-10-01 Alexandr Katrutsa , Mike Botchev , Ivan Oseledets

We consider Arnoldi like processes to obtain symplectic subspaces for Hamiltonian systems. Large systems are locally approximated by ones living in low dimensional subspaces; we especially consider Krylov subspaces and some extensions. This…

Numerical Analysis · Mathematics 2021-06-24 Antti Koskela

With the emergence of mixed precision capabilities in hardware, iterative refinement schemes for solving linear systems $Ax=b$ have recently been revisited and reanalyzed in the context of three or more precisions. These new analyses show…

Numerical Analysis · Mathematics 2022-02-17 Eda Oktay , Erin Carson

Many Krylov subspace methods for shifted linear systems take advantage of the invariance of the Krylov subspace under a shift of the matrix. However, exploiting this fact in the non-Hermitian case introduces restrictions; e.g., initial…

Numerical Analysis · Mathematics 2016-02-05 Kirk M. Soodhalter

We propose a new algorithm for efficiently solving the damped Fisher matrix in large-scale scenarios where the number of parameters significantly exceeds the number of available samples. This problem is fundamental for natural gradient…

Machine Learning · Computer Science 2023-10-27 Yixiao Chen , Hao Xie , Han Wang