English
Related papers

Related papers: Krylov subspace residual and restarting for certai…

200 papers

We derive a second-order ordinary differential equation (ODE) which is the limit of Nesterov's accelerated gradient method. This ODE exhibits approximate equivalence to Nesterov's scheme and thus can serve as a tool for analysis. We show…

Machine Learning · Statistics 2015-10-29 Weijie Su , Stephen Boyd , Emmanuel J. Candes

In this work, we present a new high order Discontinuous Galerkin time integration scheme for second-order (in time) differential systems that typically arise from the space discretization of the elastodynamics equation. By rewriting the…

Numerical Analysis · Mathematics 2021-12-06 Paola F. Antonietti , Ilario Mazzieri , Francesco Migliorini

We study the use of Krylov subspace recycling for the solution of a sequence of slowly-changing families of linear systems, where each family consists of shifted linear systems that differ in the coefficient matrix only by multiples of the…

Numerical Analysis · Mathematics 2014-10-01 Kirk M. Soodhalter , Daniel B. Szyld , Fei Xue

Block Krylov subspace methods (KSMs) comprise building blocks in many state-of-the-art solvers for large-scale matrix equations as they arise, e.g., from the discretization of partial differential equations. While extended and rational…

Numerical Analysis · Mathematics 2020-02-06 Daniel Kressner , Kathryn Lund , Stefano Massei , Davide Palitta

We propose a novel second-order optimization framework for training the emerging deep continuous-time models, specifically the Neural Ordinary Differential Equations (Neural ODEs). Since their training already involves expensive gradient…

Machine Learning · Computer Science 2021-11-09 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

In this paper, we consider a fast and second-order implicit difference method for approximation of a class of time-space fractional variable coefficients advection-diffusion equation. To begin with, we construct an implicit difference…

Numerical Analysis · Mathematics 2019-07-12 Yong-Liang Zhao , Ting-Zhu Huang , Xian-Ming Gu , Wei-Hua Luo

An accurate residual--time (AccuRT) restarting for computing matrix exponential actions of nonsymmetric matrices by the shift-and-invert (SAI) Krylov subspace method is proposed. The proposed restarting method is an extension of the…

Numerical Analysis · Mathematics 2019-12-06 M. A. Botchev

The aim of this paper is to apply a high-order discontinuous-in-time scheme to second-order hyperbolic partial differential equations (PDEs). We first discretize the PDEs in time while keeping the spatial differential operators…

Numerical Analysis · Mathematics 2021-11-30 Aili Shao

A new second-order numerical scheme based on an operator splitting is proposed for the Godunov-Peshkov-Romenski model of continuum mechanics. The homogeneous part of the system is solved with a finite volume method based on a WENO…

Computational Physics · Physics 2017-09-13 Haran Jackson

We derive an augmented Krylov subspace method with subspace recycling for computing a sequence of matrix function applications on a set of vectors. The matrix is either fixed or changes as the sequence progresses. We assume consecutive…

Numerical Analysis · Mathematics 2025-08-21 Liam Burke , Andreas Frommer , Gustavo Ramirez-Hidalgo , Kirk M. Soodhalter

Many Krylov subspace methods for shifted linear systems take advantage of the invariance of the Krylov subspace under a shift of the matrix. However, exploiting this fact in the non-Hermitian case introduces restrictions; e.g., initial…

Numerical Analysis · Mathematics 2016-02-05 Kirk M. Soodhalter

Krylov quantum diagonalization methods have emerged as a promising use case for quantum computers. However, many existing implementations rely on controlled operations, which pose challenges to near-term quantum hardware. We introduce a…

Quantum Physics · Physics 2025-10-15 Nicola Mariella , Enrique Rico , Adam Byrne , Sergiy Zhuk

This paper discusses model order reduction of large sparse second-order index-3 differential algebraic equations (DAEs) by applying Iterative Rational Krylov Algorithm (IRKA). In general, such DAEs arise in constraint mechanics, multibody…

Optimization and Control · Mathematics 2021-01-11 Xin Du , M. Monir Uddiny , A. Mostakim Fonyz , Md. Tanzim Hossainx , Md. Nazmul Islam Shuzan

Second-order optimization methods, such as cubic regularized Newton methods, are known for their rapid convergence rates; nevertheless, they become impractical in high-dimensional problems due to their substantial memory requirements and…

Optimization and Control · Mathematics 2024-01-09 Ruichen Jiang , Parameswaran Raman , Shoham Sabach , Aryan Mokhtari , Mingyi Hong , Volkan Cevher

We study a stability preserved Arnoldi algorithm for matrix exponential in the time domain simulation of large-scale power delivery networks (PDN), which are formulated as semi-explicit differential algebraic equations (DAEs). The solution…

Numerical Analysis · Mathematics 2021-10-12 Pengwen Chen , Chung-Kuan Cheng , Xinyuan Wang

Seismic imaging is a major challenge in geophysics with broad applications. It involves solving wave propagation equations with absorbing boundary conditions (ABC) multiple times. This drives the need for accurate and efficient numerical…

Numerical Analysis · Mathematics 2024-01-30 Fernando V. Ravelo , Martin Schreiber , Pedro S. Peixoto

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

This paper proposes a new second-order symmetric algorithm for solving decoupled forward-backward stochastic differential equations. Inspired by the alternating direction implicit splitting method for partial differential equations, we…

Numerical Analysis · Mathematics 2026-01-16 Wenbo Wang , Guangyan Jia

A standard approach to model reduction of large-scale higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for model reduction of first-order systems.…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

Continuing the previous initiatives arXiv: 2207.05347 and arXiv: 2212.06180, we pursue the exploration of operator growth and Krylov complexity in dissipative open quantum systems. In this paper, we resort to the bi-Lanczos algorithm…

Quantum Physics · Physics 2023-12-15 Aranya Bhattacharya , Pratik Nandy , Pingal Pratyush Nath , Himanshu Sahu