English
Related papers

Related papers: Preconditioning the Restarted and Shifted Block FO…

200 papers

This paper is a continuation of the work on unbounded Toeplitz-like operators $T_\Om$ with rational matrix symbol $\Om$ initiated in Groenewald et. al (Complex Anal. Oper. Theory 15, 1(2021)), where a Wiener-Hopf type factorization of $\Om$…

Functional Analysis · Mathematics 2023-09-27 G. J. Groenewald , S. ter Horst , J. Jaftha , A. C. M. Ran

The $p$-step backwards difference formula (BDF) for solving the system of ODEs can result in a kind of all-at-once linear systems, which are solved via the parallel-in-time preconditioned Krylov subspace solvers (see McDonald, Pestana, and…

Numerical Analysis · Mathematics 2021-09-14 Xian-Ming Gu , Yong-Liang Zhao , Xi-Le Zhao , Bruno Carpentieri , Yu-Yun Huang

We present an efficient and scalable algorithm for performing matrix-vector multiplications ("matvecs") for block Toeplitz matrices. Such matrices, which are shift-invariant with respect to their blocks, arise in the context of solving…

Numerical Analysis · Mathematics 2025-07-25 Sreeram Venkat , Milinda Fernando , Stefan Henneking , Omar Ghattas

The computation of approximating e^tA B, where A is a large sparse matrix and B is a rectangular matrix, serves as a crucial element in numerous scientific and engineering calculations. A powerful way to consider this problem is to use…

Numerical Analysis · Mathematics 2023-08-29 H. Barkouki , A. H. Bentbib , K. Jbilou

Reduced density matrix functional theory (RDMFT) calculations are usually implemented in a decoupled manner, where the orbital and occupation optimizations are repeated alternately. Typically, orbital updates are performed using the unitary…

Chemical Physics · Physics 2024-09-04 Yi-Fan Yao , Neil Qiang Su

We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends…

Numerical Analysis · Mathematics 2020-08-05 Bazyli Klockiewicz , Léopold Cambier , Ryan Humble , Hamdi Tchelepi , Eric Darve

We present a simple scheme for restarting first-order methods for convex optimization problems. Restarts are made based only on achieving specified decreases in objective values, the specified amounts being the same for all optimization…

Optimization and Control · Mathematics 2020-10-22 James Renegar , Benjamin Grimmer

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

Quantum linear system solvers like the Quantum Singular Value Transformation (QSVT) require a block encoding of the system matrix $A$ within a unitary operator $U_A$. Unfortunately, block encoding often results in significant…

Quantum Physics · Physics 2025-10-28 Leigh Lapworth , Christoph Sünderhauf

In this paper we consider linear systems with dense-matrices which arise from numerical solution of boundary integral equations. Such matrices can be well-approximated with $\mathcal{H}^2$-matrices. We propose several new preconditioners…

Numerical Analysis · Mathematics 2014-12-04 Daria Sushnikova , Ivan V. Oseledets

In this work we propose a simple but effective high order polynomial correction allowing to enhance the consistency of all kind of boundary conditions for the Euler equations (Dirichlet, characteristic far-field and slip-wall), both in 2D…

Numerical Analysis · Mathematics 2022-09-30 Mirco Ciallella , Elena Gaburro , Marco Lorini , Mario Ricchiuto

The discrete dipole approximation (DDA) is a popular numerical method for calculating the scattering properties of atmospheric ice crystals. The standard DDA formulation involves the uniform discretization of the underlying volume integral…

Computational Physics · Physics 2019-03-26 Samuel P. Groth , Athanasios G. Polimeridis , Jacob K. White

We present randomized algorithms for estimating the log-determinant of regularized symmetric positive semi-definite matrices. The algorithms access the matrix only through matrix vector products, and are based on the introduction of a…

Numerical Analysis · Mathematics 2026-02-20 Alice Cortinovis , Daniele Toni

In this overview article we will consider the deliberate restarting of algorithms, a meta technique, in order to improve the algorithm's performance, e.g., convergence rates or approximation guarantees. One of the major advantages is that…

Optimization and Control · Mathematics 2020-06-29 Sebastian Pokutta

There has been a growing interest in parallel strategies for solving trajectory optimization problems. One key step in many algorithmic approaches to trajectory optimization is the solution of moderately-large and sparse linear systems.…

Optimization and Control · Mathematics 2024-03-05 Xueyi Bu , Brian Plancher

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

The numerical modeling of fracture contact thermo-poromechanics is crucial for advancing subsurface engineering applications, including CO2 sequestration, production of geo-energy resources, energy storage and wastewater disposal…

Numerical Analysis · Mathematics 2025-10-14 Yury Zabegaev , Inga Berre , Eirik Keilegavlen

Large Language Models (LLMs) have demonstrated remarkable performance in real-world applications. However, adapting LLMs to novel tasks via fine-tuning often requires substantial training data and computational resources that are…

Machine Learning · Computer Science 2025-05-27 Boyan Gao , Xin Wang , Yibo Yang , David Clifton

We present a novel unified analysis for a broad class of adaptive optimization algorithms with structured (e.g., layerwise, diagonal, and kronecker-factored) preconditioners for both online regret minimization and offline convex…

Machine Learning · Computer Science 2025-07-16 Shuo Xie , Tianhao Wang , Sashank Reddi , Sanjiv Kumar , Zhiyuan Li

When a linear system Ax = y is solved by means of iterative methods (mainly CG and GMRES) and the convergence rate is slow, one may consider a preconditioner P. The use of such preconditioner changes the spectrum of the matrix defining the…

Numerical Analysis · Mathematics 2013-04-03 F. Tudisco , C. Di Fiore , E. E. Tyrtyshnikov