English
Related papers

Related papers: Robust and effective eSIF preconditioning for gene…

200 papers

The convergence rates of iterative methods for solving a linear system $\mathbf{A} x = b$ typically depend on the condition number of the matrix $\mathbf{A}$. Preconditioning is a common way of speeding up these methods by reducing that…

Optimization and Control · Mathematics 2021-11-04 Arun Jambulapati , Jerry Li , Christopher Musco , Aaron Sidford , Kevin Tian

Layer-wise preconditioning methods are a family of memory-efficient optimization algorithms that introduce preconditioners per axis of each layer's weight tensors. These methods have seen a recent resurgence, demonstrating impressive…

Machine Learning · Computer Science 2025-02-05 Thomas T. Zhang , Behrad Moniri , Ansh Nagwekar , Faraz Rahman , Anton Xue , Hamed Hassani , Nikolai Matni

This paper proposes a computational framework for the design optimization of stable structures under large deformations by incorporating nonlinear buckling constraints. A novel strategy for suppressing spurious buckling modes related to…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Guodong Zhang , Kapil Khandelwal , Tong Guo

The task of choosing a preconditioner $\boldsymbol{M}$ to use when solving a linear system $\boldsymbol{Ax}=\boldsymbol{b}$ with iterative methods is difficult. For instance, even if one has access to a collection…

Numerical Analysis · Mathematics 2024-09-23 Conner DiPaolo , Weiqing Gu

The random feature method (RFM), a mesh-free machine learning-based framework, has emerged as a promising alternative for solving PDEs on complex domains. However, for large three-dimensional nonlinear problems, attaining high accuracy…

Numerical Analysis · Mathematics 2025-10-07 Longze Tan

High-index saddle dynamics (HiSD) is an effective approach for computing saddle points of a prescribed Morse index and constructing solution landscapes for complex nonlinear systems. However, for problems with ill-conditioned Hessians…

Numerical Analysis · Mathematics 2026-05-25 Bingzhang Huang , Hua Su , Lei Zhang , Jin Zhao

The convergence behaviour of first-order methods can be severely slowed down when applied to high-dimensional non-convex functions due to the presence of saddle points. If, additionally, the saddles are surrounded by large plateaus, it is…

Optimization and Control · Mathematics 2023-09-12 Nick Tsipinakis , Panos Parpas

We propose a two-level nested preconditioned iterative scheme for solving sparse linear systems of equations in which the coefficient matrix is symmetric and indefinite with relatively small number of negative eigenvalues. The proposed…

Numerical Analysis · Computer Science 2019-01-29 Murat Manguoglu , Volker Mehrmann

Immersed finite element methods generally suffer from conditioning problems when cut elements intersect the physical domain only on a small fraction of their volume. De Prenter et al. [Computer Methods in Applied Mechanics and Engineering,…

Numerical Analysis · Computer Science 2019-12-17 Frits de Prenter , Clemens Verhoosel , Harald van Brummelen

First-order fully implicit as well as implicit--explicit schemes for coupled elliptic-parabolic systems are discussed in [Ern and Meunier, ESAIM: M2AN, 2009] and [Altmann et al., Math.\ Comp., 2021], respectively. The extension of the…

Numerical Analysis · Mathematics 2026-01-06 Georgios Akrivis , Minghua Chen , Fan Yu

We consider the iterative solution of symmetric saddle point systems with a rank-deficient leading block. We develop two preconditioners that, under certain assumptions on the rank structure of the system, yield a preconditioned matrix with…

Numerical Analysis · Computer Science 2018-07-24 Susanne Bradley

Folding grid value vectors of size $2^L$ into $L$th order tensors of mode sizes $2\times \cdots\times 2$, combined with low-rank representation in the tensor train format, has been shown to lead to highly efficient approximations for…

Numerical Analysis · Mathematics 2019-11-19 Markus Bachmayr , Vladimir Kazeev

Monolithic preconditioners applied to the linear systems arising during the solution of the discretized incompressible Navier-Stokes equations are typically more robust than preconditioners based on incomplete block factorizations. Lower…

Numerical Analysis · Mathematics 2026-02-11 Alexander Heinlein , Axel Klawonn , Jascha Knepper , Lea Saßmannshausen

When solving linear systems with nonsymmetric Toeplitz or multilevel Toeplitz matrices using Krylov subspace methods, the coefficient matrix may be symmetrized. The preconditioned MINRES method can then be applied to this symmetrized…

Numerical Analysis · Mathematics 2019-04-15 Jennifer Pestana

Purpose: Design of a preconditioner for fast and efficient parallel imaging and compressed sensing reconstructions. Theory: Parallel imaging and compressed sensing reconstructions become time consuming when the problem size or the number of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Kirsten Koolstra , Jeroen van Gemert , Peter Börnert , Andrew Webb , Rob Remis

The discretization of certain integral equations, e.g., the first-kind Fredholm equation of Laplace's equation, leads to symmetric positive-definite linear systems, where the coefficient matrix is dense and often ill-conditioned. We…

Numerical Analysis · Mathematics 2022-08-22 Chao Chen , George Biros

Transient simulation of linear and nonlinear circuits remains an important task in modern EDA tools. At present, SPICE-like simulators face challenges in parallelization, nonlinear convergence and linear efficiency, especially when applied…

Computational Engineering, Finance, and Science · Computer Science 2025-11-21 Zijian Zhang , Yuanmiao Lin , Xuesong Chen , Shuting Cai

This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential…

Numerical Analysis · Mathematics 2024-12-04 Ivan Bioli , Daniel Kressner , Leonardo Robol

Recently, optimizers that explicitly treat weights as matrices, rather than flattened vectors, have demonstrated their effectiveness. This perspective naturally leads to structured approximations of the Fisher matrix as preconditioners,…

Machine Learning · Computer Science 2025-11-11 Nikolay Yudin , Ekaterina Grishina , Andrey Veprikov , Alexandr Beznosikov , Maxim Rakhuba

This paper investigates a type of fast and flexible preconditioners to solve multilinear system $\mathcal{A}\textbf{x}^{m-1}=\textbf{b}$ with $\mathcal{M}$-tensor $\mathcal{A}$ and obtains some important convergent theorems about…

Numerical Analysis · Mathematics 2021-10-08 Eisa Khosravi Dehdezi , Saeed Karimi