English
Related papers

Related papers: A Note on Preconditioning by Low-Stretch Spanning …

200 papers

In this paper, a novel augmented Lagrangian preconditioner based on global Arnoldi for accelerating the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure, these systems…

Numerical Analysis · Mathematics 2024-09-10 A. Badahmane , A. Ratnani , H. Sadok

We present an efficient preconditioner for linear problems $A x=y$. It guarantees monotonic convergence of the memory-efficient fixed-point iteration for all accretive systems of the form $A = L + V$, where $L$ is an approximation of $A$,…

Numerical Analysis · Mathematics 2023-10-02 Tom Vettenburg , Ivo M. Vellekoop

In an unnormalized Krylov subspace framework for solving symmetric systems of linear equations, the orthogonal vectors that are generated by a Lanczos process are not necessarily on the form of gradients. Associating each orthogonal vector…

Optimization and Control · Mathematics 2014-09-18 Anders Forsgren , Tove Odland

Scaling hyperparameter optimisation to very large datasets remains an open problem in the Gaussian process community. This paper focuses on iterative methods, which use linear system solvers, like conjugate gradients, alternating…

Machine Learning · Computer Science 2025-01-14 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , Javier Antorán , José Miguel Hernández-Lobato

We give a necessary and sufficient condition, of geometric type, for the uniform decay of energy of solutions of the linear system of magnetoelasticity in a bounded domain with smooth boundary. A Dirichlet-type boundary condition is…

Analysis of PDEs · Mathematics 2007-05-23 Thomas Duyckaerts

We propose two novel conditional gradient-based methods for solving structured stochastic convex optimization problems with a large number of linear constraints. Instances of this template naturally arise from SDP-relaxations of…

Machine Learning · Computer Science 2020-07-09 Maria-Luiza Vladarean , Ahmet Alacaoglu , Ya-Ping Hsieh , Volkan Cevher

A finite-element discretization of such an equation yields a linear system whose conditioning worsens as the variations in the values of PDE coefficients becomes large. This paper introduces a procedure by which the discrete system obtained…

Numerical Analysis · Mathematics 2018-01-08 Yuliya Gorb , Daria Kurzanova , Yuri Kuznetsov

A method of numerically solving the Maxwell equations is considered for modeling harmonic electromagnetic fields. The vector finite element method makes it possible to obtain a physically consistent discretization of the differential…

Numerical Analysis · Mathematics 2026-01-05 Andrew V. Terekhov

We consider the solution of saddle-point systems with a tree-based block structure, introducing a parallelizable direct method for their solution. As our key contribution, we then propose several structure-exploiting preconditioners to be…

Numerical Analysis · Mathematics 2024-11-01 Christoph Hansknecht , Bernhard Heinzelreiter , John W. Pearson , Andreas Potschka

Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting remains relatively…

Optimization and Control · Mathematics 2025-04-22 Guy Kornowski , Swati Padmanabhan , Kai Wang , Zhe Zhang , Suvrit Sra

PDE-constrained optimization aims at finding optimal setups for partial differential equations so that relevant quantities are minimized. Including sparsity promoting terms in the formulation of such problems results in more practically…

Numerical Analysis · Mathematics 2016-11-23 Margherita Porcelli , Valeria Simoncini , Martin Stoll

This work develops neural-network--based preconditioners to accelerate solution of the Wilson-Dirac normal equation in lattice quantum field theories. The approach is implemented for the two-flavor lattice Schwinger model near the critical…

High Energy Physics - Lattice · Physics 2023-03-08 Salvatore Calì , Daniel C. Hackett , Yin Lin , Phiala E. Shanahan , Brian Xiao

In this article we present a new multigrid preconditioner for the linear systems arising in the semismooth Newton method solution of certain control-constrained, quadratic distributed optimal control problems. Using a piecewise constant…

Numerical Analysis · Mathematics 2016-02-16 Andrei Draganescu , Jyoti Saraswat

We present a randomized algorithm that, on input a symmetric, weakly diagonally dominant n-by-n matrix A with m nonzero entries and an n-vector b, produces a y such that $\norm{y - \pinv{A} b}_{A} \leq \epsilon \norm{\pinv{A} b}_{A}$ in…

Numerical Analysis · Mathematics 2025-10-20 Daniel A. Spielman , Shang-Hua Teng

Let $X_1, \dots, X_n$ be joint $\{ \pm 1\}$-valued random variables. It is known that conditioning on a random subset of $O(1/\epsilon^2)$ of them reduces their average pairwise covariance to below $\epsilon$ (in expectation). We conjecture…

Information Theory · Computer Science 2014-07-17 Sarah R. Allen , Ryan O'Donnell

In this paper we provide nearly linear time algorithms for several problems closely associated with the classic Perron-Frobenius theorem, including computing Perron vectors, i.e. entrywise non-negative eigenvectors of non-negative matrices,…

Data Structures and Algorithms · Computer Science 2018-10-05 AmirMahdi Ahmadinejad , Arun Jambulapati , Amin Saberi , Aaron Sidford

The solution of systems of linear(ized) equations lies at the heart of many problems in Scientific Computing. In particular for systems of large dimension, iterative methods are a primary approach. Stationary iterative methods are generally…

Numerical Analysis · Mathematics 2025-04-08 Andy Wathen

This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential…

Numerical Analysis · Mathematics 2024-12-04 Ivan Bioli , Daniel Kressner , Leonardo Robol

In this paper we develop a family of preconditioners for the linear algebraic systems arising from the arbitrary Lagrangian-Eulerian discretization of some fluid-structure interaction models. After the time discretization, we formulate the…

Numerical Analysis · Mathematics 2023-07-19 Jinchao Xu , Kai Yang

For the solution of discrete ill-posed problems, in this paper a novel preconditioned iterative method based on the Arnoldi algorithm for matrix functions is presented. The method is also extended to work in connection with Tikhonov…

Numerical Analysis · Mathematics 2011-11-18 Paolo Novati , Michela Redivo-Zaglia , Maria Rosaria Russo