English
Related papers

Related papers: Algebraic multigrid preconditioning of the Hessian…

200 papers

In this work, we formulate and analyze a geometric multigrid method for the iterative solution of the discrete systems arising from the finite element discretization of symmetric second-order linear elliptic diffusion problems. We show that…

Numerical Analysis · Mathematics 2024-01-17 Michael Innerberger , Ani Miraçi , Dirk Praetorius , Julian Streitberger

First-order optimization solvers, such as the Fast Gradient Method, are increasingly being used to solve Model Predictive Control problems in resource-constrained environments. Unfortunately, the convergence rate of these solvers is…

Optimization and Control · Mathematics 2022-04-07 Ian McInerney , Eric C. Kerrigan , George A. Constantinides

We develop a theoretical foundation for the application of Nesterov's accelerated gradient descent method (AGD) to the approximation of solutions of a wide class of partial differential equations (PDEs). This is achieved by proving the…

Numerical Analysis · Mathematics 2021-02-03 Jea-Hyun Park , Abner J. Salgado , Steven M. Wise

Solving the indefinite Helmholtz equation is not only crucial for the understanding of many physical phenomena but also represents an outstandingly-difficult benchmark problem for the successful application of numerical methods. Here we…

Numerical Analysis · Mathematics 2022-04-29 Jonas Schmitt , Harald Köstler

The paper proposes a combination of the subdomain deflation method and local algebraic multigrid as a scalable distributed memory preconditioner that is able to solve large linear systems of equations. The implementation of the algorithm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-31 Denis Demidov , Riccardo Rossi

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

The paper aims to establish a fully discrete finite element (FE) scheme and provide cost-effective solutions for one-dimensional time-space Caputo-Riesz fractional diffusion equations on a bounded domain $\Omega$. Firstly, we construct a…

Numerical Analysis · Mathematics 2017-07-27 Xiaoqiang Yue , Weiping Bu , Shi Shu , Menghuan Liu , Shuai Wang

The geometric multigrid algorithm is an efficient numerical method for solving a variety of elliptic partial differential equations (PDEs). The method damps errors at progressively finer grid scales, resulting in faster convergence compared…

Numerical Analysis · Mathematics 2024-03-14 Francisco Holguin , GS Sidharth , Gavin Portwood

For the arbitrary-Lagrangian-Eulerian (ALE) calculations, the geometric information needs to be calculated at each time step due to the movement of mesh. To achieve the high-order spatial accuracy, a large number of matrix inversions are…

Computational Physics · Physics 2025-08-18 Yibo Wang , Xing Ji , Liang Pan

Interior point methods solve small to medium sized problems to high accuracy in a reasonable amount of time. However, for larger problems as well as stochastic problems, one needs to use first-order methods such as stochastic gradient…

Optimization and Control · Mathematics 2016-10-14 Reza Takapoui , Hamid Javadi

In this work we construct multigrid preconditioners to accelerate the solution process of a linear-quadratic optimal control problem constrained by the Stokes system. The first order optimality conditions of the control problem form a…

Numerical Analysis · Mathematics 2012-07-13 Andrei Draganescu , Ana Maria Soane

A merger of two optimization frameworks is introduced: SEquential Subspace OPtimization (SESOP) with MultiGrid (MG) optimization. At each iteration of the algorithm, the search direction implied by the coarse-grid correction process of MG…

Optimization and Control · Mathematics 2021-10-22 Tao Hong , Irad Yavneh , Michael Zibulevsky

In this paper, we present a multigrid $V$-cycle preconditioner for the linear system arising from piecewise linear nonconforming Crouzeix-Raviart discretization of second order elliptic problems with jump coefficients. The preconditioner…

Numerical Analysis · Mathematics 2011-10-25 Yunrong Zhu

We introduce a new framework of numerical multiscale methods for advection-dominated problems motivated by climate sciences. Current numerical multiscale methods (MsFEM) work well on stationary elliptic problems but have difficulties when…

Computational Engineering, Finance, and Science · Computer Science 2019-05-28 Konrad Simon , Jörn Behrens

We propose some multigrid methods for solving the algebraic systems resulting from finite element approximations of space fractional partial differential equations (SFPDEs). It is shown that our multigrid methods are optimal, which means…

Numerical Analysis · Mathematics 2018-07-27 Yingjun Jiang , Xuejun Xu

We consider an algebraic multigrid (AMG) scheme for the direct solution of complex- valued square linear systems based on a recursive 2 x 2 block partitioning of the coefficient matrix and study the optimal choices of its components. In…

Numerical Analysis · Mathematics 2026-03-18 Jose Pablo Lucero Lorca , Conor McCoid , Michal Outrata

Efficient and robust iterative solvers for strong anisotropic elliptic equations are very challenging. In this paper a block preconditioning method is introduced to solve the linear algebraic systems of a class of micro-macro…

Numerical Analysis · Mathematics 2021-11-17 Lingxiao Li , Chang Yang

In this paper, we propose and analyze an efficient preconditioning method for the elliptic problem based on the reconstructed discontinuous approximation method. We reconstruct a high-order piecewise polynomial space that arbitrary order…

Numerical Analysis · Mathematics 2024-07-16 Ruo Li , Qicheng Liu , Fanyi Yang

Numerical climate- and weather-prediction requires the fast solution of the equations of fluid dynamics. Discontinuous Galerkin (DG) discretisations have several advantageous properties. They can be used for arbitrary domains and support a…

Computational Physics · Physics 2020-10-13 Jack D. Betteridge , Thomas H. Gibson , Ivan G. Graham , Eike H. Müller

This report investigates the fitting of the Hessian or its inverse for stochastic optimizations using a Hessian fitting criterion derived from the preconditioned stochastic gradient descent (PSGD) method. This criterion is closely related…

Machine Learning · Statistics 2025-12-02 Xi-Lin Li