English
Related papers

Related papers: Deep Learning Accelerated Algebraic Multigrid Meth…

200 papers

We numerically analyze the possibility of turning off post-smoothing (relaxation) in geometric multigrid when used as a preconditioner in conjugate gradient linear and eigenvalue solvers for the 3D Laplacian. The geometric Semicoarsening…

Numerical Analysis · Computer Science 2015-06-09 Henricus Bouwmeester , Andrew Dougherty , Andrew V. Knyazev

We present an efficient, robust and fully GPU-accelerated aggregation-based algebraic multigrid preconditioning technique for the solution of large sparse linear systems. These linear systems arise from the discretization of elliptic PDEs.…

Numerical Analysis · Mathematics 2014-03-10 Rajesh Gandham , Ken Esler , Yongpeng Zhang

The finite element method, finite difference method, finite volume method and spectral method have achieved great success in solving partial differential equations. However, the high accuracy of traditional numerical methods is at the cost…

Numerical Analysis · Mathematics 2020-09-25 Jian Li , Jing Yue , Wen Zhang , Wansuo Duan

Numerical climate- and weather-prediction requires the fast solution of the equations of fluid dynamics. Discontinuous Galerkin (DG) discretisations have several advantageous properties. They can be used for arbitrary domains and support a…

Computational Physics · Physics 2020-10-13 Jack D. Betteridge , Thomas H. Gibson , Ivan G. Graham , Eike H. Müller

With the hardware support for half-precision arithmetic on NVIDIA V100 GPUs, high-performance computing applications can benefit from lower precision at appropriate spots to speed up the overall execution time. In this paper, we investigate…

Mathematical Software · Computer Science 2020-07-16 Kyaw L. Oo , Andreas Vogel

The geometric multigrid algorithm is an efficient numerical method for solving a variety of elliptic partial differential equations (PDEs). The method damps errors at progressively finer grid scales, resulting in faster convergence compared…

Numerical Analysis · Mathematics 2024-03-14 Francisco Holguin , GS Sidharth , Gavin Portwood

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extragradient), limiting SGD…

Machine Learning · Computer Science 2022-03-23 Amirkeivan Mohtashami , Martin Jaggi , Sebastian U. Stich

Adaptive gradient methods, especially Adam-type methods (such as Adam, AMSGrad, and AdaBound), have been proposed to speed up the training process with an element-wise scaling term on learning rates. However, they often generalize poorly…

Machine Learning · Computer Science 2021-07-20 Zhou Shao , Tong Lin

We present a robust and efficient multigrid method for single-patch isogeometric discretizations using tensor product B-splines of maximum smoothness. Our method is based on a stable splitting of the spline space into a large subspace of…

Numerical Analysis · Mathematics 2017-08-22 Clemens Hofreither , Stefan Takacs

We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information…

Numerical Analysis · Mathematics 2023-12-22 Nils Margenberg , Robert Jendersie , Christian Lessig , Thomas Richter

We present an efficient matrix-free geometric multigrid method for the elastic Helmholtz equation, and a suitable discretization. Many discretization methods had been considered in the literature for the Helmholtz equations, as well as many…

Numerical Analysis · Mathematics 2023-12-05 Rachel Yovel , Eran Treister

In this paper we present a Local Fourier Analysis of a space-time multigrid solver for a hyperbolic test problem. The space-time discretization is based on arbitrarily high order discontinuous Galerkin spectral element methods in time and a…

Numerical Analysis · Mathematics 2021-12-07 Lea M. Versbach , Philipp Birken , Viktor Linders , Gregor Gassner

Obtainable computational efficiency is evaluated when using an Adaptive Mesh Refinement (AMR) strategy in time accurate simulations governed by sets of conservation laws. For a variety of 1D, 2D, and 3D hydro- and magnetohydrodynamic…

Astrophysics · Physics 2009-11-10 R. Keppens , M. Nool , G. Toth , J. P. Goedbloed

Automatic modulation recognition (AMR) is a promising technology for intelligent communication receivers to detect signal modulation schemes. Recently, the emerging deep learning (DL) research has facilitated high-performance DL-AMR…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Fuxin Zhang , Chunbo Luo , Jialang Xu , Yang Luo

Adaptive gradient methods (AGMs) have become popular in optimizing the nonconvex problems in deep learning area. We revisit AGMs and identify that the adaptive learning rate (A-LR) used by AGMs varies significantly across the dimensions of…

Machine Learning · Computer Science 2019-09-12 Qianqian Tong , Guannan Liang , Jinbo Bi

Matrix-free geometric multigrid solvers for elliptic PDEs that have been discretised with Higher-order Discontinuous Galerkin (DG) methods are ideally suited to exploit state-of-the-art computer architectures. Higher polynomial degrees…

Numerical Analysis · Mathematics 2025-10-02 Sean Baccas , Alexander A. Belozerov , Eike H. Müller , Tobias Weinzierl

The accurate assembly of the system matrix is an important step in any code that solves partial differential equations on a mesh. We either explicitly set up a matrix, or we work in a matrix-free environment where we have to be able to…

Mathematical Software · Computer Science 2020-06-19 Charles D. Murray , Tobias Weinzierl

We present multiplexed gradient descent (MGD), a gradient descent framework designed to easily train analog or digital neural networks in hardware. MGD utilizes zero-order optimization techniques for online training of hardware neural…

Machine Learning · Computer Science 2023-08-17 Adam N. McCaughan , Bakhrom G. Oripov , Natesh Ganesh , Sae Woo Nam , Andrew Dienstfrey , Sonia M. Buckley

Current Adaptive Mesh Refinement (AMR) simulations require algorithms that are highly parallelized and manage memory efficiently. As compute engines grow larger, AMR simulations will require algorithms that achieve new levels of efficient…

Solar and Stellar Astrophysics · Physics 2015-03-19 Jonathan J. Carroll-Nellenback , Brandon Shroyer , Adam Frank , Chen Ding

We consider geometric multigrid methods for the solution of linear systems arising from isogeometric discretizations of elliptic partial differential equations. For classical finite elements, such methods are well known to be fast solvers…

Numerical Analysis · Mathematics 2017-05-16 Clemens Hofreither , Stefan Takacs , Walter Zulehner