English
Related papers

Related papers: Mixed Precision Block-Jacobi Preconditioner: Algor…

200 papers

The Preconditioned Conjugate Gradient method is often employed for the solution of linear systems of equations arising in numerical simulations of physical phenomena. While being widely used, the solver is also known for its lack of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-18 Roman Iakymchuk , Maria Barreda , Stef Graillat , Jose I. Aliaga , Enrique S. Quintana-Orti

Mixed-precision algorithms combine low- and high-precision computations in order to benefit from the performance gains of reduced-precision without sacrificing accuracy. In this work, we design mixed-precision Runge-Kutta-Chebyshev (RKC)…

Numerical Analysis · Mathematics 2023-01-10 Matteo Croci , Giacomo Rosilho de Souza

This Paper conducts a thorough simulation study to assess the effectiveness of various acceleration techniques designed to enhance the conjugate gradient algorithm, which is used for solving large linear systems to accelerate Bayesian…

Computation · Statistics 2025-05-06 Zhihao Zhou

We describe a number of recently developed techniques for improving the performance of large-scale nuclear configuration interaction calculations on high performance parallel computers. We show the benefit of using a preconditioned block…

Numerical Analysis · Computer Science 2017-12-29 Meiyue Shao , Hasan Metin Aktulga , Chao Yang , Esmond G. Ng , Pieter Maris , James P. Vary

Efficient numerical solvers for partial differential equations empower science and engineering. One of the commonly employed numerical solvers is the preconditioned conjugate gradient (PCG) algorithm which can solve large systems to a given…

Numerical Analysis · Mathematics 2023-09-07 Yichen Li , Peter Yichen Chen , Tao Du , Wojciech Matusik

Traditional optimization methods rely on the use of single-precision floating point arithmetic, which can be costly in terms of memory size and computing power. However, mixed precision optimization techniques leverage the use of both…

Machine Learning · Computer Science 2023-09-25 Basile Lewandowski , Atli Kosson

This work proposes an original preconditioner that couples the Constrained Pressure Residual (CPR) method with block preconditioning for the efficient solution of the linearized systems of equations arising from fully implicit multiphase…

Numerical Analysis · Mathematics 2023-03-24 Stefano Nardean , Massimiliano Ferronato , Ahmad Abushaikha

We derive parameter-robust quasi-optimal error estimates for mixed finite element methods for the nonlinear Darcy--Forchheimer equations with mixed boundary conditions. Using the framework of operator preconditioning, we also design…

Numerical Analysis · Mathematics 2026-02-25 Rishi Das , Harsha Hutridurga , Amiya K. Pani , Ricardo Ruiz-Baier

The linear conjugate gradient method is widely used in physical simulation, particularly for solving large-scale linear systems derived from Newton's method. The nonlinear conjugate gradient method generalizes the conjugate gradient method…

Optimization and Control · Mathematics 2024-05-15 Xing Shen , Runyuan Cai , Mengxiao Bi , Tangjie Lv

Mixed-precision algorithms have been proposed as a way for scientific computing to benefit from some of the gains seen for artificial intelligence (AI) on recent high performance computing (HPC) platforms. A few applications dominated by…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Aditya Kashi , Nicholson Koukpaizan , Hao Lu , Michael Matheson , Sarp Oral , Feiyi Wang

Block Coordinate Update (BCU) methods enjoy low per-update computational complexity because every time only one or a few block variables would need to be updated among possibly a large number of blocks. They are also easily parallelized and…

Optimization and Control · Mathematics 2017-11-22 Yangyang Xu , Shuzhong Zhang

Mixed-precision computing has the potential to significantly reduce the cost of exascale computations, but determining when and how to implement it in programs can be challenging. In this article, we propose a methodology for enabling…

Mathematical Software · Computer Science 2025-07-02 Yanxiang Chen , Pablo de Oliveira Castro , Paolo Bientinesi , Niclas Jansson , Roman Iakymchuk

For real matrices of full column-rank, we analyze the conditioning of several types of normal equations that are preconditioned by a randomized preconditioner computed in lower precision. These include symmetrically preconditioned normal…

Numerical Analysis · Mathematics 2026-03-18 James E. Garrison , Ilse C. F. Ipsen

Purpose: Design of a preconditioner for fast and efficient parallel imaging and compressed sensing reconstructions. Theory: Parallel imaging and compressed sensing reconstructions become time consuming when the problem size or the number of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Kirsten Koolstra , Jeroen van Gemert , Peter Börnert , Andrew Webb , Rob Remis

We study a method based on Balancing Domain Decomposition by Constraints (BDDC) for a numerical solution of a single-phase flow in heterogenous porous media. The method solves for both flux and pressure variables. The fluxes are resolved in…

Numerical Analysis · Mathematics 2024-12-20 Bedřich Sousedík

A fundamental problem in robotic perception is matching identical objects or data, with applications such as loop closure detection, place recognition, object tracking, and map fusion. While the problem becomes considerably more challenging…

Robotics · Computer Science 2021-12-01 Parker C. Lusk , Ronak Roy , Kaveh Fathian , Jonathan P. How

This paper presents a scalable physics-based block preconditioner for mixed-dimensional models in beam-solid interaction and their application in engineering. In particular, it studies the linear systems arising from a regularized…

Computational Engineering, Finance, and Science · Computer Science 2024-08-09 Max Firmbach , Ivo Steinbrecher , Alexander Popp , Matthias Mayr

Many problems in machine learning write as the minimization of a sum of individual loss functions over the training examples. These functions are usually differentiable but, in some cases, their gradients are not Lipschitz continuous, which…

Optimization and Control · Mathematics 2024-04-29 S. Chraibi , F. Iutzeler , J. Malick , A. Rogozin

We explore a scaled spectral preconditioner for the efficient solution of sequences of symmetric and positive-definite linear systems. We design the scaled preconditioner not only as an approximation of the inverse of the linear system but…

Numerical Analysis · Mathematics 2024-10-04 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

Although reliable long precision floating-point arithmetic libraries such as QD and MPFR/GMP are necessary to solve ill-conditioned problems in numerical simulation, long precision BLAS-level computation such as matrix multiplication has…

Mathematical Software · Computer Science 2017-10-06 Tomonori Kouya