English
Related papers

Related papers: Polynomial Preconditioned GMRES to Reduce Communic…

200 papers

We study the solution of block-structured linear algebra systems arising in optimization by using iterative solution techniques. These systems are the core computational bottleneck of many problems of interest such as parameter estimation,…

Optimization and Control · Mathematics 2019-09-10 Jose S. Rodriguez , Carl D. Laird , Victor M. Zavala

Elliptic partial differential equations (PDEs) frequently arise in continuum descriptions of physical processes relevant to science and engineering. Multilevel preconditioners represent a family of scalable techniques for solving discrete…

Mathematical Software · Computer Science 2016-04-26 Dave A. May , Patrick Sanan , Karl Rupp , Matthew G. Knepley , Barry F. Smith

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

In this article, we focus on the parallel communication cost of multiplying the same vector along two modes of a $3$-dimensional symmetric tensor. This is a key computation in the higher-order power method for determining eigenpairs of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Hussam Al Daas , Grey Ballard , Laura Grigori , Suraj Kumar , Kathryn Rouse , Mathieu Vérité

Modern accelerators like GPUs are increasingly executing independent operations concurrently to improve the device's compute utilization. However, effectively harnessing it on GPUs for important primitives such as general matrix…

Hardware Architecture · Computer Science 2024-09-05 Suchita Pati , Shaizeen Aga , Nuwan Jayasena , Matthew D. Sinclair

We present a new parallel algorithm for solving triangular systems with multiple right hand sides (TRSM). TRSM is used extensively in numerical linear algebra computations, both to solve triangular linear systems of equations as well as to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-23 Tobias Wicky , Edgar Solomonik , Torsten Hoefler

We present a new approach to constructing of pseudo-random binary sequences (PRS) generators for the purpose of cryptographic data protection, secured from the perpetrator's attacks, caused by generation of masses of hardware errors and…

Cryptography and Security · Computer Science 2018-09-10 Oleg Finko , Sergey Dichenko

Partitioned methods allow one to build a simulation capability for coupled problems by reusing existing single-component codes. In so doing, partitioned methods can shorten code development and validation times for multiphysics and…

Numerical Analysis · Mathematics 2022-06-13 Amy de Castro , Paul Kuberry , Irina Tezaur , Pavel Bochev

We consider the use of multipreconditioning to solve linear systems when more than one preconditioner is available but the optimal choice is not known. In particular, we consider a selective multipreconditioned GMRES algorithm where we…

Numerical Analysis · Mathematics 2021-07-08 Niall Bootland , Andrew Wathen

Three approaches to implement genetic programming on GPU hardware are compilation, interpretation and direct generation of machine code. The compiled approach is known to have a prohibitive overhead compared to other two. This paper…

Neural and Evolutionary Computing · Computer Science 2017-05-23 Hakan Ayral , Songül Albayrak

We present a novel augmented Lagrangian (AL) preconditioner for the solution of linear systems arising from finite element discretizations of elliptic interface problems with jump coefficients. The method is based on the Fictitious Domain…

Numerical Analysis · Mathematics 2026-03-16 Michele Benzi , Marco Feder , Luca Heltai , Federica Mugnaioni

A linearly implicit conservative difference scheme is applied to discretize the attractive coupled nonlinear Schr\"odinger equations with fractional Laplacian. Complex symmetric linear systems can be obtained, and the system matrices are…

Numerical Analysis · Mathematics 2023-10-19 Yan Cheng , Xi Yang

We discuss the advantages of parallelization by multithreading on graphics processing units (GPUs) for parallel tempering Monte Carlo computer simulations of an exemplified bead-spring model for homopolymers. Since the sampling of a large…

Computational Physics · Physics 2015-05-28 Jonathan Groß , Wolfhard Janke , Michael Bachmann

Unmatched pairs of forward and back projectors are common in X-ray CT computations for large-scale problems; they are caused by the need for fast algorithms that best utilize the computer hardware, and it is an interesting and challenging…

Numerical Analysis · Mathematics 2022-05-30 Per Christian Hansen , Ken Hayami , Keiichi Morikuni

We propose a new algorithm for multiplying dense polynomials with integer coefficients in a parallel fashion, targeting multi-core processor architectures. Complexity estimates and experimental comparisons demonstrate the advantages of this…

Symbolic Computation · Computer Science 2016-12-20 Changbo Chen , Svyatoslav Covanov , Farnam Mansouri , Marc Moreno Maza , Ning Xie , Yuzhen Xie

Reduction operations are extensively employed in many computational problems. A reduction consists of, given a finite set of numeric elements, combining into a single value all elements in that set, using for this a combiner function. A…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-23 Walid Jradi , Hugo do Nascimento , Wellington Martins

With the emergence of mixed precision capabilities in hardware, iterative refinement schemes for solving linear systems $Ax=b$ have recently been revisited and reanalyzed in the context of three or more precisions. These new analyses show…

Numerical Analysis · Mathematics 2022-02-17 Eda Oktay , Erin Carson

Overlapping communication with computation is crucial for distributed large-model training, yet optimizing it - especially when computation becomes the bottleneck-remains challenging. We present Lagom, a system that co-tunes communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-25 Guanbin Xu , ZhenGuo Xu , Yuzhe Li , Youhui Bai , Ping Gong , Chaoyi Ruan , Cheng Li

In this paper, two efficient iterative algorithms based on the simpler GMRES method are proposed for solving shifted linear systems. To make full use of the shifted structure, the proposed algorithms utilizing the deflated restarting…

Numerical Analysis · Mathematics 2021-07-26 Hong-Xiu Zhong , Xian-Ming Gu

Geographical information systems are ideal candidates for the application of parallel programming techniques, mainly because they usually handle large data sets. To help us deal with complex calculations over such data sets, we investigated…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-18 Lucas Benedičič , Felipe A. Cruz , Tsuyoshi Hamada , Peter Korošec