English
Related papers

Related papers: Resilience for Exascale Enabled Multigrid Methods

200 papers

We consider discontinuous Galerkin methods for an elliptic distributed optimal control problem and we propose multigrid methods to solve the discretized system. We prove that the $W$-cycle algorithm is uniformly convergent in the energy…

Numerical Analysis · Mathematics 2023-05-11 Sijing Liu

Many subsurface engineering applications involve tight-coupling between fluid flow, solid deformation, fracturing, and similar processes. To better understand the complex interplay of different governing equations, and therefore design…

In large-scale LLM pre-training systems with 100k+ GPUs, failures become the norm rather than the exception, and restart costs can dominate wall-clock training time. However, existing fault-tolerance mechanisms are largely unprepared for…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-29 Jin Lee , Zhonghao Chen , Xuhang He , Robert Underwood , Bogdan Nicolae , Franck Cappello , Xiaoyi Lu , Sheng Di , Zheng Zhang

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

In his article "Powerlist: A Structure for Parallel Recursion" Jayadev Misra wrote: "Many data parallel algorithms - Fast Fourier Transform, Batcher's sorting schemes and prefix sum - exhibit recursive structure. We propose a data…

Computational Geometry · Computer Science 2011-09-06 Roman Gitlin

As computers reach exascale and beyond, the incidence of faults will increase. Solutions to this problem are an active research topic. We focus on strategies to make the preconditioned conjugate gradient (PCG) solver resilient against node…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Carlos Pachajoa , Christina Pacher , Markus Levonyak , Wilfried N. Gansterer

We develop numerical methods for elliptic systems governed by partial segregation constraints, in which three nonnegative components are required to have a vanishing pointwise product throughout the domain. This constraint enforces that at…

Numerical Analysis · Mathematics 2026-03-09 Farid Bozorgnia , Avetik Arakelyan , Vyacheslav Kungurtsev , Jan Valdman

Synchronizations of processing elements (PEs) in massively parallel simulations, which arise due to communication or load imbalances between PEs, significantly affect the scalability of scientific applications. We have recently proposed a…

Computational Physics · Physics 2018-08-16 Konduri Aditya , Diego A. Donzis

Parallel-in-time algorithms have been successfully employed for reducing time-to-solution of a variety of partial differential equations, especially for diffusive (parabolic-type) equations. A major failing of parallel-in-time approaches to…

Numerical Analysis · Mathematics 2019-08-28 Hans De Sterck , Stephanie Friedhoff , Alexander J. M. Howse , Scott P. MacLachlan

This research paper investigates how machine learning-driven data replication strategies can enhance fault tolerance in large-scale distributed systems. Traditional replication methods, which rely on static configurations, often struggle to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Almond Kiruthu Murimi

We propose a parallel adaptive constraint-tightening approach to solve a linear model predictive control problem for discrete-time systems, based on inexact numerical optimization algorithms and operator splitting methods. The underlying…

Optimization and Control · Mathematics 2015-03-24 Laura Ferranti , Tamas Keviczky

In this work, we propose an adaptive geometric multigrid method for the solution of large-scale finite cell flow problems. The finite cell method seeks to circumvent the need for a boundary-conforming mesh through the embedding of the…

Numerical Analysis · Mathematics 2026-01-21 M. Saberi , A. Vogel

The finite-difference time-domain (FDTD) algorithm is a popular numerical method for solving electromagnetic problems. FDTD simulations can suffer from instability due to the explicit nature of the method. Stability enforcement can be…

Computational Engineering, Finance, and Science · Computer Science 2018-12-26 Fadime Bekmambetova , Xinyue Zhang , Piero Triverio

This work is concerned with phrasing the concepts of fault-tolerant quantum computation within the framework of disordered systems, Bernoulli site percolation in particular. We show how the so-called "threshold theorems" on the possibility…

Quantum Physics · Physics 2007-05-23 Maxim Raginsky

In recent publications, the author and his coworkers have shown robust approximation error estimates for B-splines of maximum smoothness and have proposed multigrid methods based on them. These methods allow to solve the linear system…

Numerical Analysis · Mathematics 2021-03-05 Stefan Takacs

Hybrid fault models are known to be an effective means for enhancing the robustness of consensus-based replicated systems. However, existing hybridization approaches suffer from limited flexibility with regard to the composition of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Laura Lawniczak , Tobias Distler

Constructing fast numerical solvers for partial differential equations (PDEs) is crucial for many scientific disciplines. A leading technique for solving large-scale PDEs is using multigrid methods. At the core of a multigrid solver is the…

Numerical Analysis · Mathematics 2019-08-07 Daniel Greenfeld , Meirav Galun , Ron Kimmel , Irad Yavneh , Ronen Basri

We present a first of its kind framework which overcomes a major challenge in the design of digital systems that are resilient to reliability failures: achieve desired resilience targets at minimal costs (energy, power, execution time,…

Iterative multiscale methods for electronic structure calculations offer several advantages for large-scale problems. Here we examine a nonlinear full approximation scheme (FAS) multigrid method for solving fixed potential and…

Materials Science · Physics 2007-05-23 Nimal Wijesekera , Guogang Feng , Thomas L. Beck

The increasing scale of data propels the popularity of leveraging parallelism to speed up the optimization. Minibatch stochastic gradient descent (minibatch SGD) and local SGD are two popular methods for parallel optimization. The existing…

Machine Learning · Computer Science 2025-10-14 Yunwen Lei , Tao Sun , Mingrui Liu