English
Related papers

Related papers: A unified analysis framework for iterative paralle…

200 papers

Time-parallel algorithms, such as Parareal, are well-understood for linear problems, but their convergence analysis for nonlinear, chaotic systems remains limited. This paper introduces a new theoretical framework for analysing…

Numerical Analysis · Mathematics 2026-04-02 Giancarlo Antonino Antonucci , Raphael Andreas Hauser , Debasmita Samaddar , James Buchanan

As deep neural networks (DNNs) become deeper, the training time increases. In this perspective, multi-GPU parallel computing has become a key tool in accelerating the training of DNNs. In this paper, we introduce a novel methodology to…

Numerical Analysis · Mathematics 2024-07-08 Chang-Ock Lee , Youngkyu Lee , Jongho Park

This paper proposes a parallel in time (called also time parareal) method to solve Volterra integral equations of the second kind. The parallel in time approach follows the same spirit as the domain decomposition that consists of breaking…

Numerical Analysis · Mathematics 2016-11-26 Xianjuan Li , Tao Tang , Chuanju Xu

Time-parallel time integration has received a lot of attention in the high performance computing community over the past two decades. Indeed, it has been shown that parallel-in-time techniques have the potential to remedy one of the main…

Numerical Analysis · Mathematics 2023-09-26 Martin J. Gander , Davide Palitta

We introduce Prob-GParareal, a probabilistic extension of the GParareal algorithm designed to provide uncertainty quantification for the Parallel-in-Time (PinT) solution of (ordinary and partial) differential equations (ODEs, PDEs). The…

Computation · Statistics 2025-09-05 Guglielmo Gattiglio , Lyudmila Grigoryeva , Massimiliano Tamborrino

Parareal is a well-studied algorithm for numerically integrating systems of time-dependent differential equations by parallelising the temporal domain. Given approximate initial values at each temporal sub-interval, the algorithm locates a…

Numerical Analysis · Mathematics 2022-07-11 Kamran Pentland , Massimiliano Tamborrino , D. Samaddar , L. C. Appel

The parallel full approximation scheme in space and time (PFASST) introduced by Emmett and Minion in 2012 is an iterative strategy for the temporal parallelization of ODEs and discretized PDEs. As the name suggests, PFASST is similar in…

Numerical Analysis · Mathematics 2015-11-17 Michael Minion , Robert Speck , Matthias Bolten , Matthew Emmett , Daniel Ruprecht

We propose a parallelizable sparse inverse formulation Gaussian process (SpInGP) for temporal models. It uses a sparse precision GP formulation and sparse matrix routines to speed up the computations. Due to the state-space formulation used…

Machine Learning · Statistics 2017-09-29 Alexander Grigorievskiy , Neil Lawrence , Simo Särkkä

This paper presents a novel parallel-in-time algorithm able to compute time-periodic solutions of problems where the period is not given. Exploiting the idea of the multiple shooting method, the proposed approach calculates the initial…

Numerical Analysis · Mathematics 2020-07-08 Iryna Kulchytska-Ruchka , Sebastian Schöps

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

This paper presents a new algorithm for the parallel in time (PiT) numerical simulation of time dependent partial/ordinary differential equations. We propose a reliable alternative to the well know parareal in time algorithm, by formulating…

Numerical Analysis · Mathematics 2022-03-22 Mohamed Kamel Riahi

Although convergence of the Parareal and multigrid-reduction-in-time (MGRIT) parallel-in-time algorithms is well studied, results on their optimality is limited. Appealling to recently derived tight bounds of two-level Parareal and MGRIT…

Numerical Analysis · Mathematics 2020-02-12 Stephanie Friedhoff , Ben S. Southworth

Harnessing parallelism in seemingly sequential models is a central challenge for modern machine learning. Several approaches have been proposed for evaluating sequential processes in parallel using iterative fixed-point methods, like…

We give algorithms for geometric graph problems in the modern parallel models inspired by MapReduce. For example, for the Minimum Spanning Tree (MST) problem over a set of points in the two-dimensional space, our algorithm computes a…

Data Structures and Algorithms · Computer Science 2014-01-07 Alexandr Andoni , Aleksandar Nikolov , Krzysztof Onak , Grigory Yaroslavtsev

The paper investigates a non-intrusive parallel time integration with multigrid for space-fractional diffusion equations in two spatial dimensions. We firstly obtain a fully discrete scheme via using the linear finite element method to…

Numerical Analysis · Mathematics 2018-05-18 Xiaoqiang Yue , Shi Shu , Xiaowen Xu , Weiping Bu , Kejia Pan

To solve optimization problems with parabolic PDE constraints, often methods working on the reduced objective functional are used. They are computationally expensive due to the necessity of solving both the state equation and a…

Optimization and Control · Mathematics 2019-12-17 Sebastian Götschel , Michael L. Minion

Parallel-in-time methods for partial differential equations (PDEs) have been the subject of intense development over recent decades, particularly for diffusion-dominated problems. It has been widely reported in the literature, however, that…

Numerical Analysis · Mathematics 2023-03-22 H. De Sterck , R. D. Falgout , O. A. Krzysik , J. B. Schroder

With steadily increasing parallelism for high-performance architectures, simulations requiring a good strong scalability are prone to be limited in scalability with standard spatial-decomposition strategies at a certain amount of parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-01 Martin Schreiber , Adam Peddle , Terry Haut , Beth Wingate

Solving inverse problems and achieving statistical rigour in landscape evolution models requires running many model realizations. Parallel computation is necessary to achieve this in a reasonable time. However, no previous algorithm is…

Computational Engineering, Finance, and Science · Computer Science 2019-01-23 Richard Barnes

We introduce a new strategy for coupling the parallel in time (parareal) iterative methodology with multiscale integrators. Following the parareal framework, the algorithm computes a low-cost approximation of all slow variables in the…

Numerical Analysis · Mathematics 2015-11-19 Gil Ariel , Seong Jun Kim , Richard Tsai