English
Related papers

Related papers: A Combined Parallel-in-time Direct Inverse (ParaDI…

200 papers

We propose a new deep learning algorithm for solving high-dimensional parabolic integro-differential equations (PIDEs) and forward-backward stochastic differential equations with jumps (FBSDEJs). This novel algorithm can be viewed as an…

Numerical Analysis · Mathematics 2025-10-28 Wansheng Wang , Jiangtao Pan , Jie Wang , Zaijun Ye

Diffusion models have achieved remarkable progress in high-fidelity image, video, and audio generation, yet inference remains computationally expensive. Nevertheless, current diffusion acceleration methods based on distributed parallelism…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Euisoo Jung , Byunghyun Kim , Hyunjin Kim , Seonghye Cho , Jae-Gil Lee

We describe a parallel solver for the discretized weakly singular space-time boundary integral equation of the spatially two-dimensional heat equation. The global space-time nature of the system matrices leads to improved parallel…

Numerical Analysis · Mathematics 2021-02-23 Stefan Dohr , Michal Merta , Günther Of , Olaf Steinbach , Jan Zapletal

As a typical application of deep learning, physics-informed neural network (PINN) {has been} successfully used to find numerical solutions of partial differential equations (PDEs), but how to improve the limited accuracy is still a great…

Machine Learning · Computer Science 2022-08-09 Zhi-Yong Zhang , Hui Zhang , Li-Sheng Zhang , Lei-Lei Guo

Primal-Dual Hybrid Gradient (PDHG) and Alternating Direction Method of Multipliers (ADMM) are two widely-used first-order optimization methods. They reduce a difficult problem to simple subproblems, so they are easy to implement and have…

Optimization and Control · Mathematics 2019-09-10 Yanli Liu , Yunbei Xu , Wotao Yin

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

Optimization and Control · Mathematics 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

A variant of the Parareal method for highly oscillatory systems of PDEs was proposed by Haut and Wingate (2014). In that work they proved superlinear conver- gence of the method in the limit of infinite time scale separation. Their coarse…

Numerical Analysis · Mathematics 2017-05-29 Adam Peddle , Terry Haut , Beth Wingate

A novel Douglas alternating direction implicit (ADI) method is proposed in this work to solve a two-dimensional (2D) heat equation with interfaces. The ADI scheme is a powerful finite difference method for solving parabolic equations, due…

Numerical Analysis · Mathematics 2014-07-01 Shan Zhao

The modeling of atmospheric processes in the context of weather and climate simulations is an important and computationally expensive challenge. The temporal integration of the underlying PDEs requires a very large number of time steps,…

Numerical Analysis · Mathematics 2020-01-03 Francois P. Hamon , Martin Schreiber , Michael L. Minion

Although convergence of the Parareal and multigrid-reduction-in-time (MGRIT) parallel-in-time algorithms is well studied, results on their optimality is limited. Appealling to recently derived tight bounds of two-level Parareal and MGRIT…

Numerical Analysis · Mathematics 2020-02-12 Stephanie Friedhoff , Ben S. Southworth

Parallel-in-time integration has been the focus of intensive research efforts over the past two decades due to the advent of massively parallel computer architectures and the scaling limits of purely spatial parallelization. Various…

Numerical Analysis · Mathematics 2023-09-22 M. J. Gander , T. Lunet , D. Ruprecht , R. Speck

Numerically solving parabolic equations with quasiperiodic coefficients is a significant challenge due to the potential formation of space-filling quasiperiodic structures that lack translational symmetry or decay. In this paper, we…

Numerical Analysis · Mathematics 2024-12-30 Kai Jiang , Meng Li , Juan Zhang , Lei Zhang

Diffusion models are powerful generative models but suffer from slow sampling, often taking 1000 sequential denoising steps for one sample. As a result, considerable efforts have been directed toward reducing the number of denoising steps,…

Machine Learning · Computer Science 2023-10-17 Andy Shih , Suneel Belkhale , Stefano Ermon , Dorsa Sadigh , Nima Anari

We consider a new class of Parareal algorithms, which use ideas from localized reduced basis methods to construct the coarse solver from spectral approximations of the transfer operators mapping initial values for a given time interval to…

Numerical Analysis · Mathematics 2025-08-13 Martin J. Gander , Mario Ohlberger , Stephan Rave

Stochastic parareal (SParareal) is a probabilistic variant of the popular parallel-in-time algorithm known as parareal. Similarly to parareal, it combines fine- and coarse-grained solutions to an ordinary differential equation (ODE) using a…

Numerical Analysis · Mathematics 2023-03-13 Kamran Pentland , Massimiliano Tamborrino , T. J. Sullivan

This paper presents efforts to improve the hierarchical parallelism of a two scale simulation code. Two methods to improve the GPU parallel performance were developed and compared. The first used the NVIDIA Multi-Process Service and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-15 Jacob Merson , Mark S. Shephard

We consider a time-dependent linear diffusion equation together with a related inverse boundary value problem. The aim of the inverse problem is to determine, based on observations on the boundary, the non-homogeneous diffusion coefficient…

Numerical Analysis · Mathematics 2016-09-21 Lauri Mustonen

Neural networks offer powerful tools to solve partial differential equations (PDEs). We present a Variational Physics-Informed Neural Network (VPINN) designed for parabolic problems. Our approach combines a classical time discretization…

Numerical Analysis · Mathematics 2026-03-06 Manuela Bastidas Olivares , Josué David Acosta Castrillón , Diego A. Muñoz

Recent several years have witnessed the surge of asynchronous (async-) parallel computing methods due to the extremely big data involved in many modern applications and also the advancement of multi-core machines and computer clusters. In…

Optimization and Control · Mathematics 2019-10-17 Yangyang Xu

We establish optimal order a priori error estimates for implicit-explicit BDF methods for abstract semilinear parabolic equations with time-dependent operators in a complex Banach space settings, under a sharp condition on the…

Numerical Analysis · Mathematics 2016-06-07 Georgios Akrivis , Buyang Li
‹ Prev 1 8 9 10 Next ›