English
Related papers

Related papers: Error bound analysis of the stochastic parareal al…

200 papers

The Parareal algorithm was invented in 2001 in order to parallelize the solution of evolution problems in the time direction. It is based on parallel fine time propagators called F and sequential coarse time propagators called G, which…

Numerical Analysis · Mathematics 2024-09-05 Martin J. Gander , Mario Ohlberger , Stephan Rave

Stochastic interpolants offer a robust framework for continuously transforming samples between arbitrary data distributions, holding significant promise for generative modeling. Despite their potential, rigorous finite-time convergence…

Machine Learning · Computer Science 2025-08-12 Yuhao Liu , Rui Hu , Yu Chen , Longbo Huang

We examine the challenges associated with numerical integration when applying Neural Networks to solve Partial Differential Equations (PDEs). We specifically investigate the Deep Ritz Method (DRM), chosen for its practical applicability and…

Numerical Analysis · Mathematics 2025-05-09 Jamie M. Taylor , David Pardo

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

In this paper, we consider an approach to the parallelizing of the algorithms realizing the modified probability changigng method with adaptation and partial rollback procedure for constrained pseudo-Boolean optimization problems. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-03 Lev Kazakovtsev

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

To study the nonlinear properties of complex natural phenomena, the evolution of the quantity of interest can be often represented by systems of coupled nonlinear stochastic differential equations (SDEs). These SDEs typically contain…

Optimization and Control · Mathematics 2024-10-22 Jan Bartsch , Robert Denk , Stefan Volkwein

We present a convergence analysis of the parallel-in-time integration method known as the Parareal algorithm for degenerate differential-algebraic systems arising from quasi-static Biot models, which govern coupled flow and deformation in…

Numerical Analysis · Mathematics 2026-01-22 Iñigo Jimenez-Ciga , Francisco Gaspar , Kundan Kumar , Florin A. Radu

A class of nonstandard pseudospectral time domain (PSTD) schemes for solving time-dependent hyperbolic and parabolic partial differential equations (PDEs) is introduced. These schemes use the Fourier collocation spectral method to compute…

Computational Physics · Physics 2018-03-23 Bradley E. Treeby , Elliott S. Wise , B. T. Cox

Physical models with uncertain inputs are commonly represented as parametric partial differential equations (PDEs). That is, PDEs with inputs that are expressed as functions of parameters with an associated probability distribution.…

Numerical Analysis · Mathematics 2023-05-15 Benjamin M. Kent , Catherine E. Powell , David J. Silvester , Małgorzata J. Zimoń

This paper studies the behavior of singularly perturbed nonlinear differential equations with boundary-layer solutions that do not necessarily converge to an equilibrium. Using the average of the fast variable and assuming the boundary…

Systems and Control · Computer Science 2018-09-24 Mohammad Deghat , Saeed Ahmadizadeh , Dragan Nesic , Chris Manzie

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

Asynchronous stochastic gradient descent (ASGD) is a popular parallel optimization algorithm in machine learning. Most theoretical analysis on ASGD take a discrete view and prove upper bounds for their convergence rates. However, the…

Machine Learning · Statistics 2018-05-09 Li He , Qi Meng , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

In this paper, we propose a stochastic method for solving equality constrained optimization problems that utilizes predictive variance reduction. Specifically, we develop a method based on the sequential quadratic programming paradigm that…

Optimization and Control · Mathematics 2023-03-28 Albert S. Berahas , Jiahao Shi , Zihong Yi , Baoyu Zhou

In this paper we introduce a numerical method for nonlinear parabolic PDEs that combines operator splitting with deep learning. It divides the PDE approximation problem into a sequence of separate learning problems. Since the computational…

Numerical Analysis · Mathematics 2021-10-12 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

Stochastic Differential Equations (SDEs) in high dimension, having the structure of finite dimensional approximation of Stochastic Partial Differential Equations (SPDEs), are considered. The aim is to compute numerically expected values and…

Probability · Mathematics 2024-04-25 Franco Flandoli , Dejun Luo , Cristiano Ricci

There is a history of simple forecast error growth models designed to capture the key properties of error growth in operational numerical weather prediction (NWP) models. We propose here such a scalar model that relies on the previous ones…

Atmospheric and Oceanic Physics · Physics 2025-10-02 Eviatar Bach , Dan Crisan , Michael Ghil

Parabolic partial differential equations (PDEs) appear in many disciplines to model the evolution of various mathematical objects, such as probability flows, value functions in control theory, and derivative prices in finance. It is often…

Machine Learning · Computer Science 2024-07-18 Xingzi Xu , Ali Hasan , Jie Ding , Vahid Tarokh