English
Related papers

Related papers: Efficiency of a micro-macro acceleration method fo…

200 papers

We present an error analysis of weak convergence of one-step numerical schemes for stochastic differential equations (SDEs) with super-linearly growing coefficients. Following Milstein's weak error analysis on the one-step approximation of…

Numerical Analysis · Mathematics 2023-03-29 Xiaojie Wang , Yuying Zhao , Zhongqiang Zhang

In this work we introduce the Multi-Index Stochastic Collocation method (MISC) for computing statistics of the solution of a PDE with random data. MISC is a combination technique based on mixed differences of spatial approximations and…

Numerical Analysis · Mathematics 2016-07-22 Abdul-Lateef Haji-Ali , Fabio Nobile , Lorenzo Tamellini , Raul Tempone

A new technique for calculating the time-evolution, correlations and steady state spectra for nonlinear stochastic differential equations is presented. To illustrate the method, we consider examples involving cubic nonlinearities in an…

Condensed Matter · Physics 2016-08-31 S. Chaturvedi , P. D. Drummond

We present a novel approach to investigate the long-time stochastic dynamics of multi-dimensional classical systems, in contact with a heat-bath. When the potential energy landscape is rugged, the kinetics displays a decoupling of short and…

Soft Condensed Matter · Physics 2013-05-29 O. Corradini , P. Faccioli , H. Orland

We study the convergence behavior of the stochastic heavy-ball method with a small stepsize. Under a change of time scale, we approximate the discrete method by a stochastic differential equation that models small random perturbations of a…

Probability · Mathematics 2019-10-21 Wenqing Hu , Chris Junchi Li , Xiang Zhou

Novel multi-step predictor-corrector numerical schemes have been derived for approximating decoupled forward-backward stochastic differential equations (FBSDEs). The stability and high order rate of convergence of the schemes are rigorously…

Numerical Analysis · Mathematics 2021-02-12 Qiang Han , Shaolin Ji

For a class of finite elements approximations for linear stochastic parabolic PDEs it is proved that one can accelerate the rate of convergence by Richardson extrapolation. More precisely, by taking appropriate mixtures of finite elements…

Probability · Mathematics 2022-10-11 István Gyöngy , Annie Millet

We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates that improve…

Machine Learning · Statistics 2013-10-09 Shai Shalev-Shwartz , Tong Zhang

Various bias-correction methods such as EXTRA, gradient tracking methods, and exact diffusion have been proposed recently to solve distributed {\em deterministic} optimization problems. These methods employ constant step-sizes and converge…

Machine Learning · Computer Science 2023-07-19 Kun Yuan , Sulaiman A. Alghunaim , Bicheng Ying , Ali H. Sayed

Stochastic Gradient Descent (SGD) is a popular optimization method which has been applied to many important machine learning tasks such as Support Vector Machines and Deep Neural Networks. In order to parallelize SGD, minibatch training is…

Machine Learning · Statistics 2014-05-14 Peilin Zhao , Tong Zhang

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

Deep learning networks are typically trained by Stochastic Gradient Descent (SGD) methods that iteratively improve the model parameters by estimating a gradient on a very small fraction of the training data. A major roadblock faced when…

Machine Learning · Computer Science 2020-06-11 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

The truncated Euler-Maruyama (EM) method is proposed to approximate a class of non-autonomous stochastic differential equations (SDEs) with the H\"older continuity in the temporal variable and the super-linear growth in the state variable.…

Numerical Analysis · Mathematics 2019-07-19 Wei Liu , Xuerong Mao , Jingwen Tang , Yue Wu

The smooth particle mesh Ewald (SPME) method is the standard method for computing the electrostatic interactions in the molecular simulations. In this work, the multiple staggered mesh Ewald (MSME) method is proposed to boost the accuracy…

Computational Physics · Physics 2016-07-15 Han Wang , Xingyu Gao , Jun Fang

In this paper, we discuss and compare two probabilistic approaches for associating a stochastic differential equation with a McKean-type partial differential equation featuring a reaction term and path-dependent coefficients. The…

Probability · Mathematics 2026-02-10 Daniela Morale , Leonardo Tarquini , Stefania Ugolini

We investigate the acceleration of stationary iterations for multi-term Sylvester equation by means of reduced rank extrapolation (RRE). Theoretical convergence results and implementations are provided for both small and large-scale…

Numerical Analysis · Mathematics 2026-03-16 Peter Benner , Pascal den Boef , Patrick Kürschner , Xiaobo Liu , Jens Saak

State-space mixed-frequency vector autoregressions are now widely used for nowcasting. Despite their popularity, estimating such models can be computationally intensive, especially for large systems with stochastic volatility. To tackle the…

Econometrics · Economics 2021-12-22 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

The macroscopic behavior of dissipative stochastic partial differential equations usually can be described by a finite dimensional system. This article proves that a macroscopic reduced model may be constructed for stochastic…

Mathematical Physics · Physics 2008-12-11 Wei Wang , A. J. Roberts

This paper discusses several techniques which may be used for applying the coupling method to solutions of stochastic differential equations (SDEs). They all work in dimension $d\ge 1$, although, in $d=1$ the most natural way is to use…

Probability · Mathematics 2021-06-30 Alexander Veretennikov

In this paper we consider the parameter estimation problem associated to partially-observed time changed SDEs, with observations that are given at discrete times. In particular we consider both likelihood and Bayesian estimation. We develop…

Numerical Analysis · Mathematics 2026-05-12 Ke Zhao , Ajay Jasra