English
Related papers

Related papers: Efficiency of a micro-macro acceleration method fo…

200 papers

Stochastic differential equations (SDEs) are of utmost importance in various scientific and industrial areas. They are the natural description of dynamical processes whose precise equations of motion are either not known or too expensive to…

Methodology · Statistics 2017-11-08 Philipp Frank , Theo Steininger , Torsten A. Enßlin

Sample average approximation--based stochastic dynamic programming (SDP) and model predictive control (MPC) are two different methods for approaching multistage stochastic optimization. In this paper we investigate the conditions under…

Optimization and Control · Mathematics 2026-02-10 Dominic S. T. Keehan , Andrew B. Philpott , Edward J. Anderson

This paper mainly investigates the strong convergence and stability of the truncated Euler-Maruyama (EM) method for stochastic differential delay equations with variable delay whose coefficients can be growing super-linearly. By…

Numerical Analysis · Mathematics 2021-08-10 Shounian Deng , Chen Fei , Weiyin Fei , Xuerong Mao

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

Multilevel sampling methods, such as multilevel and multifidelity Monte Carlo, multilevel stochastic collocation, or delayed acceptance Markov chain Monte Carlo, have become standard uncertainty quantification (UQ) tools for a wide class of…

Numerical Analysis · Mathematics 2025-10-01 Josef Martínek , Erin Carson , Robert Scheichl

In this article, we present a simple technique for boosting the order of accuracy of finite difference schemes for time dependent partial differential equations by optimally selecting the time step used to advance the numerical solution and…

Numerical Analysis · Mathematics 2009-05-26 Kevin T. Chu

Physical models with uncertain inputs are commonly represented as parametric partial differential equations (PDEs). That is, PDEs with inputs that are expressed as functions of parameters with an associated probability distribution.…

Numerical Analysis · Mathematics 2023-05-15 Benjamin M. Kent , Catherine E. Powell , David J. Silvester , Małgorzata J. Zimoń

Discrete Element Methods (DEM), i.e.~the simulation of many rigid particles, suffer from very stiff differential equations plus multiscale challenges in space and time. The particles move smoothly through space until they interact almost…

Mathematical Software · Computer Science 2023-09-28 Peter Noble , Tobias Weinzierl

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

The present article investigates the convergence of a class of space-time discretization schemes for the Cauchy problem for linear parabolic stochastic partial differential equations (SPDEs) defined on the whole space. Sufficient conditions…

Probability · Mathematics 2012-10-04 Eric Joseph Hall

We prove new convergence rates for a generalized version of stochastic Nesterov acceleration under interpolation conditions. Unlike previous analyses, our approach accelerates any stochastic gradient method which makes sufficient progress…

Optimization and Control · Mathematics 2025-01-27 Aaron Mishkin , Mert Pilanci , Mark Schmidt

We consider a class of stochastic smooth convex optimization problems under rather general assumptions on the noise in the stochastic gradient observation. As opposed to the classical problem setting in which the variance of noise is…

Optimization and Control · Mathematics 2024-08-23 Sasila Ilandarideva , Anatoli Juditsky , Guanghui Lan , Tianjiao Li

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a…

Machine Learning · Statistics 2022-10-25 Sasila Ilandarideva , Yannis Bekri , Anatoli Juditsky , Vianney Perchet

An effective macroscopic model for a stochastic microscopic system is derived. The original microscopic system is modeled by a stochastic partial differential equation defined on a domain perforated with small holes or heterogeneities. The…

Analysis of PDEs · Mathematics 2007-05-23 Wei Wang , Daomin Cao , Jinqiao Duan

This paper deals with the Monte-Carlo methods for evaluating expectations of functionals of solutions to McKean-Vlasov Stochastic Differential Equations (MV-SDE) with drifts of super-linear growth. We assume that the MV-SDE is approximated…

Probability · Mathematics 2018-10-15 Goncalo dos Reis , Greig Smith , Peter Tankov

It has been experimentally observed that the efficiency of distributed training with stochastic gradient (SGD) depends decisively on the batch size and -- in asynchronous implementations -- on the gradient staleness. Especially, it has been…

Machine Learning · Computer Science 2021-03-04 Sebastian U. Stich , Amirkeivan Mohtashami , Martin Jaggi

We develop in this work a numerical method for stochastic differential equations (SDEs) with weak second order accuracy based on Gaussian mixture. Unlike the conventional higher order schemes for SDEs based on It\^o-Taylor expansion and…

Numerical Analysis · Mathematics 2021-08-12 Lei Li , Jianfeng Lu , Jonathan Mattingly , Lihan Wang

This paper studies the performative prediction problem which optimizes a stochastic loss function with data distribution that depends on the decision variable. We consider a setting where the agent(s) provides samples adapted to the…

Optimization and Control · Mathematics 2021-10-05 Qiang Li , Hoi-To Wai

We introduce an explicit, adaptive time-stepping scheme for the simulation of SPDEs with one-sided Lipschitz drift coefficients. Strong convergence rates are proven for the full space-time discretisation with multiplicative trace-class…

Numerical Analysis · Mathematics 2019-08-27 Stuart Campbell , Gabriel Lord

We present an error analysis of weak convergence of one-step numerical schemes for stochastic differential equations (SDEs) with super-linearly growing coefficients. Following Milstein's weak error analysis on the one-step approximation of…

Numerical Analysis · Mathematics 2023-03-29 Xiaojie Wang , Yuying Zhao , Zhongqiang Zhang