English
Related papers

Related papers: Easy-to-Implement One-Step Schemes for Stochastic …

200 papers

This work presents algorithms for the efficient implementation of discontinuous Galerkin methods with explicit time stepping for acoustic wave propagation on unstructured meshes of quadrilaterals or hexahedra. A crucial step towards…

Numerical Analysis · Computer Science 2019-03-06 Svenja Schoeder , Katharina Kormann , Wolfgang Wall , Martin Kronbichler

In this paper we discuss the use of implicit Runge-Kutta schemes for the time discretization of optimal control problems with evolution equations. The specialty of the considered discretizations is that the discretizations schemes for the…

Numerical Analysis · Mathematics 2013-11-05 Thomas G. Flaig

To obtain strong convergence rates of numerical schemes, an overwhelming majority of existing works impose a global monotonicity condition on coefficients of SDEs. Nevertheless, there are still many SDEs from applications that do not have…

Numerical Analysis · Mathematics 2025-04-03 Lei Dai , Xiaojie Wang

Multirate time integration methods apply different step sizes to resolve different components of the system based on the local activity levels. This local selection of step sizes allows increased computational efficiency while achieving the…

Numerical Analysis · Computer Science 2021-12-22 Arash Sarshar , Steven Roberts , Adrian Sandu

When evolving in time the solution of a hyperbolic partial differential equation, it is often desirable to use high order strong stability preserving (SSP) time discretizations. These time discretizations preserve the monotonicity…

Numerical Analysis · Mathematics 2017-08-02 Sidafa Conde , Sigal Gottlieb , Zachary J. Grant , John N. Shadid

Several classical adaptive optimization algorithms, such as line search and trust region methods, have been recently extended to stochastic settings where function values, gradients, and Hessians in some cases, are estimated via stochastic…

Optimization and Control · Mathematics 2023-10-02 Billy Jin , Katya Scheinberg , Miaolan Xie

In this paper, we propose a unified view of gradient-based algorithms for stochastic convex composite optimization by extending the concept of estimate sequence introduced by Nesterov. This point of view covers the stochastic gradient…

Machine Learning · Statistics 2019-05-08 Andrei Kulunchakov , Julien Mairal

We present stochastic variants of the exponential time differencing schemes for stiff stochastic differential equations. We derive three explicit schemes that offer better stability compared to Euler-Maruyama and Milstein's method, and…

Computational Physics · Physics 2025-12-01 Martin Kjøllesdal Johnsrud , Navdeep Rana

In this work, an approximate family of implicit multiderivative Runge-Kutta (MDRK) time integrators for stiff initial value problems is presented. The approximation procedure is based on the recent Approximate Implicit Taylor method (Baeza…

Numerical Analysis · Mathematics 2023-02-07 Jeremy Chouchoulis , Jochen Schütz

In the present paper, a class of stochastic Runge-Kutta methods containing the second order stochastic Runge-Kutta scheme due to E. Platen for the weak approximation of It\^o stochastic differential equation systems with a multi-dimensional…

Numerical Analysis · Mathematics 2013-03-20 Kristian Debrabant , Andreas Rößler

Many natural processes, such as chemical reactions and wave dynamics, are modeled as production-destruction (PD) systems that obey positivity and linear conservation laws. Classical time integrators do not guarantee positivity and can…

Numerical Analysis · Mathematics 2026-02-18 Kamila Nurkhametova , Reid J. Gomillion , Amit N. Subrahmanya , Adrian Sandu

We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is approximated by a class of stochastic differential equations with…

Machine Learning · Computer Science 2018-11-06 Qianxiao Li , Cheng Tai , Weinan E

The second-order extended stability Factorized Runge-Kutta-Chebyshev (FRKC2) class of explicit schemes for the integration of large systems of PDEs with diffusive terms is presented. FRKC2 schemes are straightforward to implement through…

Numerical Analysis · Mathematics 2017-06-28 Stephen O'Sullivan

We analyze the long-time behavior of numerical schemes for a class of monotone stochastic partial differential equations (SPDEs) driven by multiplicative noise. By deriving several time-independent a priori estimates for the numerical…

Numerical Analysis · Mathematics 2025-01-27 Zhihui Liu

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

We develop a Sequential Quadratic Optimization (SQP) algorithm for minimizing a stochastic objective function subject to deterministic equality constraints. The method utilizes two different stepsizes, one which exclusively scales the…

Optimization and Control · Mathematics 2024-08-30 Michael J. O'Neill

We prove the optimal strong convergence rate of a fully discrete scheme, based on a splitting approach, for a stochastic nonlinear Schr\"odinger (NLS) equation. The main novelty of our method lies on the uniform a priori estimate and…

Numerical Analysis · Mathematics 2019-02-25 Jianbo Cui , Jialin Hong , Zhihui Liu , Weien Zhou

In this study, we introduce a refined method for ascertaining error estimations in numerical simulations of dynamical systems via an innovative application of composition techniques. Our approach involves a dual application of a basic…

General Mathematics · Mathematics 2024-09-18 Ahmad Deeb , Denys Dutykh

Stochastic Gradient Descent (SGD) is one of the simplest and most popular stochastic optimization methods. While it has already been theoretically studied for decades, the classical analysis usually required non-trivial smoothness…

Machine Learning · Computer Science 2013-01-01 Ohad Shamir , Tong Zhang

Sampling is a fundamental algorithmic task in wide-ranging applications across multiple disciplines such as scientific computing, statistics and machine learning. In this paper, an efficient stochastic Runge-Kutta scheme is proposed to…

Statistics Theory · Mathematics 2026-05-27 Haotian Lin , Xiaojie Wang , Xiaoyan Zhang