English
Related papers

Related papers: Randomized derivative-free Milstein algorithm for …

200 papers

In this work, weakly corrected explicit, semi-implicit and implicit Milstein approximations are presented for the solution of nonlinear stochastic differential equations. The solution trajectories provided by the Milstein schemes are…

Numerical Analysis · Mathematics 2021-08-25 Tapas Tripura , Budhaditya Hazra , Souvik Chakraborty

We study geometric stochastic differential equations (SDEs) and their approximations on Riemannian manifolds. In particular, we introduce a simple new construction of geometric SDEs, using which with bounded curvature. In particular, we…

Probability · Mathematics 2023-11-22 Xiang Cheng , Jingzhao Zhang , Suvrit Sra

We propose a straightforward and effective method for discretizing multi-dimensional diffusion processes as an extension of Milstein scheme. The new scheme is explicitly given and can be simulated using Gaussian variates, requiring the same…

Numerical Analysis · Mathematics 2024-09-04 Yuga Iguchi , Toshihiro Yamada

We study the fixed design segmented regression problem: Given noisy samples from a piecewise linear function $f$, we want to recover $f$ up to a desired accuracy in mean-squared error. Previous rigorous approaches for this problem rely on…

Machine Learning · Computer Science 2016-07-15 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We present an abstract concept for the error analysis of numerical schemes for semilinear stochastic partial differential equations (SPDEs) and demonstrate its usefulness by proving the strong convergence of a Milstein-Galerkin finite…

Numerical Analysis · Mathematics 2014-11-26 Raphael Kruse

For stochastic differential equations (SDEs) with a superlinearly growing and globally one-sided Lipschitz continuous drift coefficient, the classical explicit Euler scheme fails to converge strongly to the exact solution. Recently, an…

Numerical Analysis · Mathematics 2014-08-26 Xiaojie Wang , Siqing Gan

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

Nonsmooth nonconvex optimization problems broadly emerge in machine learning and business decision making, whereas two core challenges impede the development of efficient solution methods with finite-time convergence guarantee: the lack of…

Optimization and Control · Mathematics 2022-10-18 Tianyi Lin , Zeyu Zheng , Michael I. Jordan

In this paper, we study and analyze zeroth-order stochastic approximation algorithms for solving bilvel problems, when neither the upper/lower objective values, nor their unbiased gradient estimates are available. In particular, exploiting…

Optimization and Control · Mathematics 2024-04-02 Alireza Aghasi , Saeed Ghadimi

We consider the computation of an approximately stationary point for a Lipschitz and semialgebraic function $f$ with a local oracle. If $f$ is smooth, simple deterministic methods have dimension-free finite oracle complexities. For the…

Optimization and Control · Mathematics 2022-10-14 Lai Tian , Anthony Man-Cho So

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

This paper is devoted to the numerical analysis of a fully discrete finite element approximation for the stochastic Benjamin-Bona-Mahony equation driven by multiplicative noise. We first establish the existence and uniqueness of solutions…

Numerical Analysis · Mathematics 2026-03-10 Hung D. Nguyen , Thoa Thieu , Liet Vo

We study the approximation of expectations $\E(f(X))$ for solutions $X$ of SDEs and functionals $f \colon C([0,1],\R^r) \to \R$ by means of restricted Monte Carlo algorithms that may only use random bits instead of random numbers. We…

Numerical Analysis · Mathematics 2019-01-21 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

We consider statistics for stochastic evolution equations in Hilbert space with emphasis on stochastic partial differential equations (SPDEs). We observe a solution process under additional measurement errors and want to estimate a real or…

Statistics Theory · Mathematics 2025-05-21 Gregor Pasemann , Markus Reiß

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Most simulation schemes for partial differential equations (PDEs) focus on minimizing a simple error norm of a discretized version of a field. This paper takes a fundamentally different approach; the discretized field is interpreted as data…

Methodology · Statistics 2018-04-18 Reimar H. Leike , Torsten A. Enßlin

We consider the problem of finding optimal piecewise constant approximations of one-dimensional signals. These approximations should consist of a specified number of segments (samples) and minimise the mean squared error to the original…

Signal Processing · Electrical Eng. & Systems 2019-06-12 Leif Bergerhoff , Joachim Weickert , Yehuda Dar

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

We compare a recently proposed multivariate spline based on mixed partial derivatives with two other standard splines for the scattered data smoothing problem. The splines are defined as the minimiser of a penalised least squares…

Numerical Analysis · Mathematics 2020-03-04 Elizabeth Harris , Bishnu Lamichhane , Quoc Thong Le Gia

The goal of this paper is to investigate an approach for derivative-free optimization that has not received sufficient attention in the literature and is yet one of the simplest to implement and parallelize. It consists of computing…

Optimization and Control · Mathematics 2021-02-22 Hao-Jun Michael Shi , Melody Qiming Xuan , Figen Oztoprak , Jorge Nocedal