English
Related papers

Related papers: Error distributions for random grid approximations…

200 papers

We establish general conditions under which there exists uniform in time convergence between a stochastic process and its approximated system. These standardised conditions consist of a local in time estimate between the original and the…

Probability · Mathematics 2024-12-09 Katharina Schuh , Iain Souttar

In the past decade, an intensive study of strong approximation of stochastic differential equations (SDEs) with a drift coefficient that has discontinuities in space has begun. In the majority of these results it is assumed that the drift…

Probability · Mathematics 2020-10-05 Thomas Müller-Gronbach , Larisa Yaroslavtseva

We prove novel convergence results for a stochastic proximal gradient algorithm suitable for solving a large class of convex optimization problems, where a convex objective function is given by the sum of a smooth and a possibly non-smooth…

Optimization and Control · Mathematics 2016-08-11 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

The paper considers the problem of network-based computation of global minima in smooth nonconvex optimization problems. It is known that distributed gradient-descent-type algorithms can achieve convergence to the set of global minima by…

Optimization and Control · Mathematics 2019-10-24 Brian Swenson , Anirudh Sridhar , H. Vincent Poor

The aim of this paper is to develop stable and accurate numerical schemes for boundary integral formulations of the heat equation with Dirichlet boundary conditions. The accuracy of Galerkin discretisations for the resulting boundary…

Numerical Analysis · Mathematics 2018-05-01 Alexey Chernov , Anne Reinarz

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

In this paper, we study the almost sure boundedness and the convergence of the stochastic approximation (SA) algorithm. At present, most available convergence proofs are based on the ODE method, and the almost sure boundedness of the…

Machine Learning · Statistics 2023-01-10 M. Vidyasagar

We propose a new simple and explicit numerical scheme for time-homogeneous stochastic differential equations. The scheme is based on sampling increments at each time step from a skew-symmetric probability distribution, with the level of…

Probability · Mathematics 2025-07-08 Yuga Iguchi , Samuel Livingstone , Nikolas Nüsken , Giorgos Vasdekis , Rui-Yang Zhang

Stochastic gradient descent (SGD) is the optimization algorithm of choice in many machine learning applications such as regularized empirical risk minimization and training deep neural networks. The classical convergence analysis of SGD is…

Optimization and Control · Mathematics 2018-07-10 Lam M. Nguyen , Phuong Ha Nguyen , Marten van Dijk , Peter Richtárik , Katya Scheinberg , Martin Takáč

Bayesian neural network posterior distributions have a great number of modes that correspond to the same network function. The abundance of such modes can make it difficult for approximate inference methods to do their job. Recent work has…

Machine Learning · Statistics 2024-07-03 Tommy Rochussen

We study backward stochastic differential equations (BSDEs) in infinite horizon and design efficient numerical schemes for solving them. We establish a probabilistic representation of the solution of the BSDE using Malliavin derivative and…

Probability · Mathematics 2026-04-28 Emmanuel Gobet , Adrien Richou , Charu Shardul

We consider the finite difference discretization of isotropic elastic wave equations on nonuniform grids. The intended applications are seismic studies, where heterogeneity of the earth media can lead to severe oversampling for simulations…

Numerical Analysis · Mathematics 2022-02-15 Longfei Gao , David Keyes

We discuss numerical approximation methods for Random Time Change equations which possess a deterministic drift part and jump with state-dependent rates. It is first established that solutions to such equations are versions of certain…

Probability · Mathematics 2013-10-03 Martin G. Riedler , Girolama Notarangelo

This paper is to analyze the approximation solution of a split variational inclusion problem in the framework of infinite dimensional Hilbert spaces. For this purpose, several inertial hybrid and shrinking projection algorithms are proposed…

Optimization and Control · Mathematics 2024-09-17 Zheng Zhou , Bing Tan , Songxiao Li

It is generally recognized that finite learning rate (LR), in contrast to infinitesimal LR, is important for good generalization in real-life deep nets. Most attempted explanations propose approximating finite-LR SGD with Ito Stochastic…

Machine Learning · Computer Science 2021-06-18 Zhiyuan Li , Sadhika Malladi , Sanjeev Arora

We establish thresholds for the feasibility of random multi-graph alignment in two models. In the Gaussian model, we demonstrate an "all-or-nothing" phenomenon: above a critical threshold, exact alignment is achievable with high…

Statistics Theory · Mathematics 2026-05-25 Louis Vassaux , Laurent Massoulié

The Inverse Problem for the estimation of a point-wise approximation error occurring at the discretization and solving of the system of partial differential equations is addressed. The set of the differences between the numerical solutions…

Numerical Analysis · Mathematics 2021-01-05 Aleksey Alekseev , Alexander Bondarev

In this paper we analyze the approximation of multivariate integrals over the Euclidean plane for functions which are analytic. We show explicit upper bounds which attain the exponential rate of convergence. We use an infinite grid with…

Numerical Analysis · Mathematics 2018-03-19 Dong T. P. Nguyen , Dirk Nuyens

Errors of approximations of the quasi-stationary distribution (the QSD) of the logistic SIS model are evaluated numerically. The results are used to derive asymptotic approximations of the approximation errors for large populations. We show…

Probability · Mathematics 2022-01-27 Ingemar Nåsell

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We first investigate distributed stochastic gradient methods (SGM), with mini-batches…

Machine Learning · Statistics 2018-11-06 Junhong Lin , Volkan Cevher