English
Related papers

Related papers: Non-asymptotic bounds for sampling algorithms with…

200 papers

This paper aims to investigate the numerical approximation of a general second order parabolic stochastic partial differential equation(SPDE) driven by multiplicative and additive noise under more relaxed conditions. The SPDE is discretized…

Numerical Analysis · Mathematics 2020-01-01 Antoine Tambue , Jean Daniel Mukam

Minimum distance estimation (MDE) gained recent attention as a formulation of (implicit) generative modeling. It considers minimizing, over model parameters, a statistical distance between the empirical data distribution and the model. This…

Statistics Theory · Mathematics 2020-10-21 Ziv Goldfeld , Kristjan Greenewald , Kengo Kato

We establish generalization error bounds for stochastic gradient Langevin dynamics (SGLD) with constant learning rate under the assumptions of dissipativity and smoothness, a setting that has received increased attention in the…

Machine Learning · Statistics 2021-11-29 Tyler Farghly , Patrick Rebeschini

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we…

Probability · Mathematics 2019-11-05 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

We study parameter estimation for univariate stochastic differential equations with locally Lipschitz drift and H\"older continuous multiplicative diffusion, a class commonly arising in several applications. Existing inference methods…

Methodology · Statistics 2026-05-19 Bowen Fang , Dario Spanò , Massimiliano Tamborrino

In this paper, we provide a non-asymptotic analysis of the convergence of the stochastic gradient Hamiltonian Monte Carlo (SGHMC) algorithm to a target measure in Wasserstein-1 and Wasserstein-2 distance. Crucially, compared to the existing…

Optimization and Control · Mathematics 2025-05-27 Luxu Liang , Ariel Neufeld , Ying Zhang

The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential…

Analysis of PDEs · Mathematics 2022-01-17 Daniel Adams , Manh Hong Duong , Goncalo dos Reis

In this work, we derive sharp non-asymptotic deviation bounds for weighted sums of Dirichlet random variables. These bounds are based on a novel integral representation of the density of a weighted Dirichlet sum. This representation allows…

Probability · Mathematics 2023-04-07 Denis Belomestny , Pierre Menard , Alexey Naumov , Daniil Tiapkin , Michal Valko

Algorithmic stability is an important notion that has proven powerful for deriving generalization bounds for practical algorithms. The last decade has witnessed an increasing number of stability bounds for different algorithms applied on…

Machine Learning · Statistics 2023-10-31 Lingjiong Zhu , Mert Gurbuzbalaban , Anant Raj , Umut Simsekli

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

We consider stochastic differential equations (SDEs) driven by small L\'evy noise with some unknown parameters, and propose a new type of least squares estimators based on discrete samples from the SDEs. To approximate the increments of a…

Statistics Theory · Mathematics 2022-07-11 Mitsuki Kobayashi , Yasutaka Shimizu

In this paper we deal with pointwise approximation of solutions of stochastic differential equations (SDEs) driven by infinite dimensional Wiener process with additional jumps generated by Poisson random measure. The further investigations…

Probability · Mathematics 2022-05-04 Paweł Przybyłowicz , Michał Sobieraj , Łukasz Stȩpień

We are investigating the first strong convergence analysis of a numerical method for stochastic differential algebraic equations (SDAEs) under a non-global Lipschitz setting. It is well known that the explicit Euler scheme fails to converge…

Numerical Analysis · Mathematics 2025-09-12 Guy Tsafack , Antoine Tambue

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

Probability · Mathematics 2024-12-05 Pierre Monmarché , Katharina Schuh

We study the strong rate of convergence of the Euler--Maruyama scheme for a multidimensional stochastic differential equation (SDE) $$ dX_t = b(X_t) \, dt + dL_t, $$ with irregular $\beta$-H\"older drift, $\beta > 0$, driven by a L\'evy…

Probability · Mathematics 2024-01-12 Oleg Butkovsky , Konstantinos Dareiotis , Máté Gerencsér

We consider fully discrete numerical schemes for a downscaling data assimilation algorithm aimed at approximating the velocity field of the 2D Navier-Stokes equations corresponding to given coarse mesh observational measurements. The time…

Numerical Analysis · Mathematics 2018-05-07 Hussain A. Ibdah , Cecilia F. Mondaini , Edriss S. Titi

Sampling from probability distributions is an important problem in statistics and machine learning, specially in Bayesian inference when integration with respect to posterior distribution is intractable and sampling from the posterior is…

Computation · Statistics 2021-09-07 Jian Huang , Yuling Jiao , Lican Kang , Xu Liao , Jin Liu , Yanyan Liu

We construct a nonstandard finite difference numerical scheme to approximate stochastic differential equations (SDEs) using the idea of weighed step introduced by R.E. Mickens. We prove the strong convergence of our scheme under locally…

Numerical Analysis · Mathematics 2015-07-23 Frédéric Pierret

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

Machine Learning · Statistics 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

We study discretizations of Hamiltonian systems on the probability density manifold equipped with the $L^2$-Wasserstein metric. Based on discrete optimal transport theory, several Hamiltonian systems on graph (lattice) with different…

Numerical Analysis · Mathematics 2020-06-17 Jianbo Cui , Luca Dieci , Haomin Zhou