English
Related papers

Related papers: Variance reduction for irreversible Langevin sampl…

200 papers

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

Machine Learning · Computer Science 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

We provide estimates for the asymptotic gains of the displacement of a vibrating string with endpoint forcing, modeled by the wave equation with Kelvin-Voigt and viscous damping and a boundary disturbance. Two asymptotic gains are studied:…

Optimization and Control · Mathematics 2018-07-18 Iasson Karafyllis , Maria Kontorinaki , Miroslav Krstic

We discuss parametric estimation of a degenerate diffusion system from time-discrete observations. The first component of the degenerate diffusion system has a parameter $\theta_1$ in a non-degenerate diffusion coefficient and a parameter…

Statistics Theory · Mathematics 2020-02-25 Arnaud Gloter , Nakahiro Yoshida

This paper establishes the global asymptotic equivalence, in the sense of the Le Cam $\Delta$-distance, between scalar diffusion models with unknown drift function and small variance on the one side, and nonparametric autoregressive models…

Probability · Mathematics 2015-03-05 Ester Mariucci

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

The Lamperti transform offers a powerful bridge between self-similar processes and stationary dynamics, making it especially useful for analyzing anomalous diffusion models that lack stationary increments. In this paper we examine the…

Probability · Mathematics 2026-01-07 Foad Shokrollahi , Saeed Vahdati

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

In the present paper we consider Laplace deconvolution for discrete noisy data observed on the interval whose length may increase with a sample size. Although this problem arises in a variety of applications, to the best of our knowledge,…

Statistics Theory · Mathematics 2013-01-15 Felix Abramovich , Marianna Pensky , Yves Rozenholc

In this paper we study the properties of the Lasso estimator of the drift component in the diffusion setting. More specifically, we consider a multivariate parametric diffusion model $X$ observed continuously over the interval $[0,T]$ and…

Statistics Theory · Mathematics 2023-03-29 Gabriela Ciolek , Dmytro Marushkevych , Mark Podolskij

Time-irreversible stochastic processes are frequently used in natural sciences to explain non-equilibrium phenomena and to design efficient stochastic algorithms. Our main goal in this thesis is to analyse their dynamics by means of large…

Probability · Mathematics 2021-09-21 Mikola C. Schlottke

We extend the Gibbs conditioning principle to an abstract setting combining infinitely many linear equality constraints and non-linear inequality constraints, which need not be convex. A conditional large large deviation principle (LDP) is…

Functional Analysis · Mathematics 2024-10-29 Louis-Pierre Chaintron , Giovanni Conforti , Julien Reygner

In this article we propose a novel method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ with a potential $U(x)$. In particular, inspired by diffusion models we propose to consider a sequence $(\pi^{t_k})_k$ of…

Optimization and Control · Mathematics 2025-04-04 Andreas Habring , Alexander Falk , Thomas Pock

A variance reduction technique in nonparametric smoothing is proposed: at each point of estimation, form a linear combination of a preliminary estimator evaluated at nearby points with the coefficients specified so that the asymptotic bias…

Statistics Theory · Mathematics 2007-08-22 Ming-Yen Cheng , Liang Peng , Jyh-Shyang Wu

We investigate anomalous diffusion processes governed by the fractional Langevin equation and confined to a finite or semi-infinite interval by reflecting potential barriers. As the random and damping forces in the fractional Langevin…

Statistical Mechanics · Physics 2019-11-01 Thomas Vojta , Sarah Skinner , Ralf Metzler

We consider the asymptotic behaviour of the solution of one dimensional stochastic differential equations and Langevin equations in periodic backgrounds with zero average. We prove that in several such models, there is generically a non…

Probability · Mathematics 2007-05-23 P. Collet S. Martinez

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an…

Machine Learning · Statistics 2015-04-07 Dougal Maclaurin , David Duvenaud , Ryan P. Adams

We develop an efficient sampling method by simulating Langevin dynamics with an artificial force rather than a natural force by using the gradient of the potential energy. The standard technique for sampling following the predetermined…

Statistical Mechanics · Physics 2015-09-30 M. Ohzeki , A. Ichiki

We consider extended slow-fast systems of N interacting diffusions. The typical behavior of the empirical density is described by a nonlinear McKean-Vlasov equation depending on , the scaling parameter separating the time scale of the slow…

Analysis of PDEs · Mathematics 2021-08-09 Julien Barré , Cedric Bernardin , Raphaël Chétrite , Yash Chopra , Mauro Mariani

We consider irreversible translation-invariant interacting particle systems on the $d$-dimensional cubic lattice with finite local state space, which admit at least one Gibbs measure as a time-stationary measure. Under some mild degeneracy…

Probability · Mathematics 2025-09-30 Benedikt Jahnel , Jonas Köppl

This paper addresses the nonparametric estimation of the drift function over a compact domain for a time-homogeneous diffusion process, based on high-frequency discrete observations from $N$ independent trajectories. We propose a neural…

Machine Learning · Statistics 2026-04-01 Yuzhen Zhao , Yating Liu , Marc Hoffmann