English
Related papers

Related papers: On the implicit regularization of Langevin dynamic…

200 papers

Langevin models are frequently used to model various stochastic processes in different fields of natural and social sciences. They are adapted to measured data by estimation techniques such as maximum likelihood estimation, Markov chain…

Data Analysis, Statistics and Probability · Physics 2021-08-04 Clemens Willers , Oliver Kamps

We consider a Langevin-type diffusion on the planar motion group $\mathrm{SE}(2)$, describing the coupled evolution of position and orientation with degenerate noise acting only in the rotational direction. Although hypocoercivity for…

Probability · Mathematics 2026-05-13 Martin Grothaus , Andrea V. Hurtado-Quiceno

We show the relation between processes which are modeled by a Langevin equation with multiplicative noise and infinite ergodic theory. We concentrate on a spatially dependent diffusion coefficient that behaves as ${D(x)}\sim…

Statistical Mechanics · Physics 2019-05-01 N. Leibovich , E. Barkai

We study the implicit regularization of gradient descent towards structured sparsity via a novel neural reparameterization, which we call a diagonally grouped linear neural network. We show the following intriguing property of our…

Machine Learning · Statistics 2023-01-31 Jiangyuan Li , Thanh V. Nguyen , Chinmay Hegde , Raymond K. W. Wong

We show how Langevin diffusions can be interpreted in the context of stochastic Hamiltonian systems with structure-preserving noise and dissipation on reductive Lie groups. Reductive Lie groups provide the setting in which the Lie group…

Probability · Mathematics 2025-09-15 Erwin Luesink , Oliver D. Street

We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and…

Machine Learning · Computer Science 2020-11-20 Xiang Cheng , Dong Yin , Peter L. Bartlett , Michael I. Jordan

In this paper we prove strong well-posedness for a system of stochastic differential equations driven by a degenerate diffusion satisfying a weak-type H\"ormander condition, assuming H\"older regularity assumptions on the drift coefficient.…

Probability · Mathematics 2022-10-07 Giacomo Lucertini , Stefano Pagliarani , Andrea Pascucci

Stochastic Gradient Langevin Dynamics (SGLD) is a popular variant of Stochastic Gradient Descent, where properly scaled isotropic Gaussian noise is added to an unbiased estimate of the gradient at each iteration. This modest change allows…

Machine Learning · Computer Science 2017-06-06 Maxim Raginsky , Alexander Rakhlin , Matus Telgarsky

We introduce a scheme for deriving an optimally-parametrised Langevin dynamics of few collective variables from data generated in molecular dynamics simulations. The drift and the position-dependent diffusion profiles governing the Langevin…

Statistical Mechanics · Physics 2008-08-22 Cristian Micheletti , Giovanni Bussi , Alessandro Laio

This paper introduces a geometric method for proving ergodicity of degenerate noise driven stochastic processes. The driving noise is assumed to be an arbitrary Levy process with non-degenerate diffusion component (but that may be applied…

Probability · Mathematics 2008-04-10 Nawaf Bou-Rabee , Houman Owhadi

A dynamics between Newton and Langevin formalisms is elucidated within the framework of the generalized Langevin equation. For thermal noise yielding a vanishing zero-frequency friction the corresponding non-Markovian Brownian dynamics…

Statistical Mechanics · Physics 2007-07-23 Jing-Dong Bao , Yi-Zhong Zhuo , Fernando A. Oliveira , Peter Hanggi

Understanding the behavior of stochastic gradient descent (SGD) in the context of deep neural networks has raised lots of concerns recently. Along this line, we study a general form of gradient based optimization dynamics with unbiased…

Machine Learning · Statistics 2019-06-11 Zhanxing Zhu , Jingfeng Wu , Bing Yu , Lei Wu , Jinwen Ma

In many instances, the dynamical richness and complexity observed in natural phenomena can be related to stochastic drives influencing their temporal evolution. For example, random noise allied to spatial asymmetries may induce…

Statistical Mechanics · Physics 2023-10-03 K. S. Fa , C. -L. Ho , Y. B. Matos , M. G. E da Luz

Data-driven modeling of non-Markovian dynamics is a recent topic of research with applications in many fields such as climate research, molecular dynamics, biophysics, or wind power modeling. In the frequently used standard Langevin…

Data Analysis, Statistics and Probability · Physics 2022-07-22 Clemens Willers , Oliver Kamps

The translational motion of anisotropic or self-propelled colloidal particles is closely linked with the particle's orientation and its rotational Brownian motion. In the overdamped limit, the stochastic evolution of the orientation vector…

Statistical Mechanics · Physics 2025-10-17 Felix Höfling , Arthur V. Straube

Recent years have seen a flurry of activities in designing provably efficient nonconvex procedures for solving statistical estimation problems. Due to the highly nonconvex nature of the empirical loss, state-of-the-art procedures often…

Machine Learning · Computer Science 2020-06-09 Cong Ma , Kaizheng Wang , Yuejie Chi , Yuxin Chen

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin…

Optimization and Control · Mathematics 2022-01-12 Tobias Breiten , Carsten Hartmann , Lara Neureither , Upanshu Sharma

Systems living in complex non equilibrated environments often exhibit subdiffusion characterized by a sublinear power-law scaling of the mean square displacement. One of the most common models to describe such subdiffusive dynamics is the…

Statistical Mechanics · Physics 2015-07-03 Andrea Cairoli , Adrian Baule

We solve the generalized Langevin equation driven by a stochastic force with power-law autocorrelation function. A stationary Markov process has been applied as a model of the noise. However, the resulting velocity variance does not…

Statistical Mechanics · Physics 2015-07-22 T. Srokowski
‹ Prev 1 2 3 10 Next ›