English
Related papers

Related papers: Adaptive stepsize and instabilities in complex Lan…

200 papers

In this paper, we propose a novel technique to implement stochastic gradient methods, which are beneficial for learning from large datasets, through accelerated stochastic dynamics. A stochastic gradient method is based on mini-batch…

Machine Learning · Statistics 2016-05-04 Masayuki Ohzeki

Monte Carlo sampling techniques have broad applications in machine learning, Bayesian posterior inference, and parameter estimation. Often the target distribution takes the form of a product distribution over a dataset with a large number…

Methodology · Statistics 2019-09-19 Charles Matthews , Jonathan Weare

Metastable transitions in Langevin dynamics can exhibit rich behaviors that are markedly different from its overdamped limit. In addition to local alterations of the transition path geometry, more fundamental global changes may exist. For…

Computational Physics · Physics 2018-05-28 Andre Souza , Molei Tao

Selecting an effective step-size is a fundamental challenge in first-order optimization, especially for problems with non-Euclidean geometries. This paper presents a novel adaptive step-size strategy for optimization algorithms that rely on…

Optimization and Control · Mathematics 2025-10-14 Abbas Khademi , Antonio Silveti-Falls

I discuss the so-called stochastic individual based model of adaptive dynamics and in particular how different scaling limits can be obtained by taking limits of large populations, small mutation rate, and small effect of single mutations…

Populations and Evolution · Quantitative Biology 2021-07-06 Anton Bovier

We introduce adaptive, tuning-free step size schedules for gradient-based sampling algorithms obtained as time-discretizations of Wasserstein gradient flows. The result is a suite of tuning-free sampling algorithms, including tuning-free…

Methodology · Statistics 2025-10-30 Louis Sharrock , Christopher Nemeth

We study the Langevin dynamics of diffusive particles with regular pairwise interactions under mean-field scaling. By approximating empirical distributions with conditional distributions, we establish coercive and contractive properties for…

Probability · Mathematics 2026-05-28 Songbo Wang

We study a Monte Carlo algorithm for simulation of probability distributions based on stochastic step functions, and compare to the traditional Metropolis/Hastings method. Unlike the latter, the step function algorithm can produce an…

Probability · Mathematics 2015-12-07 Torquil Macdonald Sørensen , Fred Espen Benth

We introduce a model of long-range interacting particles evolving under a stochastic Monte Carlo dynamics, in which possible increase or decrease in the values of the dynamical variables is accepted with preassigned probabilities. For…

Statistical Mechanics · Physics 2013-12-03 Shamik Gupta , Thierry Dauxois , Stefano Ruffo

We consider numerical methods for thermodynamic sampling, i.e. computing sequences of points distributed according to the Gibbs-Boltzmann distribution, using Langevin dynamics and overdamped Langevin dynamics (Brownian dynamics). A wide…

Statistical Mechanics · Physics 2015-01-13 Benedict Leimkuhler , Charles Matthews , Gabriel Stoltz

Motivated by stochastic models of climate phenomena, the steady-state of a linear stochastic model with additive Gaussian white noise is studied. Fluctuation theorems for nonequilibrium steady-states provide a constraint on the character of…

Statistical Mechanics · Physics 2008-01-04 Jeffrey B. Weiss

We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage…

Probability · Mathematics 2014-12-30 Andreas Milias-Argeitis , Mustafa Khammash

This study deals with continuous limits of interacting one-dimensional diffusive systems, arising from stochastic distortions of discrete curves with various kinds of coding representations. These systems are essentially of a…

Statistical Mechanics · Physics 2011-09-09 Guy Fayolle , Cyril Furtlehner

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

We show how to construct the optimum superstatistical dynamical model for a given experimentally measured time series. For this purpose we generalise the superstatistics concept and study a Langevin equation with a memory kernel whose…

Statistical Mechanics · Physics 2011-01-10 Erik Van der Straeten , Christian Beck

As sample sizes grow, scalability has become a central concern in the development of Markov chain Monte Carlo (MCMC) methods. One general approach to this problem, exemplified by the popular stochastic gradient Langevin dynamics (SGLD)…

Computation · Statistics 2024-12-04 Natesh S. Pillai , Aaron Smith , Azeem Zaman

In Bhattacharya et al. (Science Advances, 2020), a set of chemical reactions involved in the dynamics of actin waves in cells was studied. Both at the microscopic level, where the individual chemical reactions are directly modelled using…

Analysis of PDEs · Mathematics 2023-02-01 Christian Hamster , Peter van Heijster

Processes leading to anomalous fluctuations in turbulent flows, referred to as intermittency, are still challenging. We consider cascade trajectories through scales as realizations of a stochastic Langevin process for which multiplicative…

We present a numerical method to produce stochastic dynamics according to the generalized Langevin equation with a non-stationary memory kernel. This type of dynamics occurs when a microscopic system with an explicitly time-dependent…

Statistical Mechanics · Physics 2022-11-30 Christoph Widder , Fabian Glatzel , Tanja Schilling

We develop a theoretical approach to the protein folding problem based on out-of-equilibrium stochastic dynamics. Within this framework, the computational difficulties related to the existence of large time scale gaps in the protein folding…

Quantitative Methods · Quantitative Biology 2009-11-13 M. Sega , P. Faccioli , F. Pederiva , G. Garberoglio , H. Orland