Related papers: Adaptive stepsize and instabilities in complex Lan…
In this paper, we propose a novel technique to implement stochastic gradient methods, which are beneficial for learning from large datasets, through accelerated stochastic dynamics. A stochastic gradient method is based on mini-batch…
Monte Carlo sampling techniques have broad applications in machine learning, Bayesian posterior inference, and parameter estimation. Often the target distribution takes the form of a product distribution over a dataset with a large number…
Metastable transitions in Langevin dynamics can exhibit rich behaviors that are markedly different from its overdamped limit. In addition to local alterations of the transition path geometry, more fundamental global changes may exist. For…
Selecting an effective step-size is a fundamental challenge in first-order optimization, especially for problems with non-Euclidean geometries. This paper presents a novel adaptive step-size strategy for optimization algorithms that rely on…
I discuss the so-called stochastic individual based model of adaptive dynamics and in particular how different scaling limits can be obtained by taking limits of large populations, small mutation rate, and small effect of single mutations…
We introduce adaptive, tuning-free step size schedules for gradient-based sampling algorithms obtained as time-discretizations of Wasserstein gradient flows. The result is a suite of tuning-free sampling algorithms, including tuning-free…
We study the Langevin dynamics of diffusive particles with regular pairwise interactions under mean-field scaling. By approximating empirical distributions with conditional distributions, we establish coercive and contractive properties for…
We study a Monte Carlo algorithm for simulation of probability distributions based on stochastic step functions, and compare to the traditional Metropolis/Hastings method. Unlike the latter, the step function algorithm can produce an…
We introduce a model of long-range interacting particles evolving under a stochastic Monte Carlo dynamics, in which possible increase or decrease in the values of the dynamical variables is accepted with preassigned probabilities. For…
We consider numerical methods for thermodynamic sampling, i.e. computing sequences of points distributed according to the Gibbs-Boltzmann distribution, using Langevin dynamics and overdamped Langevin dynamics (Brownian dynamics). A wide…
Motivated by stochastic models of climate phenomena, the steady-state of a linear stochastic model with additive Gaussian white noise is studied. Fluctuation theorems for nonequilibrium steady-states provide a constraint on the character of…
We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage…
This study deals with continuous limits of interacting one-dimensional diffusive systems, arising from stochastic distortions of discrete curves with various kinds of coding representations. These systems are essentially of a…
Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…
We show how to construct the optimum superstatistical dynamical model for a given experimentally measured time series. For this purpose we generalise the superstatistics concept and study a Langevin equation with a memory kernel whose…
As sample sizes grow, scalability has become a central concern in the development of Markov chain Monte Carlo (MCMC) methods. One general approach to this problem, exemplified by the popular stochastic gradient Langevin dynamics (SGLD)…
In Bhattacharya et al. (Science Advances, 2020), a set of chemical reactions involved in the dynamics of actin waves in cells was studied. Both at the microscopic level, where the individual chemical reactions are directly modelled using…
Processes leading to anomalous fluctuations in turbulent flows, referred to as intermittency, are still challenging. We consider cascade trajectories through scales as realizations of a stochastic Langevin process for which multiplicative…
We present a numerical method to produce stochastic dynamics according to the generalized Langevin equation with a non-stationary memory kernel. This type of dynamics occurs when a microscopic system with an explicitly time-dependent…
We develop a theoretical approach to the protein folding problem based on out-of-equilibrium stochastic dynamics. Within this framework, the computational difficulties related to the existence of large time scale gaps in the protein folding…