English
Related papers

Related papers: Adaptive stepsize and instabilities in complex Lan…

200 papers

Langevin algorithms are popular Markov chain Monte Carlo methods that are often used to solve high-dimensional large-scale sampling problems in machine learning. The most classical Langevin Monte Carlo algorithm is based on the overdamped…

Probability · Mathematics 2026-05-21 Nian Yao , Pervez Ali , Xihua Tao , Lingjiong Zhu

A wide variety of numerical methods are evaluated and compared for solving the stochastic differential equations encountered in molecular dynamics. The methods are based on the application of deterministic impulses, drifts, and Brownian…

Computational Physics · Physics 2013-05-14 Benedict Leimkuhler , Charles Matthews

A binary fluid mixture in contact with lateral particle reservoirs is considered. By imposing different particle concentrations in these reservoirs, the system can be maintained under controlled non-equilibrium conditions. Previous…

Statistical Mechanics · Physics 2026-04-01 O. Politano , Alejandro L. Garcia , F. Baras , M. Malek Mansour

We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in the high-dimensional regime. We prove limit theorems for the trajectories of summary statistics (i.e., finite-dimensional functions) of SGD as the…

Machine Learning · Statistics 2023-08-21 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

The problem of biological motion is a very intriguing and topical issue. Many efforts are being focused on the development of novel modeling approaches for the description of anomalous diffusion in biological systems, such as the very…

In Hamiltonian systems subjected to periodic perturbations the stable and unstable manifolds of the unstable periodic orbits provide the dynamical "skeleton" that drives the mixing process and bounds the chaotic regions of the phase space.…

Plasma Physics · Physics 2016-10-05 David Ciro Taborda , Todd Edwin Evans , Iberê Luiz Caldas

After a short review of one of proposals to avoid complex stochastic processes in Complex Langevin studies, the recent progress in the former is reported. In particular, the new developments allow now to construct positive and normalizable…

High Energy Physics - Lattice · Physics 2018-10-30 Jacek Wosiek , Blazej Ruba

Forecasting the evolution of complex systems is one of the grand challenges of modern data science. The fundamental difficulty lies in understanding the structure of the observed stochastic process. In this paper, we show that every…

Statistics Theory · Mathematics 2020-01-01 Xiucai Ding , Zhou Zhou

The kinetics of monoatomic steps in diffusion-controlled crystal growth and evaporation processes are investigated analytically using a Green's function approach. Integro-differential equations of motion for the steps are derived; and a…

Condensed Matter · Physics 2009-10-22 Fong Liu , H. Metiu

The purpose of this paper is to examine the Lagrangian stochastic modeling of the fluid velocity seen by inertial particles in a nonhomogeneous turbulent flow. A new Langevin-type model, compatible with the transport equation of the drift…

Fluid Dynamics · Physics 2009-07-01 Boris Arcen , Anne Tanière

We present adaptive gradient methods (both basic and accelerated) for solving convex composite optimization problems in which the main part is approximately smooth (a.k.a. $(\delta, L)$-smooth) and can be accessed only via a (potentially…

Optimization and Control · Mathematics 2024-06-11 Anton Rodomanov , Xiaowen Jiang , Sebastian Stich

The selective frequency damping (SFD) method is an alternative to classical Newton's method to obtain unstable steady-state solutions of dynamical systems. However this method has two main limitations: it does not converge for arbitrary…

Fluid Dynamics · Physics 2015-10-28 Bastien E. Jordi , Colin J. Cotter , Spencer J. Sherwin

The theoretical justification of the Hybrid Monte Carlo algorithm depends upon the molecular dynamics trajectories within it being exactly reversible. If computations were carried out with exact arithmetic then it would be easy to ensure…

High Energy Physics - Lattice · Physics 2009-10-28 R. G. Edwards , Ivan Horváth , A. D. Kennedy

Complex systems are sometimes subject to non Gaussian alpha stable Levy fluctuations. A new method is devised to estimate this uncertain parameter and other system parameters, using observations on either mean exit time or escape…

Dynamical Systems · Mathematics 2013-06-04 Ting Gao , Jinqiao Duan

The paper presents a multidimensional model for nonlinear Markovian random walks that generalizes one we developed previously (Phys. Rev. E v.79, 011110, 2009) in order to describe the Levy type stochastic processes in terms of continuous…

Statistical Mechanics · Physics 2015-05-13 Ihor Lubashevsky , Rudolf Friedrich , Andreas Heuer

We present a simulation strategy for the real-time dynamics of quantum fields, inspired by reinforcement learning. It builds on the complex Langevin approach, which it amends with system specific prior information, a necessary prerequisite…

High Energy Physics - Lattice · Physics 2023-10-13 Daniel Alvestad , Alexander Rothkopf , Dénes Sexty

Efficient analysis and simulation of multiscale stochastic systems of chemical kinetics is an ongoing area for research, and is the source of many theoretical and computational challenges. In this paper, we present a significant improvement…

Numerical Analysis · Mathematics 2016-09-21 Simon Cotter

Hamiltonian Monte Carlo and underdamped Langevin Monte Carlo are state-of-the-art methods for taking samples from high-dimensional distributions with a differentiable density function. To generate samples, they numerically integrate…

Computation · Statistics 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

The utilization of online stochastic algorithms is popular in large-scale learning settings due to their ability to compute updates on the fly, without the need to store and process data in large batches. When a constant step-size is used,…

Optimization and Control · Mathematics 2023-07-19 Stefan Vlaski , Elsa Rizk , Ali H. Sayed

We develop an efficient sampling method by simulating Langevin dynamics with an artificial force rather than a natural force by using the gradient of the potential energy. The standard technique for sampling following the predetermined…

Statistical Mechanics · Physics 2015-09-30 M. Ohzeki , A. Ichiki