English
Related papers

Related papers: Adaptive sampling of large deviations

200 papers

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

These lecture notes give a short review of methods such as the matrix ansatz, the additivity principle or the macroscopic fluctuation theory, developed recently in the theory of non-equilibrium phenomena. They show how these methods allow…

Statistical Mechanics · Physics 2009-11-13 B. Derrida

We solve two problems related to the fluctuations of time-integrated functionals of Markov diffusions, used in physics to model nonequilibrium systems. In the first we derive and illustrate the appropriate boundary conditions on the…

Statistical Mechanics · Physics 2023-02-01 Johan du Buisson

The complex dynamics of physical systems can often be modeled with stochastic differential equations. However, computational constraints inhibit the estimation of dynamics from large time-series datasets. I present a method for estimating…

Data Analysis, Statistics and Probability · Physics 2023-11-02 William Davis

Importance sampling of trajectories has proved a uniquely successful strategy for exploring rare dynamical behaviors of complex systems in an unbiased way. Carrying out this sampling, however, requires an ability to propose changes to…

Statistical Mechanics · Physics 2015-07-01 Todd R. Gingrich , Phillip L. Geissler

We show that the variance of the Monte Carlo estimator that is importance sampled from an exponential family is a convex function of the natural parameter of the distribution. With this insight, we propose an adaptive importance sampling…

Methodology · Statistics 2015-01-12 Ernest K. Ryu , Stephen P. Boyd

Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…

We investigate piecewise deterministic Markov processes (PDMP), where the deterministic dynamics follows a scalar conservation law and random jumps in the system are characterized by changes in the flux function. We show under which…

Probability · Mathematics 2019-01-30 Stephan Knapp

We present a review of recent work on the statistical mechanics of non equilibrium processes based on the analysis of large deviations properties of microscopic systems. Stochastic lattice gases are non trivial models of such phenomena and…

Probability · Mathematics 2015-12-18 L. Bertini , A. De Sole , D. Gabrielli , G. Jona-Lasinio , C. Landim

Adaptive importance sampling is a class of techniques for finding good proposal distributions for importance sampling. Often the proposal distributions are standard probability distributions whose parameters are adapted based on the…

Computation · Statistics 2021-03-10 Topi Paananen , Juho Piironen , Paul-Christian Bürkner , Aki Vehtari

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the…

Machine Learning · Computer Science 2021-05-14 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

In this paper we develop the large deviations principle and a rigorous mathematical framework for asymptotically efficient importance sampling schemes for general, fully dependent systems of stochastic differential equations of slow and…

Probability · Mathematics 2013-01-29 Konstantinos Spiliopoulos

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

Adaptive importance sampling is a powerful tool to sample from complicated target densities, but its success depends sensitively on the initial proposal density. An algorithm is presented to automatically perform the initialization using…

Computation · Statistics 2013-05-01 Frederik Beaujean , Allen Caldwell

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to…

Statistical Mechanics · Physics 2021-01-14 Tom H. E. Oakes , Adam Moss , Juan P. Garrahan

Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…

Performance · Computer Science 2017-05-17 Vitali Volovoi

Understanding the fluctuations by which phenomenological evolution equations with thermodynamic structure can be enhanced is the key to a general framework of nonequilibrium statistical mechanics. These fluctuations provide an idealized…

Statistical Mechanics · Physics 2021-02-03 Hans Christian Öttinger , Mark A. Peletier , Alberto Montefusco

In this Letter we show that the analysis of Lyapunov-exponents fluctuations contributes to deepen our understanding of high-dimensional chaos. This is achieved by introducing a Gaussian approximation for the large deviation function that…

Chaotic Dynamics · Physics 2012-03-28 Pavel V. Kuptsov , Antonio Politi

We propose a method for approximating the large deviation rate function of time-integrated observables of diffusion processes, used in statistical physics to characterize the fluctuations of nonequilibrium systems. The method is based on…

Statistical Mechanics · Physics 2026-01-15 Pelerine Tsobgni Nyawo , Hugo Touchette