English
Related papers

Related papers: Adaptive sampling of large deviations

200 papers

We consider stochastic zero-order optimization problems, which arise in settings from simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method where we estimate the gradients of a stochastic…

Optimization and Control · Mathematics 2019-10-31 Raghu Bollapragada , Stefan M. Wild

We analyse large deviations of the dynamical activity in one-dimensional systems of diffusing hard particles. Using an optimal-control representation of the large-deviation problem, we analyse effective interaction forces which can be added…

Statistical Mechanics · Physics 2020-01-22 Jakub Dolezal , Robert L. Jack

Simultaneous load forecasting across multiple entities (e.g., regions, buildings) is crucial for the efficient, reliable, and cost-effective operation of power systems. Accurate load forecasting is a challenging problem due to the inherent…

Machine Learning · Computer Science 2026-01-21 Onintze Zaballa , Verónica Álvarez , Santiago Mazuelas

Linear diffusions are used to model a large number of stochastic processes in physics, including small mechanical and electrical systems perturbed by thermal noise, as well as Brownian particles controlled by electrical and optical forces.…

Statistical Mechanics · Physics 2023-05-10 Johan du Buisson , Hugo Touchette

In this paper, we study the dynamics of a linear control system with given state feedback control law in the presence of fast periodic sampling at temporal frequency $1/\delta$ ($0 < \delta \ll 1$), together with small white noise…

Probability · Mathematics 2021-10-15 Shivam Dhama , Chetan D. Pahlajani

Sampling rare events in metastable dynamical systems is often a computationally expensive task and one needs to resort to enhanced sampling methods such as importance sampling. Since we can formulate the problem of finding optimal…

Optimization and Control · Mathematics 2023-10-05 Enric Ribera Borrell , Jannes Quer , Lorenz Richter , Christof Schütte

Piecewise-Deterministic Markov Processes (PDMPs) hold significant promise for sampling from complex probability distributions. However, their practical implementation is hindered by the need to compute model-specific bounds. Conversely,…

Computation · Statistics 2025-03-17 Augustin Chevallier , Sam Power , Matthew Sutton

This paper studies the distributed adaptiveestimation problems for stochastic large regression modelswith an infinite number of parameters. By constructing a re-cursive local cost function, we propose a novel distributedrecursive least…

Systems and Control · Electrical Eng. & Systems 2026-04-29 Die Gan , Siyu Xie , Zhixin Liu , Xuebo Zhang

For Markov processes evolving on multiple time-scales a combination of large component scalings and averaging of rapid fluctuations can lead to useful limits for model approximation. A general approach to proving a law of large numbers to a…

Probability · Mathematics 2020-12-29 Lea Popovic

Complex systems may often be characterized by their hierarchical dynamics. In this paper do we present a method and an operational algorithm that automatically infer this property in a broad range of systems; discrete stochastic processes.…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Olof Görnerup , Martin Nilsson Jacobi

We consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling…

Optimization and Control · Mathematics 2021-09-28 Raghu Bollapragada , Stefan M. Wild

In this work we investigate an importance sampling approach for evaluating policies for a structurally time-varying factored Markov decision process (MDP), i.e. the policy's value is estimated with a high-probability confidence interval. In…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Carmel Fiscko , Soummya Kar , Bruno Sinopoli

We describe stochastic calculus in the context of processes that are driven by an adapted point process of locally finite intensity and are differentiable between jumps. This includes Markov chains as well as non-Markov processes. By…

Probability · Mathematics 2016-07-26 Eric Foxall

We present an algorithm to evaluate the large deviation functions associated to history-dependent observables. Instead of relying on a time discretisation procedure to approximate the dynamics, we provide a direct continuous-time algorithm,…

Statistical Mechanics · Physics 2007-12-03 Vivien Lecomte , Julien Tailleur

We investigate the parameter recovery of Markov-switching ordinary differential processes from discrete observations, where the differential equations are nonlinear additive models. This framework has been widely applied in biological…

Methodology · Statistics 2025-01-03 Katherine Tsai , Mladen Kolar , Sanmi Koyejo

We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…

Probability · Mathematics 2022-02-18 Frank Redig , Florian Völlering

In Monte-Carlo methods the Markov processes used to sample a given target distribution usually satisfy detailed balance, i.e. they are time-reversible. However, relatively recent results have demonstrated that appropriate reversible and…

Probability · Mathematics 2016-06-29 Luc Rey-Bellet , Konstantinos Spiliopoulos

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

We study the convergence of statistical estimators used in the estimation of large deviation functions describing the fluctuations of equilibrium, nonequilibrium, and manmade stochastic systems. We give conditions for the convergence of…

Statistical Mechanics · Physics 2015-11-09 Christian M. Rohwer , Florian Angeletti , Hugo Touchette

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola