English
Related papers

Related papers: Rare event estimation with sequential directional …

200 papers

This article analyzes and compares two general techniques of rare event simulation for generating paths of Markov processes over fixed time horizons: exponential tilting and stochastic bridge. These two methods allow to accurately compute…

Statistical Mechanics · Physics 2025-08-27 Javier Aguilar , Riccardo Gatto

This work presents the convergence rate analysis of stochastic variants of the broad class of direct-search methods of directional type. It introduces an algorithm designed to optimize differentiable objective functions $f$ whose values can…

Optimization and Control · Mathematics 2020-03-09 Kwassi Joseph Dzahini

Probabilistic software analysis aims at quantifying the probability of a target event occurring during the execution of a program processing uncertain incoming data or written itself using probabilistic programming constructs. Recent…

Machine Learning · Computer Science 2021-06-21 Yicheng Luo , Antonio Filieri , Yuan Zhou

We propose an adaptive importance sampling scheme for the simulation of rare events when the underlying dynamics is given by a diffusion. The scheme is based on a Gibbs variational principle that is used to determine the optimal (i.e.…

Probability · Mathematics 2019-07-24 Carsten Hartmann , Omar Kebiri , Lara Neureither , Lorenz Richter

We study rare events in systems of diffusive fields driven out of equilibrium by the boundaries. We present a numerical technique and use it to calculate the probabilities of rare events in one and two dimensions. Using this technique, we…

Statistical Mechanics · Physics 2015-09-10 Guy Bunin , Yariv Kafri , Daniel Podolsky

Annealed Importance Sampling (AIS) moves particles along a Markov chain from a tractable initial distribution to an intractable target distribution. The recently proposed Differentiable AIS (DAIS) (Geffner and Domke, 2021; Zhang et al.,…

Machine Learning · Statistics 2023-04-28 Johannes Zenn , Robert Bamler

Importance sampling has become an important tool for the computation of tail-based risk measures. Since such quantities are often determined mainly by rare events standard Monte Carlo can be inefficient and importance sampling provides a…

Probability · Mathematics 2013-06-29 Pierre Nyquist

Rare trajectories of stochastic systems are important to understand -- because of their potential impact. However, their properties are by definition difficult to sample directly. Population dynamics provides a numerical tool allowing their…

Statistical Mechanics · Physics 2017-07-03 Esteban Guevara Hidalgo , Takahiro Nemoto , Vivien Lecomte

Imposing some flexible sampling scheme we provide some discretization of continuous time discrete scale invariant (DSI) processes which is a subsidiary discrete time DSI process. Then by introducing some simple random measure we provide a…

Methodology · Statistics 2016-06-22 S. Rezakhah , Y. Maleki

Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of…

Machine Learning · Computer Science 2022-09-29 Ali Mousavi , Reza Monsefi , Víctor Elvira

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

In chaotic dynamical systems, a number of rare trajectories with low level of chaoticity are embedded in chaotic sea, while extraordinary unstable trajectories can exist even in weakly chaotic regions. In this study, a quantitative method…

Chaotic Dynamics · Physics 2010-10-06 Akimasa Kitajima , Yukito Iba

Nested Sampling is a method for computing the Bayesian evidence, also called the marginal likelihood, which is the integral of the likelihood with respect to the prior. More generally, it is a numerical probabilistic quadrature rule. The…

Computation · Statistics 2023-10-09 Jonas Latz , Doris Schneider , Philipp Wacker

Rare-event simulation techniques, such as importance sampling (IS), constitute powerful tools to speed up challenging estimation of rare catastrophic events. These techniques often leverage the knowledge and analysis on underlying system…

Methodology · Statistics 2021-11-04 Mansur Arief , Yuanlu Bai , Wenhao Ding , Shengyi He , Zhiyuan Huang , Henry Lam , Ding Zhao

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

The stochastic simulation algorithm (SSA) and the corresponding Monte Carlo (MC) method are among the most common approaches for studying stochastic processes. They rely on knowledge of interevent probability density functions (PDFs) and on…

Computation · Statistics 2024-02-12 S. Rusconi , E. Akhmatskaya , D. Sokolovski , N. Ballard , J. C. de la Cal

The naive importance sampling (IS) estimator generally does not work well in examples involving simultaneous inference on several targets, as the importance weights can take arbitrarily large values, making the estimator highly unstable. In…

Methodology · Statistics 2022-04-20 Vivekananda Roy , Evangelos Evangelou

When an interval of integers between the lower bound $l_i$ and the upper bound $u_i$ is the support of the marginal distribution $n_i|(n_{i-1}, ...,n_1)$, Chen et al, 2005 noticed that sampling from the interval at each step, for $n_i$…

Combinatorics · Mathematics 2018-01-19 Ruriko Yoshida , Jing Xi , Shaoceng Wei , Feng Zhou , David Haws

Annealed importance sampling (AIS) and related algorithms are highly effective tools for marginal likelihood estimation, but are not fully differentiable due to the use of Metropolis-Hastings correction steps. Differentiability is a…

Machine Learning · Statistics 2021-10-28 Guodong Zhang , Kyle Hsu , Jianing Li , Chelsea Finn , Roger Grosse

Understanding systems by forward and inverse modeling is a recurrent topic of research in many domains of science and engineering. In this context, Monte Carlo methods have been widely used as powerful tools for numerical inference and…

Computation · Statistics 2022-02-14 F. Llorente , L. Martino , D. Delgado , G. Camps-Valls