English
Related papers

Related papers: Coupling rare event algorithms with data-based lea…

200 papers

In a number of applications, particularly in financial and actuarial mathematics, it is of interest to characterize the tail distribution of a random variable $V$ satisfying the distributional equation $V\stackrel{\mathcal{D}}{=}f(V)$,…

Probability · Mathematics 2014-07-04 Jeffrey F. Collamore , Guoqing Diao , Anand N. Vidyashankar

A central object in the computational studies of rare events is the committor function. Though costly to compute, the committor function encodes complete mechanistic information of the processes involving rare events, including reaction…

Statistical Mechanics · Physics 2022-11-23 Muhammad R. Hasyim , Clay H. Batton , Kranthi K. Mandadapu

Adaptive multilevel splitting algorithms have been introduced rather recently for estimating tail distributions in a fast and efficient way. In particular, they can be used for computing the so-called reactive trajectories corresponding to…

Numerical Analysis · Mathematics 2014-12-25 Joran Rolland , Eric Simonnet

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

We propose a unified rare-event estimator for the performance evaluation of wireless communication systems. The estimator is derived from the well-known multilevel splitting algorithm. In its original form, the splitting algorithm cannot be…

Information Theory · Computer Science 2019-08-29 Nadhir Ben Rached , Daniel MacKinlay , Zdravko Botev , Raul Tempone , Mohamed-Slim Alouini

The choice of optimal event variables is crucial for achieving the maximal sensitivity of experimental analyses. Over time, physicists have derived suitable kinematic variables for many typical event topologies in collider physics. Here we…

High Energy Physics - Phenomenology · Physics 2021-05-24 Doojin Kim , Kyoungchul Kong , Konstantin T. Matchev , Myeonghun Park , Prasanth Shyamsundar

We propose a new method to define anomaly scores and apply this to particle physics collider events. Anomalies can be either rare, meaning that these events are a minority in the normal dataset, or different, meaning they have values that…

High Energy Physics - Phenomenology · Physics 2022-03-09 Sascha Caron , Luc Hendriks , Rob Verheyen

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Detecting rare events, those defined to give rise to high impact but have a low probability of occurring, is a challenge in a number of domains including meteorological, environmental, financial and economic. The use of machine learning to…

Applications · Statistics 2022-09-13 Santhosh Narayanan , Carsten Maple , Mark Hooper

We study the performance of a stochastic algorithm based on the power method that adaptively learns the large deviation functions characterizing the fluctuations of additive functionals of Markov processes, used in physics to model…

Statistical Mechanics · Physics 2023-03-30 Francesco Coghi , Hugo Touchette

Correlating events in complex and dynamic IoT environments is a challenging task not only because of the amount of available data that needs to be processed but also due to the call for time efficient data processing. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-30 Vassilis Papataxiarhis , Thomais Vassilopoulou , Sofia Kostakonti , Stathes Hadjiefthymiades

In this paper a method based on a Markov chain Monte Carlo (MCMC) algorithm is proposed to compute the probability of a rare event. The conditional distribution of the underlying process given that the rare event occurs has the probability…

Probability · Mathematics 2012-11-12 Thorbjörn Gudmundsson , Henrik Hult

Particle splitting methods are considered for the estimation of rare events. The probability of interest is that a Markov process first enters a set $B$ before another set $A$, and it is assumed that this probability satisfies a large…

Probability · Mathematics 2007-11-14 Thomas Dean , Paul Dupuis

The estimation of the probability of rare events is an important task in reliability and risk assessment. We consider failure events that are expressed in terms of a limit state function, which depends on the solution of a partial…

Numerical Analysis · Mathematics 2020-07-15 Fabian Wagner , Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

Motivated by techniques developed in recent progress on lower bounds for sublinear time algorithms (Behnezhad, Roghani and Rubinstein, STOC 2023, FOCS 2023, and STOC 2024) we introduce and study a new class of randomized algorithmic…

Data Structures and Algorithms · Computer Science 2026-03-19 Amir Azarmehr , Soheil Behnezhad , Alma Ghafari , Madhu Sudan

In this paper an original interacting particle system approach is developed for studying Markov chains in rare event regimes. The proposed particle system is theoretically studied through a genealogical tree interpretation of Feynman--Kac…

Probability · Mathematics 2007-05-23 Pierre Del Moral , Josselin Garnier

In this paper, we develop a computational approach for computing most likely trajectories describing rare events that correspond to the emergence of non-dominant genotypes. This work is based on the large deviations approach for discrete…

Populations and Evolution · Quantitative Biology 2023-08-29 Yingxue Su , Brett Geiger , Ilya Timofeyev , Andreas Mang , Robert Azencott

We analyse the splitting algorithm performance in the estimation of rare event probabilities and this in a discrete multidimensional framework. For this we assume that each threshold is partitioned into disjoint subsets and the probability…

Probability · Mathematics 2016-10-10 Agnès Lagnoux , Pascal Lezaud

For rare events described in terms of Markov processes, truly unbiased estimation of the rare event probability generally requires the avoidance of numerical approximations of the Markov process. Recent work in the exact and…

Statistics Theory · Mathematics 2021-11-08 James Hodgson , Adam M. Johansen , Murray Pollock

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile iterative method to estimate the probability of rare events, based on an interacting particle systems. In an other article, in a so-called idealized setting, the…

Probability · Mathematics 2019-10-21 Charles-Edouard Bréhier , Ludovic Goudenège , Loic Tudela