English
Related papers

Related papers: Splitting for Rare Event Simulation: A Large Devia…

200 papers

This overview is devoted to splitting methods, a class of numerical integrators intended for differential equations that can be subdivided into different problems easier to solve than the original system. Closely connected with this class…

Numerical Analysis · Mathematics 2024-05-08 Sergio Blanes , Fernando Casas , Ander Murua

In this paper, we propose a class of efficient, accurate, and general methods for solving state-estimation problems with equality and inequality constraints. The methods are based on recent developments in variable splitting and partially…

Optimization and Control · Mathematics 2020-12-02 Rui Gao , Filip Tronarp , Simo Särkkä

In this work we propose an adaptive multilevel version of subset simulation to estimate the probability of rare events for complex physical systems. Given a sequence of nested failure domains of increasing size, the rare event probability…

Numerical Analysis · Mathematics 2023-12-13 Daniel Elfverson , Robert Scheichl , Simon Weissmann , F. Alejandro DiazDelaO

In this paper, we consider an importance sampling problem for a certain rare-event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the…

Optimization and Control · Mathematics 2020-08-26 Getachew K. Befekadu

We consider a standard splitting algorithm for the rare-event simulation of overflow probabilities in any subset of stations in a Jackson network at level n, starting at a fixed initial position. It was shown in DeanDup09 that a subsolution…

Probability · Mathematics 2010-07-29 Jose Blanchet , Kevin Leder , Yixi Shi

The estimation of the probability of rare events is an important task in reliability and risk assessment. We consider failure events that are expressed in terms of a limit state function, which depends on the solution of a partial…

Numerical Analysis · Mathematics 2020-07-15 Fabian Wagner , Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

Splitting probabilities quantify the likelihood of particular outcomes out of a set of mutually-exclusive possibilities for stochastic processes and play a central role in first-passage problems. For two-dimensional Markov processes…

Mathematical Physics · Physics 2025-08-12 Emir Sezik , Jacob Knight , Henry Alston , Connor Roberts , Thibault Bertrand , Gunnar Pruessner , Luca Cocconi

Partitioning a set of elements into an unknown number of mutually exclusive subsets is essential in many machine learning problems. However, assigning elements, such as samples in a dataset or neurons in a network layer, to an unknown and…

Machine Learning · Computer Science 2023-11-10 Thomas M. Sutter , Alain Ryser , Joram Liebeskind , Julia E. Vogt

In this work, we consider the numerical estimation of the probability for a stochastic process to hit a set B before reaching another set A. This event is assumed to be rare. We consider reactive trajectories of the stochastic Allen-Cahn…

Analysis of PDEs · Mathematics 2019-10-21 Charles-Edouard Bréhier , Maxime Gazeau , Ludovic Goudenège , Mathias Rousset

Even though a train/test split of the dataset randomly performed is a common practice, could not always be the best approach for estimating performance generalization under some scenarios. The fact is that the usual machine learning…

Machine Learning · Computer Science 2022-09-09 Carlos Catania , Jorge Guerra , Juan Manuel Romero , Gabriel Caffaratti , Martin Marchetta

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Sparse inversion and classification problems are ubiquitous in modern data science and imaging. They are often formulated as non-smooth minimisation problems. In sparse inversion, we minimise, e.g., the sum of a data fidelity term and an…

Numerical Analysis · Mathematics 2022-11-23 Jonas Latz

Diffusion processes with small noise conditioned to reach a target set are considered. The AMS algorithm is a Monte Carlo method that is used to sample such rare events by iteratively simulating clones of the process and selecting…

Numerical Analysis · Mathematics 2022-12-12 Frédéric Cérou , Sofiane Martel , Mathias Rousset

An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and…

Statistical Mechanics · Physics 2019-07-24 Tobias Grafke , Eric Vanden-Eijnden

We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design…

Optimization and Control · Mathematics 2019-02-22 Amarjit Budhiraja , Shu Lu , Yang Yu , Quoc Tran-Dinh

We formulate the statistics of the discrete multicomponent fragmentation event using a methodology borrowed from statistical mechanics. We generate the ensemble of all feasible distributions that can be formed when a single integer…

Statistical Mechanics · Physics 2020-07-03 Themis Matsoukas

This paper is about how to partition decision variables while decomposing a large-scale optimization problem for the best performance of distributed solution methods. Solving a large-scale optimization problem sequen- tially can be…

Optimization and Control · Mathematics 2017-10-26 Yuchen Zheng , Ilbin Lee , Nicoleta Serban

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

By their very nature, rare event probabilities are expensive to compute; they are also delicate to estimate as their value strongly depends on distributional assumptions on the model parameters. Hence, understanding the sensitivity of the…

Numerical Analysis · Mathematics 2021-10-28 Michael Merritt , Alen Alexanderian , Pierre Gremaud