English
Related papers

Related papers: Efficient Rare Event Sampling with Unsupervised No…

200 papers

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

Annealed Importance Sampling (AIS) and its Sequential Monte Carlo (SMC) extensions are state-of-the-art methods for estimating normalizing constants of probability distributions. We propose here a novel Monte Carlo algorithm, Annealed Flow…

Machine Learning · Statistics 2021-07-12 Michael Arbel , Alexander G. D. G. Matthews , Arnaud Doucet

We present a new Monte Carlo algorithm that produces results of high accuracy with reduced simulational effort. Independent random walks are performed (concurrently or serially) in different, restricted ranges of energy, and the resultant…

Statistical Mechanics · Physics 2009-10-31 Fugao Wang , D. P. Landau

Previously, using forward-flux sampling (FFS) and machine learning (ML), we developed multivariate alarm systems to counter rare un-postulated abnormal events. Our alarm systems utilized ML-based predictive models to quantify committer…

Machine Learning · Computer Science 2024-09-04 Vikram Sudarshan , Warren D. Seider

Accounting for inaccuracies in Monte Carlo simulations is a crucial step in any high energy physics analysis. It becomes especially important when training machine learning models, which can amplify simulation inaccuracies and introduce…

High Energy Physics - Phenomenology · Physics 2023-09-29 Samuel Bright-Thonney , Philip Harris , Patrick McCormack , Simon Rothman

This work presents mixed variational flows (MixFlows), a new variational family that consists of a mixture of repeated applications of a map to an initial reference distribution. First, we provide efficient algorithms for i.i.d. sampling,…

Machine Learning · Statistics 2025-06-03 Zuheng Xu , Naitong Chen , Trevor Campbell

Inverse medium scattering solvers generally reconstruct a single solution without an associated measure of uncertainty. This is true both for the classical iterative solvers and for the emerging deep learning methods. But ill-posedness and…

Machine Learning · Computer Science 2022-12-12 AmirEhsan Khorashadizadeh , Ali Aghababaei , Tin Vlašić , Hieu Nguyen , Ivan Dokmanić

The idea of rare event sampling is applied to the estimation of the performance of error-correcting codes. The essence of the idea is importance sampling of the pattern of noises in the channel by Multicanonical Monte Carlo, which enables…

Disordered Systems and Neural Networks · Physics 2009-11-13 Yukito Iba , Koji Hukushima

In this work we propose a one-class self-supervised method for anomaly segmentation in images that benefits both from a modern machine learning approach and a more classic statistical detection theory. The method consists of four phases.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Matías Tailanian , Álvaro Pardo , Pablo Musé

Although many deep-learning-based super-resolution approaches have been proposed in recent years, because no ground truth is available in the inference stage, few can quantify the errors and uncertainties of the super-resolved results. For…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Jingyi Shen , Han-Wei Shen

We develop importance sampling based efficient simulation techniques for three commonly encountered rare event probabilities associated with random walks having i.i.d. regularly varying increments; namely, 1) the large deviation…

Probability · Mathematics 2014-09-30 Karthyek R. A. Murthy , Sandeep Juneja , Jose Blanchet

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

Machine Learning · Computer Science 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

Controlling generative models is computationally expensive. This is because optimal alignment with a reward function--whether via inference-time steering or fine-tuning--requires estimating the value function. This task demands access to…

Machine Learning · Statistics 2026-01-22 Peter Potaptchik , Adhi Saravanan , Abbas Mammadov , Alvaro Prat , Michael S. Albergo , Yee Whye Teh

Complex heterogeneous dynamic networks like knowledge graphs are powerful constructs that can be used in modeling data provenance from computer systems. From a security perspective, these attributed graphs enable causality analysis and…

Cryptography and Security · Computer Science 2022-03-08 Maya Kapoor , Joshua Melton , Michael Ridenhour , Mahalavanya Sriram , Thomas Moyer , Siddharth Krishnan

Estimating the probability of rare channel conditions is a central challenge in ultra-reliable wireless communication, where random events, such as deep fades, can cause sudden variations in the channel quality. This paper proposes a…

Signal Processing · Electrical Eng. & Systems 2024-07-08 Tobias Kallehauge , Anders E. Kalør , Pablo Ramírez-Espinosa , Christophe Biscio , Petar Popovski

Energy-Based Models (EBMs) allow for extremely flexible specifications of probability distributions. However, they do not provide a mechanism for obtaining exact samples from these distributions. Monte Carlo techniques can aid us in…

Machine Learning · Computer Science 2021-12-13 Bryan Eikema , Germán Kruszewski , Hady Elsahar , Marc Dymetman

We apply for the first time the Flow Matching method to the problem of phase-space sampling for event generation in high-energy collider physics. By training the model to remap the random numbers used to generate the momenta and helicities…

High Energy Physics - Phenomenology · Physics 2025-06-25 Enrico Bothmann , Timo Janßen , Max Knobbe , Bernhard Schmitzer , Fabian Sinz

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we…

Machine Learning · Computer Science 2025-10-23 Zijing Ou , Ruixiang Zhang , Yingzhen Li

Analyzing and interpreting time-dependent stochastic data requires accurate and robust density estimation. In this paper we extend the concept of normalizing flows to so-called temporal Normalizing Flows (tNFs) to estimate time dependent…

Computational Physics · Physics 2019-12-20 Gert-Jan Both , Remy Kusters

Rare events in molecular dynamics are often related to noise-induced transitions between different macroscopic states (e.g., in protein folding). A common feature of these rare transitions is that they happen on timescales that are on…

Probability · Mathematics 2026-01-06 Carsten Hartmann , Annika Jöster , Christof Schütte , Alexander Sikorski , Marcus Weber