English
Related papers

Related papers: Exhaustive Neural Importance Sampling applied to M…

200 papers

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

Among Monte Carlo techniques, the importance sampling requires fine tuning of a proposal distribution, which is now fluently resolved through iterative schemes. The Adaptive Multiple Importance Sampling (AMIS) of Cornuet et al. (2012)…

Computation · Statistics 2014-05-27 Jean-Michel Marin , Pierre Pudlo , Mohammed Sedki

Speculative Decoding is a prominent technique for accelerating the autoregressive inference of large language models (LLMs) by employing a fast draft model to propose candidate token sequences and a large target model to verify them in…

Computation and Language · Computer Science 2025-12-18 Chendong Sun , Ali Mao , Lei Xu , mingmin Chen

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

Importance sampling (IS) is a technique that enables statistical estimation of output performance at multiple input distributions from a single nominal input distribution. IS is commonly used in Monte Carlo simulation for variance reduction…

Methodology · Statistics 2025-05-07 Yijuan Liang , Guangxin Jiang , Michael C. Fu

We describe a simple Importance Sampling strategy for Monte Carlo simulations based on a least squares optimization procedure. With several numerical examples, we show that such Least Squares Importance Sampling (LSIS) provides efficiency…

Physics and Society · Physics 2008-12-10 Luca Capriotti

Monte Carlo event generators are an essential tool for data analysis in collider physics. To include subleading quantum corrections, these generators often need to produce negative weight events, which leads to statistical dilution of the…

High Energy Physics - Phenomenology · Physics 2020-10-21 Benjamin Nachman , Jesse Thaler

The presence of erratic or unstable paths in standard kinetic Monte Carlo simulations significantly undermines the accurate simulation and sampling of transition pathways. While typically reliable methods, such as the Gillespie algorithm,…

Statistical Mechanics · Physics 2024-12-03 Elad Korngut , Ohad Vilk , Michael Assaf

Importance sampling is a Monte Carlo method that introduces a proposal distribution to sample the space according to the target distribution. Yet calibration of the proposal distribution is essential to achieving efficiency, thus the resort…

Computation · Statistics 2022-06-17 Grégoire Aufort , Pierre Pudlo , Denis Burgarella

Importance sampling is one of the most widely used variance reduction strategies in Monte Carlo rendering. In this paper, we propose a novel importance sampling technique that uses a neural network to learn how to sample from a desired…

Machine Learning · Computer Science 2024-03-25 Quan Zheng , Matthias Zwicker

Monte Carlo methods are widely used in particle physics to integrate and sample probability distributions (differential cross sections or decay rates) on multi-dimensional phase spaces. We present a Neural Network (NN) algorithm optimized…

High Energy Physics - Phenomenology · Physics 2020-10-21 Matthew D. Klimek , Maxim Perelstein

Sampling from unnormalized densities presents a fundamental challenge with wide-ranging applications, from posterior inference to molecular dynamics simulations. Continuous flow-based neural samplers offer a promising approach, learning a…

Machine Learning · Computer Science 2025-07-22 Wuhao Chen , Zijing Ou , Yingzhen Li

From Physics and Biology to Seismology and Economics, the behaviour of countless systems is determined by impactful yet unlikely transitions between metastable states known as \emph{rare events}, the study of which is essential for…

Computational Physics · Physics 2025-07-22 Solomon Asghar , Qing-Xiang Pei , Giorgio Volpe , Ran Ni

We consider the problem of estimating rare event probabilities, focusing on systems whose evolution is governed by differential equations with uncertain input parameters. If the system dynamics is expensive to compute, standard sampling…

Computation · Statistics 2019-11-05 Siddhant Wahal , George Biros

In Bayesian statistical inference and computationally intensive frequentist inference, one is interested in obtaining samples from a high dimensional, and possibly multi-modal target density. The challenge is to obtain samples from this…

Statistics Theory · Mathematics 2007-06-13 Raazesh Sainudiin , Thomas L. York

Atomistic simulations provide valuable insights into the physical processes governing material behavior. However, their applicability is fundamentally constrained by the limited time scales accessible to brute-force simulations. This…

Computational Physics · Physics 2026-02-16 Michael Kim , Wei Cai

Estimating the probability that a sum of random variables (RVs) exceeds a given threshold is a well-known challenging problem. Closed-form expression of the sum distribution is usually intractable and presents an open problem. A crude Monte…

Information Theory · Computer Science 2014-09-23 Nadhir Ben Rached , Fatma Benkhelifa , Abla Kammoun , Mohamed-Slim Alouini , Raul Tempone

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

Many Monte Carlo (MC) and importance sampling (IS) methods use mixture models (MMs) for their simplicity and ability to capture multimodal distributions. Recently, subtractive mixture models (SMMs), i.e. MMs with negative coefficients, have…

Machine Learning · Computer Science 2025-03-28 Lena Zellinger , Nicola Branchini , Víctor Elvira , Antonio Vergari

In this work, we develop an importance sampling estimator by coupling the reduced-order model and the generative model in a problem setting of uncertainty quantification. The target is to estimate the probability that the quantity of…

Machine Learning · Statistics 2024-12-20 Xiaoliang Wan , Shuangqing Wei