English
Related papers

Related papers: When Machine Learning Meets Importance Sampling: A…

200 papers

Deep neuroevolution, that is evolutionary policy search methods based on deep neural networks, have recently emerged as a competitor to deep reinforcement learning algorithms due to their better parallelization capabilities. However, these…

Machine Learning · Computer Science 2018-08-20 Aloïs Pourchot , Nicolas Perrin , Olivier Sigaud

This paper describes a method for estimating the marginal likelihood or Bayes factors of Bayesian models using non-parametric importance sampling ("arrogance sampling"). This method can also be used to compute the normalizing constant of…

Computation · Statistics 2015-03-17 Benedict Escoto

Randomized protocols are procedures that incorporate probabilistic choices during their execution and they play a central role in quantum algorithms, spanning Hamiltonian simulation, noise mitigation, and measurement tasks. In practical…

Quantum Physics · Physics 2026-03-17 Davide Cugini , Touheed Anwar Atif , Yigit Subasi

A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…

Computation · Statistics 2013-10-15 Alexis Roche

In this paper we address the problem of rare-event simulation for heavy-tailed L\'evy processes with infinite activities. We propose a strongly efficient importance sampling algorithm that builds upon the sample path large deviations for…

Probability · Mathematics 2020-07-17 Xingyu Wang , Chang-Han Rhee

Rare properties remain a challenge for statistical model checking (SMC) due to the quadratic scaling of variance with rarity. We address this with a variance reduction framework based on lightweight importance splitting observers. These…

Logic in Computer Science · Computer Science 2015-04-29 Cyrille Jegourel , Axel Legay , Sean Sedwards , Louis-Marie Traonouez

Estimating the probability of failures or accidents with aerospace systems is often necessary when new concepts or designs are introduced, as it is being done for Autonomous Aircraft. If the design is safe, as it is supposed to be, accident…

Applications · Statistics 2018-08-10 Ítalo Romani de Oliveira , Jeffery Musiak

We consider the problem of estimating an expected outcome from a stochastic simulation model. Our goal is to develop a theoretical framework on importance sampling for such estimation. By investigating the variance of an importance sampling…

Methodology · Statistics 2019-09-27 Yen-Chi Chen , Youngjun Choe

We describe a new approach to the rare-event Monte Carlo sampling problem. This technique utilizes a symmetrization strategy to create probability distributions that are more highly connected and thus more easily sampled than their…

Statistical Mechanics · Physics 2015-05-28 Nuria Plattner , J. D. Doll , Paul Dupuis , Hui Wang , Yufei Liu , J. E. Gubernatis

This article reviews the concepts and methods of variational path sampling. These methods allow computational studies of rare events in systems driven arbitrarily far from equilibrium. Based upon a statistical mechanics of trajectory space…

Chemical Physics · Physics 2025-02-05 Aditya N. Singh , Avishek Das , David T. Limmer

Importance sampling is a central idea underlying off-policy prediction in reinforcement learning. It provides a strategy for re-weighting samples from a distribution to obtain unbiased estimates under another distribution. However,…

Machine Learning · Computer Science 2023-06-28 Kristopher De Asis , Eric Graves , Richard S. Sutton

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

The paper introduces AND/OR importance sampling for probabilistic graphical models. In contrast to importance sampling, AND/OR importance sampling caches samples in the AND/OR space and then extracts a new sample mean from the stored…

Artificial Intelligence · Computer Science 2012-06-18 Vibhav Gogate , Rina Dechter

Sampling random nodes is a fundamental algorithmic primitive in the analysis of massive networks, with many modern graph mining algorithms critically relying on it. We consider the task of generating a large collection of random nodes in…

Social and Information Networks · Computer Science 2021-10-27 Omri Ben-Eliezer , Talya Eden , Joel Oren , Dimitris Fotakis

Autoregressive models (ARMs) currently hold state-of-the-art performance in likelihood-based modeling of image and audio data. Generally, neural network based ARMs are designed to allow fast inference, but sampling from these models is…

Machine Learning · Computer Science 2020-07-09 Auke Wiggers , Emiel Hoogeboom

We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq \gamma)$, via importance sampling (IS). We…

Computation · Statistics 2021-10-04 Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Gerardo Rubino , Raul Tempone

Importance weighting is a fundamental procedure in statistics and machine learning that weights the objective function or probability distribution based on the importance of the instance in some sense. The simplicity and usefulness of the…

Machine Learning · Computer Science 2024-05-15 Masanari Kimura , Hideitsu Hino

We consider a linear stochastic fluid network under Markov modulation, with a focus on the probability that the joint storage level attains a value in a rare set at a given point in time. The main objective is to develop efficient…

Probability · Mathematics 2018-05-09 Onno Boxma , Ewan Cahen , David Koops , Michel Mandjes

The sampling importance resampling method is widely utilized in various fields, such as numerical integration and statistical simulation. In this paper, two modified methods are presented by incorporating two variance reduction techniques…

Computation · Statistics 2024-08-28 Yao Xiao , Kang Fu , Kun Li

Generalising well in supervised learning tasks relies on correctly extrapolating the training data to a large region of the input space. One way to achieve this is to constrain the predictions to be invariant to transformations on the input…

Machine Learning · Computer Science 2018-08-17 Mark van der Wilk , Matthias Bauer , ST John , James Hensman