English
Related papers

Related papers: Optimal Monte Carlo Estimation of Belief Network I…

200 papers

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

Methodology · Statistics 2018-05-07 Jeremie Houssineau , Branko Ristic

We study a neural network framework for the numerical evaluation of Feynman loop integrals that are fundamental building blocks for perturbative computations of physical observables in gauge and gravity theories. We show that such a machine…

High Energy Physics - Theory · Physics 2023-12-12 Ryusuke Jinno , Gregor Kälin , Zhengwen Liu , Henrique Rubira

As the vocabulary size of modern word-based language models becomes ever larger, many sampling-based training criteria are proposed and investigated. The essence of these sampling methods is that the softmax-related traversal over the…

Computation and Language · Computer Science 2021-06-18 Yingbo Gao , David Thulke , Alexander Gerstenberger , Khoa Viet Tran , Ralf Schlüter , Hermann Ney

Recent advances in machine learning have led to the development of new methods for enhancing Monte Carlo methods such as Markov chain Monte Carlo (MCMC) and importance sampling (IS). One such method is normalizing flows, which use a neural…

Computation · Statistics 2024-01-12 Charly Andral

We propose, theoretically investigate, and numerically validate an algorithm for the Monte Carlo solution of least-squares polynomial approximation problems in a collocation frame- work. Our method is motivated by generalized Polynomial…

Numerical Analysis · Mathematics 2021-05-04 Akil Narayan , John D. Jakeman , Tao Zhou

Computing systems interacting with real-world processes must safely and reliably process uncertain data. The Monte Carlo method is a popular approach for computing with such uncertain values. This article introduces a framework for…

Taking into account future risk is essential for an autonomously operating robot to find online not only the best but also a safe action to execute. In this paper, we build upon the recently introduced formulation of probabilistic…

Artificial Intelligence · Computer Science 2024-11-12 Andrey Zhitnikov , Vadim Indelman

In recent years, many Machine Learning (ML) explanation techniques have been designed using ideas from cooperative game theory. These game-theoretic explainers suffer from high complexity, hindering their exact computation in practical…

Machine Learning · Computer Science 2024-04-22 Konstandinos Kotsiopoulos , Alexey Miroshnikov , Khashayar Filom , Arjun Ravi Kannan

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least squares estimate in linear regression, where…

Computation · Statistics 2019-06-27 HaiYing Wang , Rong Zhu , Ping Ma

We propose a multi-fidelity neural network surrogate sampling method for the uncertainty quantification of physical/biological systems described by ordinary or partial differential equations. We first generate a set of low/high-fidelity…

Numerical Analysis · Mathematics 2020-05-07 Mohammad Motamed

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

We investigate in this paper an alternative method to simulation based recursive importance sampling procedure to estimate the optimal change of measure for Monte Carlo simulations. We propose an algorithm which combines (vector and…

Probability · Mathematics 2011-09-20 Noufel Frikha , Abass Sagna

This article reviews the application of advanced Monte Carlo techniques in the context of Multilevel Monte Carlo (MLMC). MLMC is a strategy employed to compute expectations which can be biased in some sense, for instance, by using the…

Computation · Statistics 2017-04-25 Ajay Jasra , Kody Law , Carina Suciu

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

In this article, we discuss the optimal allocation problem in an experiment when a regression model is used for statistical analysis. Monotonic convergence for a general class of multiplicative algorithms for $D$-optimality has been…

Computation · Statistics 2013-10-28 Wei Gao , Ping Shing Chan , Hon Keung Tony Ng , Xiaolei Lu

Improving efficiency of importance sampler is at the center of research in Monte Carlo methods. While adaptive approach is usually difficult within the Markov Chain Monte Carlo framework, the counterpart in importance sampling can be…

Methodology · Statistics 2007-12-11 Heng Lian

We study the problem of reducing the variance of Monte Carlo estimators through performing suitable changes of the sampling measure which are induced by feedforward neural networks. To this end, building on the concept of vector stochastic…

Computational Finance · Quantitative Finance 2023-06-05 Aleksandar Arandjelović , Thorsten Rheinländer , Pavel V. Shevchenko

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

We describe Monte Carlo methods for estimating lower envelopes of expectations of real random variables. We prove that the estimation bias is negative and that its absolute value shrinks with increasing sample size. We discuss fairly…

Probability · Mathematics 2019-09-02 Arne Decadt , Gert de Cooman , Jasper De Bock