English
Related papers

Related papers: Optimal Monte Carlo Estimation of Belief Network I…

200 papers

Monte Carlo methods are widely used to estimate observables in many-body quantum systems. However, conventional sampling schemes often require a large number of samples to achieve sufficient accuracy. In this work we propose the…

Quantum Physics · Physics 2026-01-29 Wenxuan Zhang , Dingzu Wang , Dario Poletti

In many complex statistical models maximum likelihood estimators cannot be calculated. In the paper we solve this problem using Markov chain Monte Carlo approximation of the true likelihood. In the main result we prove asymptotic normality…

Statistics Theory · Mathematics 2018-08-09 Błażej Miasojedow , Wojciech Niemiro , Wojciech Rejchel

We propose a neural approach for estimating spatially varying light selection distributions to improve importance sampling in Monte Carlo rendering, particularly for complex scenes with many light sources. Our method uses a neural network…

Graphics · Computer Science 2025-05-20 Pedro Figueiredo , Qihao He , Steve Bako , Nima Khademi Kalantari

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo…

Numerical Analysis · Mathematics 2019-11-06 Jingrun Chen , Rui Du , Panchi Li , Liyao Lyu

Monte Carlo estimation in plays a crucial role in stochastic reaction networks. However, reducing the statistical uncertainty of the corresponding estimators requires sampling a large number of trajectories. We propose control variates…

Methodology · Statistics 2021-10-19 Michael Backenköhler , Luca Bortolussi , Verena Wolf

We present a sequential Monte Carlo sampler variant of the partial rejection control algorithm, and show that this variant can be considered as a sequential Monte Carlo sampler with a modified mutation kernel. We prove that the new sampler…

Computation · Statistics 2009-11-11 G. W. Peters , Y. Fan , S. A. Sisson

We develop an algorithm for sampling from the unitary invariant random matrix ensembles. The algorithm is based on the representation of their eigenvalues as a determinantal point process whose kernel is given in terms of orthogonal…

Mathematical Physics · Physics 2014-04-02 Sheehan Olver , Raj Rao Nadakuditi , Thomas Trogdon

We establish epigraphical and uniform laws of large numbers for sample-based approximations of law invariant risk functionals. These sample-based approximation schemes include Monte Carlo (MC) and certain randomized quasi-Monte Carlo…

Optimization and Control · Mathematics 2025-07-01 Olena Melnikov , Johannes Milz

A key limitation of sampling algorithms for approximate inference is that it is difficult to quantify their approximation error. Widely used sampling schemes, such as sequential importance sampling with resampling and Metropolis-Hastings,…

Artificial Intelligence · Computer Science 2017-05-09 Marco F. Cusumano-Towner , Vikash K. Mansinghka

We describe a Monte Carlo method to approximate the maximum likelihood estimate (MLE), when there are missing data and the observed data likelihood is not available in closed form. This method uses simulated missing data that are…

Statistics Theory · Mathematics 2007-08-22 Yun Ju Sung , Charles J. Geyer

Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from…

Machine Learning · Computer Science 2022-04-28 Zhaoyuan Yang , Arpit Jain

Standard Monte Carlo computation is widely known to exhibit a canonical square-root convergence speed in terms of sample size. Two recent techniques, one based on control variate and one on importance sampling, both derived from an…

Computation · Statistics 2023-03-13 Henry Lam , Haofeng Zhang

Latent Gaussian models have a rich history in statistics and machine learning, with applications ranging from factor analysis to compressed sensing to time series analysis. The classical method for maximizing the likelihood of these models…

Machine Learning · Computer Science 2023-06-07 Alexander Lin , Bahareh Tolooshams , Yves Atchadé , Demba Ba

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

Approximate Bayesian Computation (ABC) is a powerful method for carrying out Bayesian inference when the likelihood is computationally intractable. However, a drawback of ABC is that it is an approximate method that induces a systematic…

Methodology · Statistics 2015-09-29 Minh Ngoc Tran , Robert Kohn

Monte Carlo methods are widely used for approximating complicated, multidimensional integrals for Bayesian inference. Population Monte Carlo (PMC) is an important class of Monte Carlo methods, which utilizes a population of proposals to…

Methodology · Statistics 2022-08-30 Chaofan Huang , V. Roshan Joseph , Simon Mak

Model counting of Disjunctive Normal Form (DNF) formulas is a critical problem in applications such as probabilistic inference and network reliability. For example, it is often used for query evaluation in probabilistic databases. Due to…

Data Structures and Algorithms · Computer Science 2026-01-16 Paul Burkhardt , David G. Harris , Kevin T Schmitt

This paper addresses the problem of Monte Carlo approximation of posterior probability distributions. In particular, we have considered a recently proposed technique known as population Monte Carlo (PMC), which is based on an iterative…

Computation · Statistics 2016-06-03 Eugenia Koblents , Joaquín Míguez

We present powerful new analysis techniques to constrain effective field theories at the LHC. By leveraging the structure of particle physics processes, we extract extra information from Monte-Carlo simulations, which can be used to train…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez