English
Related papers

Related papers: Monte Carlo Anti-Differentiation for Approximate W…

200 papers

The paper studies several approaches to numerical integration over a domain defined implicitly by an indicator function such as the level set function. The integration methods are based on subdivision, moment--fitting, local…

Numerical Analysis · Mathematics 2016-01-26 Maxim Olshanskii , Danil Safin

Nested integration of the form $\int f\left(\int g(\bs{y},\bs{x})\di{}\bs{x}\right)\di{}\bs{y}$, characterized by an outer integral connected to an inner integral through a nonlinear function $f$, is a challenging problem in various fields,…

Numerical Analysis · Mathematics 2026-05-19 Arved Bartuska , André Gustavo Carlon , Luis Espath , Sebastian Krumscheid , Raúl Tempone

Along with Markov chain Monte Carlo (MCMC) methods, variational inference (VI) has emerged as a central computational approach to large-scale Bayesian inference. Rather than sampling from the true posterior $\pi$, VI aims at producing a…

Machine Learning · Statistics 2023-04-24 Marc Lambert , Sinho Chewi , Francis Bach , Silvère Bonnabel , Philippe Rigollet

Multi-sample, importance-weighted variational autoencoders (IWAE) give tighter bounds and more accurate uncertainty estimates than variational autoencoders (VAE) trained with a standard single-sample objective. However, IWAEs scale poorly:…

Machine Learning · Statistics 2019-01-18 Laurence Aitchison

In this paper we discuss the possibility of using multilevel Monte Carlo (MLMC) methods for weak approximation schemes. It turns out that by means of a simple coupling between consecutive time discretisation levels, one can achieve the same…

Computational Finance · Quantitative Finance 2014-10-07 Denis Belomestny , Tigran Nagapetyan

When solving stochastic partial differential equations (SPDEs) driven by additive spatial white noise, the efficient sampling of white noise realizations can be challenging. Here, we present a new sampling technique that can be used to…

Numerical Analysis · Mathematics 2023-01-10 Matteo Croci , Michael B. Giles , Marie E. Rognes , Patrick E. Farrell

A variety of lifted inference algorithms, which exploit model symmetry to reduce computational cost, have been proposed to render inference tractable in probabilistic relational models. Most existing lifted inference algorithms operate only…

Machine Learning · Computer Science 2020-02-11 Yuqiao Chen , Yibo Yang , Sriraam Natarajan , Nicholas Ruozzi

Owing to their favorable scaling with dimensionality, Monte Carlo (MC) methods have become the tool of choice for numerical integration across the quantitative sciences. Almost invariably, efficient MC integration schemes are strictly…

Statistical Mechanics · Physics 2010-01-29 Artur B. Adib

One of the open challenges in quantum computing is to find meaningful and practical methods to leverage quantum computation to accelerate classical machine learning workflows. A ubiquitous problem in machine learning workflows is sampling…

Quantum Physics · Physics 2024-08-08 Owen Lockwood , Peter Weiss , Filip Aronshtein , Guillaume Verdon

Monte Carlo methods are widely used for approximating complicated, multidimensional integrals for Bayesian inference. Population Monte Carlo (PMC) is an important class of Monte Carlo methods, which utilizes a population of proposals to…

Methodology · Statistics 2022-08-30 Chaofan Huang , V. Roshan Joseph , Simon Mak

The vast majority of 21st century AI workloads are based on gradient-based deterministic algorithms such as backpropagation. One of the key reasons for the dominance of deterministic ML algorithms is the emergence of powerful hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-19 Tathagata Srimani , Robert Radway , Masoud Mohseni , Kerem Çamsarı , Subhasish Mitra

Variational Inference (VI) is a method that approximates a difficult-to-compute posterior density using better behaved distributional families. VI is an alternative to the already well-studied Markov chain Monte Carlo (MCMC) method of…

Computation · Statistics 2022-03-25 Neil Dey , Emmett B. Kendall

By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One…

Optimization and Control · Mathematics 2021-11-25 Valentin Durante , George Katsirelos , Thomas Schiex

When working with multimodal Bayesian posterior distributions, Markov chain Monte Carlo (MCMC) algorithms have difficulty moving between modes, and default variational or mode-based approximate inferences will understate posterior…

Methodology · Statistics 2021-11-19 Yuling Yao , Aki Vehtari , Andrew Gelman

We present a hybrid method for time-dependent particle transport that combines Monte Carlo (MC) estimation with a deterministic discrete ordinates (\(S_N\)) solve, augmented by quasi-Monte Carlo (QMC) sampling. For spatial discretizations,…

Numerical Analysis · Mathematics 2025-11-24 Johannes Krotz , Ryan G. McClarren

The discrete nature of transmitted symbols poses challenges for achieving optimal detection in multiple-input multiple-output (MIMO) systems associated with a large number of antennas. Recently, the combination of two powerful machine…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Xingyu Zhou , Le Liang , Jing Zhang , Chao-Kai Wen , Shi Jin

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

We discuss the statistical analysis method for the worldvolume hybrid Monte Carlo (WV-HMC) algorithm [arXiv:2012.08468], which was recently introduced to substantially reduce the computational cost of the tempered Lefschetz thimble method.…

High Energy Physics - Lattice · Physics 2021-07-16 Masafumi Fukuma , Nobuyuki Matsumoto , Yusuke Namekawa

Extreme Multi-label Classification (XMC) methods predict relevant labels for a given query in an extremely large label space. Recent works in XMC address this problem using deep encoders that project text descriptions to an embedding space…

Machine Learning · Computer Science 2024-10-29 Kunal Dahiya , Diego Ortego , David Jiménez

Inference after model selection presents computational challenges when dealing with intractable conditional distributions. Markov chain Monte Carlo (MCMC) is a common method for sampling from these distributions, but its slow convergence…

Methodology · Statistics 2023-08-22 Sifan Liu