English
Related papers

Related papers: Monte Carlo Anti-Differentiation for Approximate W…

200 papers

We study the discriminative probabilistic modeling on a continuous domain for the data prediction task of (multimodal) self-supervised representation learning. To address the challenge of computing the integral in the partition function for…

Machine Learning · Computer Science 2025-03-06 Bokun Wang , Yunwen Lei , Yiming Ying , Tianbao Yang

In machine learning (ML) verification, the majority of procedures are non-quantitative and therefore cannot be used for verifying probabilistic models, or be applied in domains where hard guarantees are practically unachievable. The…

Artificial Intelligence · Computer Science 2024-10-24 Paolo Morettin , Andrea Passerini , Roberto Sebastiani

Hierarchical models represent a challenging setting for inference algorithms. MCMC methods struggle to scale to large models with many local variables and observations, and variational inference (VI) may fail to provide accurate…

Machine Learning · Computer Science 2022-07-27 Tomas Geffner , Justin Domke

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

Methodology · Statistics 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

Approximate inference in probabilistic graphical models (PGMs) can be grouped into deterministic methods and Monte-Carlo-based methods. The former can often provide accurate and rapid inferences, but are typically associated with biases…

Machine Learning · Statistics 2019-01-09 Fredrik Lindsten , Jouni Helske , Matti Vihola

Statistical inference methods are fundamentally important in machine learning. Most state-of-the-art inference algorithms are variants of Markov chain Monte Carlo (MCMC) or variational inference (VI). However, both methods struggle with…

Machine Learning · Computer Science 2019-10-17 Yichuan Zhang , José Miguel Hernández-Lobato

For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, Monte Carlo simulations…

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

We propose a methodology for computing single and multi-asset European option prices, and more generally expectations of scalar functions of (multivariate) random variables. This new approach combines the ability of Monte Carlo simulation…

Computational Finance · Quantitative Finance 2019-10-21 Damir Filipović , Kathrin Glau , Yuji Nakatsukasa , Francesco Statti

We study statistical model checking of continuous-time stochastic hybrid systems. The challenge in applying statistical model checking to these systems is that one cannot simulate such systems exactly. We employ the multilevel Monte Carlo…

Systems and Control · Computer Science 2017-06-27 Sadegh Esmaeil Zadeh Soudjani , Rupak Majumdar , Tigran Nagapetyan

Weighted model counting (WMC) is a well-known inference task on knowledge bases, used for probabilistic inference in graphical models. We introduce algebraic model counting (AMC), a generalization of WMC to a semiring structure. We show…

Logic in Computer Science · Computer Science 2012-11-20 Angelika Kimmig , Guy Van den Broeck , Luc De Raedt

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

Differentiable programming has emerged as a key programming paradigm empowering rapid developments of deep learning while its applications to important computational methods such as Monte Carlo remain largely unexplored. Here we present the…

Computational Physics · Physics 2023-08-28 Shi-Xin Zhang , Zhou-Quan Wan , Hong Yao

Many generative models can be expressed as a differentiable function of random inputs drawn from some simple probability density. This framework includes both deep generative architectures such as Variational Autoencoders and a large class…

Computation · Statistics 2017-03-06 Matthew M. Graham , Amos J. Storkey

We discuss algorithms for domain wall fermions focussing on accelerating Hybrid Monte Carlo sampling of gauge configurations. Firstly a new multigrid algorithm for domain wall solvers and secondly a domain decomposed hybrid monte carlo…

High Energy Physics - Lattice · Physics 2022-04-01 Peter A Boyle , Dennis Bollweg , Christopher Kelly , Azusa Yamaguchi

Weighted model counting (WMC) consists of computing the weighted sum of all satisfying assignments of a propositional formula. WMC is well-known to be #P-hard for exact solving, but admits a fully polynomial randomized approximation scheme…

Artificial Intelligence · Computer Science 2020-07-14 Ralph Abboud , İsmail İlkan Ceylan , Radoslav Dimitrov

Several disciplines, such as econometrics, neuroscience, and computational psychology, study the dynamic interactions between variables over time. A Bayesian nonparametric model known as the Wishart process has been shown to be effective in…

Methodology · Statistics 2024-06-10 Hester Huijsdens , David Leeftink , Linda Geerligs , Max Hinne

Quasi-Monte Carlo (QMC) methods for estimating integrals are attractive since the resulting estimators typically converge at a faster rate than pseudo-random Monte Carlo. However, they can be difficult to set up on arbitrary posterior…

Statistics Theory · Mathematics 2018-10-03 Tobias Schwedes , Ben Calderhead

Many Bayesian inference problems require exploring the posterior distribution of high-dimensional parameters that represent the discretization of an underlying function. This work introduces a family of Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2016-05-03 Tiangang Cui , Kody J. H. Law , Youssef M. Marzouk

Nested integration problems arise in various scientific and engineering applications, including Bayesian experimental design, financial risk assessment, and uncertainty quantification. These nested integrals take the form $\int f\left(\int…

Numerical Analysis · Mathematics 2025-06-17 Arved Bartuska , André Gustavo Carlon , Luis Espath , Sebastian Krumscheid , Raúl Tempone