English
Related papers

Related papers: Higher order Quasi-Monte Carlo integration for Bay…

200 papers

In this paper we give explicit constructions of point sets in the $s$ dimensional unit cube yielding quasi-Monte Carlo algorithms which achieve the optimal rate of convergence of the worst-case error for numerically integrating high…

Numerical Analysis · Mathematics 2013-04-02 Josef Dick

We study Bayesian methods for large-scale linear inverse problems, focusing on the challenging task of hyperparameter estimation. Typical hierarchical Bayesian formulations that follow a Markov Chain Monte Carlo approach are possible for…

Numerical Analysis · Mathematics 2024-01-05 Khalil A Hall-Hooper , Arvind K Saibaba , Julianne Chung , Scot M Miller

This paper is concerned with the numerical solution of model-based, Bayesian inverse problems. We are particularly interested in cases where the cost of each likelihood evaluation (forward-model call) is expensive and the number of un-…

Computation · Statistics 2016-07-25 Isabell M. Franck , P. S. Koutsourelakis

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

We establish the geometric ergodicity of the preconditioned Hamiltonian Monte Carlo (HMC) algorithm defined on an infinite-dimensional Hilbert space, as developed in [Beskos et al., Stochastic Process. Appl., 2011]. This algorithm can be…

Statistics Theory · Mathematics 2020-03-19 Nathan E. Glatt-Holtz , Cecilia F. Mondaini

Importance Sampling (IS), an effective variance reduction strategy in Monte Carlo (MC) simulation, is frequently utilized for Bayesian inference and other statistical challenges. Quasi-Monte Carlo (QMC) replaces the random samples in MC…

Numerical Analysis · Mathematics 2024-03-19 Zhijian He , Hejin Wang , Xiaoqun Wang

Integration over non-negative integrands is a central problem in machine learning (e.g. for model averaging, (hyper-)parameter marginalisation, and computing posterior predictive distributions). Bayesian Quadrature is a probabilistic…

Machine Learning · Statistics 2018-12-05 Ed Wagstaff , Saad Hamid , Michael Osborne

We study numerical integration over bounded regions in $\mathbb{R}^s, s\ge1$ with respect to some probability measure. We replace random sampling with quasi-Monte Carlo methods, where the underlying point set is derived from deterministic…

Numerical Analysis · Mathematics 2023-05-01 Tiangang Cui , Josef Dick , Friedrich Pillichshammer

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

The classical approaches to numerically integrating a function $f$ are Monte Carlo (MC) and quasi-Monte Carlo (QMC) methods. MC methods use random samples to evaluate $f$ and have error $O(\sigma(f)/\sqrt{n})$, where $\sigma(f)$ is the…

Data Structures and Algorithms · Computer Science 2024-08-14 Nikhil Bansal , Haotian Jiang

In this paper, we develop a comprehensive weighted theory for a class of Banach-valued multilinear bounded oscillation operators on measure spaces, which merges multilinear Calder\'{o}n-Zygmund operators with a quantity of operators beyond…

Classical Analysis and ODEs · Mathematics 2024-03-26 Mingming Cao , Gonzalo Ibañez-Firnkorn , Israel P. Rivera-Ríos , Qingying Xue , Kôzô Yabuta

We propose two new Bayesian smoothing methods for general state-space models with unknown parameters. The first approach is based on the particle learning and smoothing algorithm, but with an adjustment in the backward resampling weights.…

Computation · Statistics 2016-04-20 Biao Yang , Jonathan R. Stroud , Gabriel Huerta

The Bayesian inversion method demonstrates significant potential for solving inverse problems, enabling both point estimation and uncertainty quantification (UQ). However, Bayesian maximum a posteriori (MAP) estimation may become unstable…

Numerical Analysis · Mathematics 2025-06-04 Ruibiao Song , Liying Zhang

Quasi-Monte Carlo rules are equal weight quadrature rules defined over the domain $[0,1]^s$. Here we introduce quasi-Monte Carlo type rules for numerical integration of functions defined on $\mathbb{R}^s$. These rules are obtained by way of…

Numerical Analysis · Mathematics 2010-11-12 Josef Dick

When working with multimodal Bayesian posterior distributions, Markov chain Monte Carlo (MCMC) algorithms have difficulty moving between modes, and default variational or mode-based approximate inferences will understate posterior…

Methodology · Statistics 2021-11-19 Yuling Yao , Aki Vehtari , Andrew Gelman

A control in feedback form is derived for linear quadratic, time-invariant optimal control problems subject to parabolic partial differential equations with coefficients depending on a countably infinite number of uncertain parameters. It…

Optimization and Control · Mathematics 2024-09-25 Philipp A. Guth , Peter Kritzer , Karl Kunisch

Bayesian inverse problems often involve sampling posterior distributions on infinite-dimensional function spaces. Traditional Markov chain Monte Carlo (MCMC) algorithms are characterized by deteriorating mixing times upon mesh-refinement,…

Computation · Statistics 2017-03-08 Alexandros Beskos , Mark Girolami , Shiwei Lan , Patrick E. Farrell , Andrew M. Stuart

Quasi-Monte Carlo (QMC) sampling has been developed for integration over $[0,1]^s$ where it has superior accuracy to Monte Carlo (MC) for integrands of bounded variation. Scrambled net quadrature gives allows replication based error…

Numerical Analysis · Computer Science 2015-03-11 K. Basu , A. B. Owen

It has been found empirically that quasi-Monte Carlo methods are often efficient for very high-dimensional problems, that is, with dimension in the hundreds or even thousands. The common explanation for this surprising fact is that those…

Numerical Analysis · Mathematics 2014-09-23 Christian Irrgeher , Gunther Leobacher

We study the convergence of these operators in a weighted space of functions on a positive semi-axis and estimate the approximation by using a new type of weighted modulus of continuity and error estimation.

Classical Analysis and ODEs · Mathematics 2016-06-22 Preeti Sharma , Vishnu Narayan Mishra