English
Related papers

Related papers: Semi-Exact Control Functionals From Sard's Method

200 papers

Zero-variance control variates (ZV-CV) are a post-processing method to reduce the variance of Monte Carlo estimators of expectations using the derivatives of the log target. Once the derivatives are available, the only additional…

Computation · Statistics 2022-08-17 Leah F. South , Chris J. Oates , Antonietta Mira , Christopher Drovandi

There is a lack of simple and scalable algorithms for uncertainty quantification. Bayesian methods quantify uncertainty through posterior and predictive distributions, but it is difficult to rapidly estimate summaries of these…

Computation · Statistics 2016-12-28 Cheng Li , Sanvesh Srivastava , David B. Dunson

This study introduces a computationally efficient algorithm, delayed acceptance Markov chain Monte Carlo (DA-MCMC), designed to improve posterior simulation in quasi-Bayesian inference. Quasi-Bayesian methods, which do not require fully…

Computation · Statistics 2026-02-16 Masahiro Tanaka

Sequential techniques can enhance the efficiency of the approximate Bayesian computation algorithm, as in Sisson et al.'s (2007) partial rejection control version. While this method is based upon the theoretical works of Del Moral et al.…

Computation · Statistics 2010-10-11 Mark A. Beaumont , Jean-Marie Cornuet , Jean-Michel Marin , Christian P. Robert

We propose a Markov Chain Monte Carlo (MCMC) algorithm based on Gibbs sampling with parallel tempering to solve nonlinear optimal control problems. The algorithm is applicable to nonlinear systems with dynamics that can be approximately…

Optimization and Control · Mathematics 2024-07-10 João Hespanha , Kerem Camsari

Optimal control under uncertainty is a prevailing challenge for many reasons. One of the critical difficulties lies in producing tractable solutions for the underlying stochastic optimization problem. We show how advanced approximate…

Machine Learning · Computer Science 2024-10-28 Joe Watson , Hany Abdulsamad , Rolf Findeisen , Jan Peters

We develop exact Markov chain Monte Carlo methods for discretely-sampled, directly and indirectly observed diffusions. The qualification "exact" refers to the fact that the invariant and limiting distribution of the Markov chains is the…

The Stochastic Approximation EM (SAEM) algorithm, a variant stochastic approximation of EM, is a versatile tool for inference in incomplete data models. In this paper, we review the fundamental EM algorithm and then focus especially on the…

Methodology · Statistics 2018-11-30 Vahid Tadayon

This paper introduces a class of Monte Carlo algorithms which are based upon the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current…

Methodology · Statistics 2020-04-14 Murray Pollock , Paul Fearnhead , Adam M. Johansen , Gareth O. Roberts

Bayesian inference for Markov processes has become increasingly relevant in recent years. Problems of this type often have intractable likelihoods and prior knowledge about model rate parameters is often poor. Markov Chain Monte Carlo…

Computation · Statistics 2014-10-23 Jamie Owen , Darren J. Wilkinson , Colin S. Gillespie

We provide explicit nonasymptotic estimates for the rate of convergence of empirical means of Markov chains, together with a Gaussian or exponential control on the deviations of empirical means. These estimates hold under a "positive…

Probability · Mathematics 2010-11-11 Aldéric Joulin , Yann Ollivier

Control variates are variance reduction tools for Monte Carlo estimators. They can provide significant variance reduction, but usually require a large number of samples, which can be prohibitive when sampling or evaluating the integrand is…

Methodology · Statistics 2023-06-08 Zhuo Sun , Alessandro Barp , François-Xavier Briol

High-dimensional data are routinely collected in many areas. We are particularly interested in Bayesian classification models in which one or more variables are imbalanced. Current Markov chain Monte Carlo algorithms for posterior…

Methodology · Statistics 2024-01-15 Deborshee Sen , Matthias Sachs , Jianfeng Lu , David Dunson

We consider the problem of estimation in Hidden Markov models with finite state space and nonparametric emission distributions. Efficient estimators for the transition matrix are exhibited, and a semiparametric Bernstein-von Mises result is…

Statistics Theory · Mathematics 2023-03-09 Daniel Moss , Judith Rousseau

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

We develop two Regression Monte Carlo algorithms (value and performance iteration) to solve general problems of optimal stochastic control of discrete-time Markov processes. We formulate our method within an innovative framework that allow…

Optimization and Control · Mathematics 2017-12-29 Alessandro Balata , Jan Palczewski

We estimate the parameter of a stationary time series process by minimizing the integrated weighted mean squared error between the empirical and simulated characteristic function, when the true characteristic functions cannot be explicitly…

Statistics Theory · Mathematics 2021-02-03 Richard A. Davis , Thiago do Rêgo Sousa , Claudia Klüppelberg

Optimization in the Bures-Wasserstein space has been gaining popularity in the machine learning community since it draws connections between variational inference and Wasserstein gradient flows. The variational inference objective function…

Machine Learning · Computer Science 2025-03-03 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Marcelo Hartmann , Arto Klami

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively slow when both the…

Statistics Theory · Mathematics 2019-04-23 Pierre Alquier , James Ridgway

Monte Carlo methods have become increasingly relevant for control of non-differentiable systems, approximate dynamics models and learning from data. These methods scale to high-dimensional spaces and are effective at the non-convex…

Machine Learning · Computer Science 2022-10-10 Joe Watson , Jan Peters