English
Related papers

Related papers: Weak Convergence and Optimal Tuning of the Reversi…

200 papers

In this paper we build on previous work which uses inferences techniques, in particular Markov Chain Monte Carlo (MCMC) methods, to solve parameterized control problems. We propose a number of modifications in order to make this approach…

Machine Learning · Computer Science 2012-05-14 Matthias Hoffman , Hendrik Kueck , Nando de Freitas , Arnaud Doucet

We investigate lower bounds on the subgeometric convergence of adaptive Markov chain Monte Carlo under any adaptation strategy. In particular, we prove general lower bounds in total variation and on the weak convergence rate under general…

Statistics Theory · Mathematics 2025-06-17 Austin Brown , Jeffrey S. Rosenthal

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel

In this paper we consider the problem of model choice for a set of insurance loss ratios. We use a reversible jump algorithm for our model discrimination and show how the vanilla reversible jump algorithm can be improved on using recent…

Applications · Statistics 2015-03-17 Garfield Brown , Steve Brooks

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

Bayesian curve fitting plays an important role in inverse problems, and is often addressed using the Reversible Jump Markov Chain Monte Carlo (RJMCMC) algorithm. However, this algorithm can be computationally inefficient without…

Computation · Statistics 2024-02-28 Zhiyao Tian , Anthony Lee , Shunhua Zhou

Efficient computation of min-max problems is a central question in optimization, learning, games, and controls. Arguably the most natural algorithm is gradient-descent-ascent (GDA). However, since the 1970s, conventional wisdom has argued…

Optimization and Control · Mathematics 2025-05-05 Henry Shugart , Jason M. Altschuler

Random Reshuffling (RR) is an algorithm for minimizing finite-sum functions that utilizes iterative gradient descent steps in conjunction with data reshuffling. Often contrasted with its sibling Stochastic Gradient Descent (SGD), RR is…

Optimization and Control · Mathematics 2021-04-06 Konstantin Mishchenko , Ahmed Khaled , Peter Richtárik

We introduce an efficient nonreversible Markov chain Monte Carlo algorithm to generate self-avoiding walks with a variable endpoint. In two dimensions, the new algorithm slightly outperforms the two-move nonreversible Berretti-Sokal…

Statistical Mechanics · Physics 2021-12-13 Hanqing Zhao , Marija Vucelja

This work develops novel error expansions with computable leading order terms for the global weak error in the tau-leap discretization of pure jump processes arising in kinetic Monte Carlo models. Accurate computable a posteriori error…

Numerical Analysis · Mathematics 2011-10-21 Jesper Karlsson , Raul Tempone

Most Markov chain Monte Carlo methods operate in discrete time and are reversible with respect to the target probability. Nevertheless, it is now understood that the use of non-reversible Markov chains can be beneficial in many contexts. In…

Methodology · Statistics 2021-02-23 Chris Sherlock , Alexandre H. Thiery

We present a stepwise adaptive-timestep version of the Quantum Jump (Monte Carlo wave-function) algorithm. Our method has proved to remain robust even for problems where the integrating implementation of the Quantum Jump method is…

Quantum Physics · Physics 2019-03-27 M. Kornyik , A. Vukics

We investigate the properties of a sequential Monte Carlo method where the particle weight that appears in the algorithm is estimated by a positive, unbiased estimator. We present broadly-applicable convergence results, including a central…

Methodology · Statistics 2022-08-26 Paul B. Rohrbach , Robert L. Jack

We consider adaptive increasingly rare Markov chain Monte Carlo (MCMC) algorithms, which are adaptive MCMC methods, where the adaptation concerning the "past'' happens less and less frequently over time. Under a contraction assumption with…

Numerical Analysis · Mathematics 2026-02-24 Julian Hofstadler , Krzysztof Latuszynski , Gareth O. Roberts , Daniel Rudolf

Markov chain Monte Carlo (MCMC) algorithms are indispensable when sampling from a complex, high-dimensional distribution by a conventional method is intractable. Even though MCMC is a powerful tool, it is also hard to control and tune in…

Graphics · Computer Science 2025-10-14 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

Optimization and Control · Mathematics 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Regional flood frequency analysis is a convenient way to reduce estimation uncertainty when few data are available at the gauging site. In this work, a model that allows a non-null probability to a regional fixed shape parameter is…

Applications · Statistics 2008-02-05 Mathieu Ribatet , Eric Sauquet , Jean-Michel Grésillon , Taha B. M. J. Ouarda

The present article deals with the averaging principle for a two-time-scale system of jump-diffusion stochastic differential equation. Under suitable conditions, the weak error is expanded in powers of timescale parameter. It is proved that…

Probability · Mathematics 2018-06-01 Bengong Zhang , Hongbo Fu , Li Wan , Jicheng Liu

The Pseudo-Marginal (PM) algorithm is a popular Markov chain Monte Carlo (MCMC) method used to sample from a target distribution when its density is inaccessible, but can be estimated with a non-negative unbiased estimator. Its performance…

Computation · Statistics 2025-09-30 Sarra Abaoubida , Mylène Bédard , Florian Maire

This article develops general conditions for weak convergence of adaptive Markov chain Monte Carlo processes and is shown to imply a weak law of large numbers for bounded Lipschitz continuous functions. This allows an estimation theory for…

Statistics Theory · Mathematics 2026-01-14 Austin Brown , Jeffrey S. Rosenthal