English
Related papers

Related papers: Weak Poincar\'{e} inequalities for Deterministic-s…

200 papers

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact…

Methodology · Statistics 2010-06-04 Michael Braun , Jon McAuliffe

Assuming that $(X_t)_{t\in\Z}$ is a vector valued time series with a common marginal distribution admitting a density $f$, our aim is to provide a wide range of consistent estimators of $f$. We consider different methods of estimation of…

Statistics Theory · Mathematics 2007-06-13 Nicolas Ragache , Olivier Wintenberger

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

Probability · Mathematics 2016-08-16 Christophe Andrieu , Éric Moulines

We study the Gibbs posterior distribution for sparse deep neural nets in a nonparametric regression setting. The posterior can be accessed via Metropolis-adjusted Langevin algorithms. Using a mixture over uniform priors on sparse sets of…

Statistics Theory · Mathematics 2026-01-09 Maximilian F. Steffen , Mathias Trabs

Mostof the existing literature on supervised machine learning problems focuses on the case when the training data set is drawn from an i.i.d. sample. However, many practical problems are characterized by temporal dependence and strong…

Statistics Theory · Mathematics 2023-01-23 Nikola Sandrić , Stjepan Šebek

We develop an efficient posterior sampling scheme for the Poisson INGARCH models. The proposed method is based on the approximation of the posterior density that exploits the Poisson limit of the negative binomial distribution. It allows us…

Methodology · Statistics 2026-03-10 Yixuan Fan , Zhengwei Liu , Fukang Zhu

We propose a general approach for quantitative convergence analysis of non-reversible Markov processes, based on the concept of second-order lifts and a variational approach to hypocoercivity. To this end, we introduce the flow Poincar{\'e}…

Analysis of PDEs · Mathematics 2025-07-22 Andreas Eberle , Arnaud Guillin , Leo Hahn , Francis Lörler , Manon Michel

Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale…

Machine Learning · Computer Science 2019-11-25 Ruqi Zhang , Christopher De Sa

The Metropolis-Hastings (MH) algorithm is one of the most widely used Markov Chain Monte Carlo schemes for generating samples from Bayesian posterior distributions. The algorithm is asymptotically exact, flexible and easy to implement.…

Methodology · Statistics 2026-03-10 Estevão Prado , Christopher Nemeth , Chris Sherlock

This article is concerned with sampling from Gibbs distributions $\pi(x)\propto e^{-U(x)}$ using Markov chain Monte Carlo methods. In particular, we investigate Langevin dynamics in the continuous- and the discrete-time setting for such…

Numerical Analysis · Mathematics 2026-05-25 Lorenz Fruehwirth , Andreas Habring

This paper presents a control variate-based Markov chain Monte Carlo algorithm for efficient sampling from the probability simplex, with a focus on applications in large-scale Bayesian models such as latent Dirichlet allocation. Standard…

Methodology · Statistics 2024-10-02 Francesco Barile , Christopher Nemeth

In this paper we study Markov chains associated with the Metropolis-Hastings algorithm. We consider conditions under which the sequence of the successive densities of such a chain converges to the target density according to the total…

Statistics Theory · Mathematics 2020-06-16 Dimiter Tsvetkov , Lyubomir Hristov , Ralitsa Angelova-Slavova

By formulating the inverse problem of partial differential equations (PDEs) as a statistical inference problem, the Bayesian approach provides a general framework for quantifying uncertainties. In the inverse problem of PDEs, parameters are…

Numerical Analysis · Mathematics 2026-02-10 Haoyu Lu , Junxiong Jia , Deyu Meng

This paper concerns the use of Markov chain Monte Carlo methods for posterior sampling in Bayesian nonparametric mixture models with normalized random measure priors. Making use of some recent posterior characterizations for the class of…

Methodology · Statistics 2013-10-03 Stefano Favaro , Yee Whye Teh

General multivariate distributions are notoriously expensive to sample from, particularly the high-dimensional posterior distributions in PDE-constrained inverse problems. This paper develops a sampler for arbitrary continuous multivariate…

Numerical Analysis · Mathematics 2019-07-05 Sergey Dolgov , Karim Anaya-Izquierdo , Colin Fox , Robert Scheichl

Discrete mixture models are routinely used for density estimation and clustering. While conducting inferences on the cluster-specific parameters, current frequentist and Bayesian methods often encounter problems when clusters are placed too…

Methodology · Statistics 2012-09-21 Francesca Petralia , Vinayak Rao , David B. Dunson

Motivated by the physics of strings and branes, we develop a class of Markov chain Monte Carlo (MCMC) algorithms involving extended objects. Starting from a collection of parallel Metropolis-Hastings (MH) samplers, we place them on an…

Computational Physics · Physics 2017-09-13 Jonathan J. Heckman , Jeffrey G. Bernstein , Ben Vigoda

We consider local Markov chain Monte-Carlo algorithms for sampling from the weighted distribution of independent sets with activity $\l$, where the weight of an independent set $I$ is $\l^{|I|}$. A recent result has established that Gibbs…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Dror Weitz , Nicholas Wormald

Equilibrium systems evolve according to Detailed Balance (DB). This principe guided development of the Monte-Carlo sampling techniques, of which Metropolis-Hastings (MH) algorithm is the famous representative. It is also known that DB is…

Statistical Mechanics · Physics 2015-07-15 Konstantin S. Turitsyn , Michael Chertkov , Marija Vucelja

We study the exponential dissipation of entropic functionals for continuous time Markov chains and the associated convex Sobolev inequalities, including MLSI and Beckner inequalities. We propose a method that combines the Bakry \'Emery…

Probability · Mathematics 2020-05-28 Giovanni Conforti