English
Related papers

Related papers: Efficient Sampling on Riemannian Manifolds via Lan…

200 papers

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

Probability · Mathematics 2024-12-05 Pierre Monmarché , Katharina Schuh

We consider the problem of learning an $\varepsilon$-optimal policy in a general class of continuous-space Markov decision processes (MDPs) having smooth Bellman operators. Given access to a generative model, we achieve rate-optimal sample…

Machine Learning · Computer Science 2024-05-13 Davide Maran , Alberto Maria Metelli , Matteo Papini , Marcello Restelli

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the…

Machine Learning · Computer Science 2014-11-13 Xianghang Liu , Justin Domke

Traditional Markov Chain Monte Carlo sampling methods often struggle with sharp curvatures, intricate geometries, and multimodal distributions. Slice sampling can resolve local exploration inefficiency issues, and Riemannian geometries help…

Machine Learning · Computer Science 2025-06-17 Bernardo Williams , Hanlin Yu , Hoang Phuc Hau Luu , Georgios Arvanitidis , Arto Klami

This paper proposes a replica exchange preconditioned Langevin diffusion discretized by the Crank-Nicolson scheme (repCNLD) to handle high-dimensional and multi-modal distribution problems. Sampling from high-dimensional and multi-modal…

Numerical Analysis · Mathematics 2022-11-01 Ou Na , Zecheng Zhang , Guang Lin

We introduce a Markov Chain Monte Carlo (MCMC) algorithm to generate samples from probability distributions supported on a $d$-dimensional lattice $\Lambda = \mathbf{B}\mathbb{Z}^d$, where $\mathbf{B}$ is a full-rank matrix. Specifically,…

Computation · Statistics 2021-01-27 Anand Jerry George , Navin Kashyap

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

Sampling from high-dimensional distributions has wide applications in data science and machine learning but poses significant computational challenges. We introduce Subspace Langevin Monte Carlo (SLMC), a novel and efficient sampling method…

Machine Learning · Statistics 2025-05-21 Tyler Maunu , Jiayi Yao

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

We propose to model the image differentials of astrophysical source maps by Student's t-distribution and to use them in the Bayesian source separation method as priors. We introduce an efficient Markov Chain Monte Carlo (MCMC) sampling…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 K. Kayabol , E. E. Kuruoglu , J. L. Sanz , B. Sankur , E. Salerno , D. Herranz

We introduce a new method for analyzing midpoint discretizations of stochastic differential equations (SDEs), which are frequently used in Markov chain Monte Carlo (MCMC) methods for sampling from a target measure $\pi \propto \exp(-V)$.…

Numerical Analysis · Mathematics 2025-07-18 Matthew S. Zhang

Low-precision training has emerged as a promising low-cost technique to enhance the training efficiency of deep neural networks without sacrificing much accuracy. Its Bayesian counterpart can further provide uncertainty quantification and…

Machine Learning · Statistics 2024-07-16 Ziyi Wang , Yujie Chen , Qifan Song , Ruqi Zhang

The purpose of this paper is to examine the sampling problem through Euler discretization, where the potential function is assumed to be a mixture of locally smooth distributions and weakly dissipative. We introduce $\alpha_{G}$-mixture…

Computation · Statistics 2023-02-01 Dao Nguyen

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sampling from complex continuous distributions. However, a major limitation of HMC is its inability to be applied to discrete domains due to the lack of gradient signal.…

Machine Learning · Computer Science 2021-03-02 Priyank Jaini , Didrik Nielsen , Max Welling

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

Machine Learning · Computer Science 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

Standard Markov chain Monte Carlo methods struggle to explore distributions that are concentrated in the neighbourhood of low-dimensional structures. These pathologies naturally occur in a number of situations. For example, they are common…

Computation · Statistics 2021-12-02 Khai Xiang Au , Matthew M. Graham , Alexandre H. Thiery

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

Methodology · Statistics 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

We study the efficiency of Thompson sampling for contextual bandits. Existing Thompson sampling-based algorithms need to construct a Laplace approximation (i.e., a Gaussian distribution) of the posterior distribution, which is inefficient…

Machine Learning · Computer Science 2022-06-23 Pan Xu , Hongkai Zheng , Eric Mazumdar , Kamyar Azizzadenesheli , Anima Anandkumar
‹ Prev 1 8 9 10 Next ›