中文
相关论文

相关论文: Enhanced gradient-based MCMC in discrete spaces

200 篇论文

We consider a recently proposed class of MCMC methods which uses proximity maps instead of gradients to build proposal mechanisms which can be employed for both differentiable and non-differentiable targets. These methods have been shown to…

统计计算 · 统计学 2024-06-21 Francesca R. Crucinio , Alain Durmus , Pablo Jiménez , Gareth O. Roberts

The discrete nature of transmitted symbols poses challenges for achieving optimal detection in multiple-input multiple-output (MIMO) systems associated with a large number of antennas. Recently, the combination of two powerful machine…

信号处理 · 电气工程与系统科学 2024-12-11 Xingyu Zhou , Le Liang , Jing Zhang , Chao-Kai Wen , Shi Jin

Bayesian approaches have been successfully integrated into training deep neural networks. One popular family is stochastic gradient Markov chain Monte Carlo methods (SG-MCMC), which have gained increasing interest due to their scalability…

数值分析 · 数学 2021-03-17 Yating Wang , Wei Deng , Guang Lin

Gaussian latent variable models are a key class of Bayesian hierarchical models with applications in many fields. Performing Bayesian inference on such models can be challenging as Markov chain Monte Carlo algorithms struggle with the…

统计计算 · 统计学 2020-11-09 Charles C. Margossian , Aki Vehtari , Daniel Simpson , Raj Agrawal

Variational autoencoders (VAEs) are popular likelihood-based generative models which can be efficiently trained by maximizing an Evidence Lower Bound (ELBO). There has been much progress in improving the expressiveness of the variational…

机器学习 · 统计学 2023-08-29 Marcel Hirt , Vasileios Kreouzis , Petros Dellaportas

The usage of positive definite metric tensors derived from second derivative information in the context of the simplified manifold Metropolis adjusted Langevin algorithm (MALA) is explored. A new adaptive step length procedure that resolves…

统计计算 · 统计学 2015-09-03 Tore Selland Kleppe

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

统计方法学 · 统计学 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

The Metropolis-Adjusted Langevin Algorithm (MALA) is a widely used Markov Chain Monte Carlo (MCMC) method for sampling from high-dimensional distributions. However, MALA relies on differentiability assumptions that restrict its…

统计方法学 · 统计学 2025-07-10 Ning Ning

Riemannian manifold Hamiltonian (RMHMC) and Lagrangian Monte Carlo (LMC) have emerged as powerful methods of Bayesian inference. Unlike Euclidean Hamiltonian Monte Carlo (EHMC) and the Metropolis-adjusted Langevin algorithm (MALA), the…

统计方法学 · 统计学 2023-01-05 James A. Brofos , Vivekananda Roy , Roy R. Lederman

Particle Marginal Metropolis-Hastings (PMMH) is a general approach to Bayesian inference when the likelihood is intractable, but can be estimated unbiasedly. Our article develops an efficient PMMH method that scales up better to higher…

统计计算 · 统计学 2023-05-10 David Gunawan , Pratiti Chatterjee , Robert Kohn

Constantine et al. (2016) introduced a Metropolis-Hastings (MH) approach that target the active subspace of a posterior distribution: a linearly projected subspace that is informed by the likelihood. Schuster et al. (2017) refined this…

统计方法学 · 统计学 2025-01-10 Leonardo Ripoli , Richard G. Everitt

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

统计方法学 · 统计学 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

We develop sampling methods, which consist of Gaussian invariant versions of random walk Metropolis (RWM), Metropolis adjusted Langevin algorithm (MALA) and second order Hessian or Manifold MALA. Unlike standard RWM and MALA we show that…

机器学习 · 统计学 2025-06-27 Michalis K. Titsias , Angelos Alexopoulos , Siran Liu , Petros Dellaportas

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

机器学习 · 计算机科学 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

Yang et al. (2016) proved that the symmetric random walk Metropolis--Hastings algorithm for Bayesian variable selection is rapidly mixing under mild high-dimensional assumptions. We propose a novel MCMC sampler using an informed proposal…

统计方法学 · 统计学 2022-04-26 Quan Zhou , Jun Yang , Dootika Vats , Gareth O. Roberts , Jeffrey S. Rosenthal

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

机器学习 · 计算机科学 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Preliminary mission design of low-thrust spacecraft trajectories in the Circular Restricted Three-Body Problem is a global search characterized by a complex objective landscape and numerous local minima. Formulating the problem as sampling…

系统与控制 · 电气工程与系统科学 2025-12-10 Jannik Graebner , Ryne Beeson

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sampling from complex continuous distributions. However, a major limitation of HMC is its inability to be applied to discrete domains due to the lack of gradient signal.…

机器学习 · 计算机科学 2021-03-02 Priyank Jaini , Didrik Nielsen , Max Welling

This paper presents an improved implicit sampling method for hierarchical Bayesian inverse problems. A widely used approach for sampling posterior distribution is based on Markov chain Monte Carlo (MCMC). However, the samples generated by…

数值分析 · 数学 2018-11-27 Xiaoyan Song , Lijian Jiang , Guanghui Zheng

Gaussian and discrete non-Gaussian spatial datasets are common across fields like public health, ecology, geosciences, and social sciences. Bayesian spatial generalized linear mixed models (SGLMMs) are a flexible class of models for…

统计方法学 · 统计学 2025-01-27 Jin Hyung Lee , Ben Seiyon Lee