中文
相关论文

相关论文: Deep unfolding of MCMC kernels: scalable, modular …

200 篇论文

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

机器学习 · 统计学 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

统计计算 · 统计学 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

天体物理仪器与方法 · 物理学 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

In this paper, we address the challenge of Markov Chain Monte Carlo (MCMC) algorithms within the approximate Bayesian Computation (ABC) framework, which often get trapped in local optima due to their inherent local exploration mechanism. We…

统计计算 · 统计学 2025-12-16 Xuefei Cao , Shijia Wang , Yongdao Zhou

Stochastic gradient Markov Chain Monte Carlo (SGMCMC) is considered the gold standard for Bayesian inference in large-scale models, such as Bayesian neural networks. Since practitioners face speed versus accuracy tradeoffs in these models,…

机器学习 · 计算机科学 2022-07-19 Antonios Alexos , Alex Boyd , Stephan Mandt

We develop a multivariate posterior sampling procedure through deep generative quantile learning. Simulation proceeds implicitly through a push-forward mapping that can transform i.i.d. random vector samples from the posterior. We utilize…

统计计算 · 统计学 2025-05-01 Jungeum Kim , Percy S. Zhai , Veronika Ročková

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

统计方法学 · 统计学 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

High-dimensional feature selection arises in many areas of modern science. For example, in genomic research we want to find the genes that can be used to separate tissues of different classes (e.g. cancer and normal) from tens of thousands…

统计计算 · 统计学 2018-07-20 Longhai Li , Weixin Yao

We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency…

统计理论 · 数学 2015-06-01 Yun Yang , Martin J. Wainwright , Michael I. Jordan

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

统计计算 · 统计学 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

Recent developments in big data and analytics research have produced an abundance of large data sets that are too big to be analyzed in their entirety, due to limits on computer memory or storage capacity. To address these issues,…

统计方法学 · 统计学 2016-01-06 Alexey Miroshnikov , Erin M. Conlon

Bayesian inference for Markov processes has become increasingly relevant in recent years. Problems of this type often have intractable likelihoods and prior knowledge about model rate parameters is often poor. Markov Chain Monte Carlo…

统计计算 · 统计学 2014-10-23 Jamie Owen , Darren J. Wilkinson , Colin S. Gillespie

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

统计计算 · 统计学 2021-08-17 Yves Atchadé , Liwei Wang

Bayesian Generative AI (BayesGen-AI) methods are developed and applied to Bayesian computation. BayesGen-AI reconstructs the posterior distribution by directly modeling the parameter of interest as a mapping (a.k.a. deep learner) from a…

统计计算 · 统计学 2024-02-27 Nicholas G. Polson , Vadim Sokolov

Markov chain Monte Carlo (MCMC), such as Langevin dynamics, is valid for approximating intractable distributions. However, its usage is limited in the context of deep latent variable models owing to costly datapoint-wise sampling iterations…

机器学习 · 计算机科学 2022-10-12 Shohei Taniguchi , Yusuke Iwasawa , Wataru Kumagai , Yutaka Matsuo

Performing reliable Bayesian inference on a big data scale is becoming a keystone in the modern era of machine learning. A workhorse class of methods to achieve this task are Markov chain Monte Carlo (MCMC) algorithms and their design to…

统计方法学 · 统计学 2021-06-21 Vincent Plassier , Maxime Vono , Alain Durmus , Eric Moulines

Markov chain Monte Carlo (MCMC) is a powerful methodology for the approximation of posterior distributions. However, the iterative nature of MCMC does not naturally facilitate its use with modern highly parallel computation on HPC and cloud…

Classical parameter-space Bayesian inference for Bayesian neural networks (BNNs) suffers from several unresolved prior issues, such as knowledge encoding intractability and pathological behaviours in deep networks, which can lead to…

机器学习 · 计算机科学 2024-10-11 Mengjing Wu , Junyu Xuan , Jie Lu

Bayesian inverse problems highly rely on efficient and effective inference methods for uncertainty quantification (UQ). Infinite-dimensional MCMC algorithms, directly defined on function spaces, are robust under refinement of physical…

统计计算 · 统计学 2019-05-22 Shiwei Lan

In the era of Big Data, Markov chain Monte Carlo (MCMC) methods, which are currently essential for Bayesian estimation, face significant computational challenges owing to their sequential nature. To achieve a faster and more effective…

统计计算 · 统计学 2024-11-08 Tomoki Matsumoto