中文
相关论文

相关论文: Covariance-Controlled Adaptive Langevin Thermostat…

200 篇论文

Stochastic gradient Markov chain Monte Carlo (MCMC) algorithms have received much attention in Bayesian computing for big data problems, but they are only applicable to a small class of problems for which the parameter space has a fixed…

统计计算 · 统计学 2020-02-10 Qifan Song , Yan Sun , Mao Ye , Faming Liang

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

统计计算 · 统计学 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

机器学习 · 计算机科学 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

机器学习 · 统计学 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

Hamiltonian Monte Carlo and underdamped Langevin Monte Carlo are state-of-the-art methods for taking samples from high-dimensional distributions with a differentiable density function. To generate samples, they numerically integrate…

统计计算 · 统计学 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

机器学习 · 计算机科学 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Stochastic gradient Markov Chain Monte Carlo (SGMCMC) is considered the gold standard for Bayesian inference in large-scale models, such as Bayesian neural networks. Since practitioners face speed versus accuracy tradeoffs in these models,…

机器学习 · 计算机科学 2022-07-19 Antonios Alexos , Alex Boyd , Stephan Mandt

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

机器学习 · 计算机科学 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

For engineering applications of artificial intelligence, Bayesian learning holds significant advantages over standard frequentist learning, including the capacity to quantify uncertainty. Langevin Monte Carlo (LMC) is an efficient…

信息论 · 计算机科学 2022-03-01 Yunchuan Zhang , Dongzhu Liu , Osvaldo Simeone

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin…

最优化与控制 · 数学 2022-01-12 Tobias Breiten , Carsten Hartmann , Lara Neureither , Upanshu Sharma

We extend the L\'evy Langevin Monte Carlo method studied by Oechsler in 2024 to the setting of a target distribution with heavy tails: Choosing a target distribution from the class of subexponential distributions we prove convergence of a…

概率论 · 数学 2025-07-15 Anita Behme , Claudius Lütke Schwienhorst

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin…

Adaptive Langevin dynamics is a method for sampling the Boltzmann-Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. The method replaces the…

概率论 · 数学 2023-11-14 Benedict Leimkuhler , Matthias Sachs , Gabriel Stoltz

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…

机器学习 · 统计学 2021-02-03 Adrià Garriga-Alonso , Vincent Fortuin

Estimation and prediction in high dimensional multivariate factor stochastic volatility models is an important and active research area because such models allow a parsimonious representation of multivariate stochastic volatility. Bayesian…

统计计算 · 统计学 2021-04-27 David Gunawan , Robert Kohn , David Nott

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

信号处理 · 电气工程与系统科学 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

Stochastic gradient Langevin dynamics (SGLD) and stochastic gradient Hamiltonian Monte Carlo (SGHMC) are two popular Markov Chain Monte Carlo (MCMC) algorithms for Bayesian inference that can scale to large datasets, allowing to sample from…

机器学习 · 统计学 2021-08-30 Mert Gürbüzbalaban , Xuefeng Gao , Yuanhan Hu , Lingjiong Zhu

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

机器学习 · 计算机科学 2024-03-15 Tim Rensmeyer , Oliver Niggemann

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

机器学习 · 计算机科学 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling