中文
相关论文

相关论文: Sampling from Bayesian Neural Network Posteriors w…

200 篇论文

Sampling the parameter space of artificial neural networks according to a Boltzmann distribution provides insight into the geometry of low-loss solutions and offers an alternative to conventional loss minimization for training. However,…

无序系统与神经网络 · 物理学 2026-03-17 Alessandro Zambon , Francesca Caruso , Riccardo Zecchina , Guido Tiana

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

统计方法学 · 统计学 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

Posterior sampling in high-dimensional spaces using generative models holds significant promise for various applications, including but not limited to inverse problems and guided generation tasks. Despite many recent developments,…

机器学习 · 统计学 2024-10-04 Vishal Purohit , Matthew Repasky , Jianfeng Lu , Qiang Qiu , Yao Xie , Xiuyuan Cheng

Bayesian neural networks (BNNs) allow us to reason about uncertainty in a principled way. Stochastic Gradient Langevin Dynamics (SGLD) enables efficient BNN learning by drawing samples from the BNN posterior using mini-batches. However,…

机器学习 · 计算机科学 2018-06-28 Kuan-Chieh Wang , Paul Vicol , James Lucas , Li Gu , Roger Grosse , Richard Zemel

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

机器学习 · 计算机科学 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a…

机器学习 · 统计学 2025-12-10 Jinyuan Chang , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Cheng Yuan

The self-configuring nnU-Net has achieved leading performance in a large range of medical image segmentation challenges. It is widely considered as the model of choice and a strong baseline for medical image segmentation. However, despite…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Yidong Zhao , Changchun Yang , Artur Schweidtmann , Qian Tao

In this paper, we examine the computational complexity of sampling from a Bayesian posterior (or pseudo-posterior) using the Metropolis-adjusted Langevin algorithm (MALA). MALA first employs a discrete-time Langevin SDE to propose a new…

统计理论 · 数学 2024-05-10 Rong Tang , Yun Yang

We explore an explicit link between stochastic gradient descent using common batching strategies and splitting methods for ordinary differential equations. From this perspective, we introduce a new minibatching strategy (called Symmetric…

最优化与控制 · 数学 2025-04-08 Luke Shaw , Peter A. Whalley

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

数值分析 · 数学 2021-03-17 Yating Wang , Wei Deng , Lin Guang

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

统计计算 · 统计学 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

机器学习 · 计算机科学 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

机器学习 · 计算机科学 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

Bayesian neural network posterior distributions have a great number of modes that correspond to the same network function. The abundance of such modes can make it difficult for approximate inference methods to do their job. Recent work has…

机器学习 · 统计学 2024-07-03 Tommy Rochussen

The paper presents a Bayesian framework for the calibration of financial models using neural stochastic differential equations (neural SDEs), for which we also formulate a global universal approximation theorem based on Barron-type…

计算金融 · 定量金融 2026-05-12 Christa Cuchiero , Eva Flonner , Kevin Kurt

Bayesian deep learning counts on the quality of posterior distribution estimation. However, the posterior of deep neural networks is highly multi-modal in nature, with local modes exhibiting varying generalization performance. Given a…

机器学习 · 计算机科学 2024-03-27 Bolian Li , Ruqi Zhang

High-dimensional data are routinely collected in many areas. We are particularly interested in Bayesian classification models in which one or more variables are imbalanced. Current Markov chain Monte Carlo algorithms for posterior…

统计方法学 · 统计学 2024-01-15 Deborshee Sen , Matthias Sachs , Jianfeng Lu , David Dunson

Bayesian network structure learning is often performed in a Bayesian setting, evaluating candidate structures using their posterior probabilities for a given data set. Score-based algorithms then use those posterior probabilities as an…

机器学习 · 统计学 2017-04-14 Marco Scutari

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

机器学习 · 计算机科学 2021-03-17 Jannik Schmitt , Stefan Roth