中文
相关论文

相关论文: Bayesian Inference with Latent Hamiltonian Neural …

200 篇论文

Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive…

机器学习 · 计算机科学 2024-08-16 Zi-Yu Khoo , Dawen Wu , Jonathan Sze Choong Low , Stéphane Bressan

Analysts routinely use Bayesian hierarchical models to understand natural processes. The no-U-turn sampler (NUTS) is the most widely used algorithm to sample high-dimensional, continuously differentiable models. But NUTS is slowed by high…

统计计算 · 统计学 2026-03-04 Cole C. Monnahan , Kasper Kristensen , James T. Thorson , Bob Carpenter

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

机器学习 · 计算机科学 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

We present a deep neural network (DNN) accelerated Hamiltonian Monte Carlo (HMC) algorithm called DeepHMC for the inference of binary neutron star systems. The HMC is a non-random walk sampler that uses background gradient information to…

广义相对论与量子宇宙学 · 物理学 2025-05-06 Jules Perret , Marc Aréne , Edward K. Porter

Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions. However, ANNs often suffer from over-parameterization, complicating interpretation and raising uncertainty issues. Bayesian neural…

机器学习 · 统计学 2025-03-14 Eirik Høyheim , Lars Skaaret-Lund , Solve Sæbø , Aliaksandr Hubin

Modeling of conservative systems with neural networks is an area of active research. A popular approach is to use Hamiltonian neural networks (HNNs) which rely on the assumptions that a conservative system is described with Hamilton's…

人工智能 · 计算机科学 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

统计计算 · 统计学 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Artificial neural networks (ANNs) are powerful machine learning methods used in many modern applications such as facial recognition, machine translation, and cancer diagnostics. A common issue with ANNs is that they usually have millions or…

机器学习 · 统计学 2023-05-08 Lars Skaaret-Lund , Geir Storvik , Aliaksandr Hubin

Artificial neural networks (NNs) have become the de facto standard in machine learning. They allow learning highly nonlinear transformations in a plethora of applications. However, NNs usually only provide point estimates without…

机器学习 · 统计学 2020-09-11 Marco F. Huber

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

机器学习 · 计算机科学 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Bayesian neural networks (BNN) can estimate the uncertainty in predictions, as opposed to non-Bayesian neural networks (NNs). However, BNNs have been far less widely used than non-Bayesian NNs in practice since they need iterative NN…

机器学习 · 计算机科学 2022-02-15 Namuk Park , Taekyu Lee , Songkuk Kim

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem…

机器学习 · 计算机科学 2023-01-02 Clara Lucía Galimberti , Luca Furieri , Liang Xu , Giancarlo Ferrari-Trecate

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

统计计算 · 统计学 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

Bayesian Neural Networks (BNNs) extend traditional neural networks to provide uncertainties associated with their outputs. On the forward pass through a BNN, predictions (and their uncertainties) are made either by Monte Carlo sampling…

机器学习 · 计算机科学 2024-10-22 David J. Schodt

We assess the usefulness of gradient-based samplers, such as the No-U-Turn Sampler (NUTS), by comparison with traditional Metropolis-Hastings algorithms, in tomographic $3 \times 2$ point analyses. Specifically, we use the DES Year 1 data…

天体物理仪器与方法 · 物理学 2024-06-10 Arrykrishna Mootoovaloo , Jaime Ruiz-Zapatero , Carlos García-García , David Alonso

With the recently increased interest in probabilistic models, the efficiency of an underlying sampler becomes a crucial consideration. Hamiltonian Monte Carlo (HMC) is one popular option for models of this kind. Performance of the method,…

Deep learning (DL)-based methods have achieved state-of-the-art performance for many medical image segmentation tasks. Nevertheless, recent studies show that deep neural networks (DNNs) can be miscalibrated and overconfident, leading to…

图像与视频处理 · 电气工程与系统科学 2024-06-28 Yidong Zhao , Joao Tourais , Iain Pierce , Christian Nitsche , Thomas A. Treibel , Sebastian Weingärtner , Artur M. Schweidtmann , Qian Tao

Hamiltonian Monte Carlo (HMC) is a premier Markov Chain Monte Carlo (MCMC) algorithm for continuous target distributions. Its full potential can only be unleashed when its problem-dependent hyperparameters are tuned well. The adaptation of…

统计计算 · 统计学 2022-05-10 Pavel Sountsov , Matt D. Hoffman

Hamiltonian Monte Carlo (HMC) sampling methods provide a mechanism for defining distant proposals with high acceptance probabilities in a Metropolis-Hastings framework, enabling more efficient exploration of the state space than standard…

统计方法学 · 统计学 2014-05-13 Tianqi Chen , Emily B. Fox , Carlos Guestrin

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

机器学习 · 统计学 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang