English
Related papers

Related papers: Improving predictions of Bayesian neural nets via …

200 papers

This paper introduces General Proximal Flow Networks (GPFNs), a generalization of Bayesian Flow Networks that broadens the class of admissible belief-update operators. In Bayesian Flow Networks, each update step is a Bayesian posterior…

Machine Learning · Computer Science 2026-03-03 Alexander Strunk , Roland Assam

Graph Neural Networks (GNNs) have achieved impressive performance in collaborative filtering. However, GNNs tend to yield inferior performance when the distributions of training and test data are not aligned well. Also, training GNNs…

Machine Learning · Computer Science 2023-07-19 Huiyuan Chen , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Junpeng Wang , Vivian Lai , Mahashweta Das , Hao Yang

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

We introduce a new computational framework for estimating parameters in generalized generalized linear models (GGLM), a class of models that extends the popular generalized linear models (GLM) to account for dependencies among observations…

Methodology · Statistics 2023-04-28 Anatoli Juditsky , Arkadi Nemirovski , Yao Xie , Chen Xu

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent…

Machine Learning · Computer Science 2020-11-19 Miles Cranmer , Alvaro Sanchez-Gonzalez , Peter Battaglia , Rui Xu , Kyle Cranmer , David Spergel , Shirley Ho

Gaussian Process (GP) Variational Autoencoders (VAEs) extend standard VAEs by replacing the fully factorised Gaussian prior with a GP prior, thereby capturing richer correlations among latent variables. However, performing exact GP…

Machine Learning · Computer Science 2025-08-18 Xinxing Shi , Xiaoyu Jiang , Mauricio A. Álvarez

Explaining the foundations for predictions obtained from graph neural networks (GNNs) is critical for credible use of GNN models for real-world problems. Owing to the rapid growth of GNN applications, recent progress in explaining…

Machine Learning · Computer Science 2025-01-07 Hyeoncheol Cho , Youngrock Oh , Eunjoo Jeon

Generalized linear models (GLM) are link function based statistical models. Many supervised learning algorithms are extensions of GLMs and have link functions built into the algorithm to model different outcome distributions. There are two…

Methodology · Statistics 2019-05-02 Colleen M. Farrelly , Srikanth Namuduri , Uchenna Chukwu

Generalized Linear Model (or GLM) extends the ordinary linear regression by linking the mean of the response variable to covariates through appropriate link functions. GLM is widely used in the analysis of datasets arising from diverse…

Methodology · Statistics 2026-04-28 Mayukh Choudhury , Debraj Das

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

All discretized numerical models contain modelling errors - this reality is amplified when reduced-order models are used. The ability to accurately approximate modelling errors informs statistics on model confidence and improves…

Computational Physics · Physics 2021-03-17 Danny Smyl , Tyler N. Tallman , Jonathan A. Black , Andreas Hauptmann , Dong Liu

We introduce a novel training principle for probabilistic models that is an alternative to maximum likelihood. The proposed Generative Stochastic Networks (GSN) framework is based on learning the transition operator of a Markov chain whose…

Machine Learning · Computer Science 2015-03-29 Guillaume Alain , Yoshua Bengio , Li Yao , Jason Yosinski , Eric Thibodeau-Laufer , Saizheng Zhang , Pascal Vincent

Bayesian neural networks often approximate the weight-posterior with a Gaussian distribution. However, practical posteriors are often, even locally, highly non-Gaussian, and empirical performance deteriorates. We propose a simple parametric…

Machine Learning · Statistics 2023-06-13 Federico Bergamin , Pablo Moreno-Muñoz , Søren Hauberg , Georgios Arvanitidis

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-network weights. The…

Machine Learning · Statistics 2021-07-21 Ali Unlu , Laurence Aitchison

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-network weights. The…

Machine Learning · Statistics 2021-08-11 Ali Unlu , Laurence Aitchison

Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate…

Machine Learning · Computer Science 2022-03-16 Jonathan Klimesch , Philipp Holl , Nils Thuerey

This paper deals with surrogate modelling of a computer code output in a hierarchical multi-fidelity context, i.e., when the output can be evaluated at different levels of accuracy and computational cost. Using observations of the output at…

Statistics Theory · Mathematics 2023-12-06 Baptiste Kerleguer , Claire Cannamela , Josselin Garnier

Bayesian inference is used extensively to quantify the uncertainty in an inferred field given the measurement of a related field when the two are linked by a mathematical model. Despite its many applications, Bayesian inference faces…

Machine Learning · Statistics 2020-03-31 Dhruv V. Patel , Assad A. Oberai