English
Related papers

Related papers: Adversarial $\alpha$-divergence Minimization for B…

200 papers

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

In Bayesian statistics, the choice of the prior can have an important influence on the posterior and the parameter estimation, especially when few data samples are available. To limit the added subjectivity from a priori information, one…

Methodology · Statistics 2025-12-05 Nils Baillie , Antoine Van Biesbroeck , Clément Gauchy

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

We propose a novel approach to approximate Bayesian computation (ABC) that seeks to cater for possible misspecification of the assumed model. This new approach can be equally applied to rejection-based ABC and to popular regression…

Methodology · Statistics 2020-08-11 David T. Frazier , Christopher Drovandi , Ruben Loaiza-Maya

Robust Bayesian inference is the calculation of posterior probability bounds given perturbations in a probabilistic model. This paper focuses on perturbations that can be expressed locally in Bayesian networks through convex sets of…

Artificial Intelligence · Computer Science 2013-02-08 Fabio Gagliardi Cozman

Backpropagation algorithm is the cornerstone for neural network analysis. Paper extends it for training any derivatives of neural network's output with respect to its input. By the dint of it feedforward networks can be used to solve or…

Neural and Evolutionary Computing · Computer Science 2017-12-13 V. I. Avrutskiy

We develop an iterative framework for Bayesian inference problems where the posterior distribution may involve computationally intensive models, intractable gradients, significant posterior concentration, and pronounced non-Gaussianity. Our…

Computation · Statistics 2026-03-16 Daniel Sharp , Bart van Bloemen Waanders , Youssef Marzouk

We consider Bayesian inference in inverse regression problems where the objective is to infer about unobserved covariates from observed responses and covariates. We establish posterior consistency of such unobserved covariates in Bayesian…

Statistics Theory · Mathematics 2020-05-04 Debashis Chatterjee , Sourabh Bhattacharya

Approximate Bayesian computation (ABC) methods perform inference on model-specific parameters of mechanistically motivated parametric statistical models when evaluating likelihoods is difficult. Central to the success of ABC methods is…

Computation · Statistics 2013-01-29 Erkan O. Buzbas , Noah A. Rosenberg

Artificial neural networks are most commonly trained with the back-propagation algorithm, where the gradient for learning is provided by back-propagating the error, layer by layer, from the output layer to the hidden layers. A recently…

Machine Learning · Statistics 2016-12-22 Arild Nøkland

In this work we consider Bayesian inference problems with intractable likelihood functions. We present a method to compute an approximate of the posterior with a limited number of model simulations. The method features an inverse Gaussian…

Computation · Statistics 2021-02-23 Hongqiao Wang , Ziqiao Ao , Tengchao Yu , Jinglai Li

Approximate Bayesian computation (ABC) is a class of algorithmic methods in Bayesian inference using statistical summaries and computer simulations. ABC has become popular in evolutionary genetics and in other branches of biology. However…

Computation · Statistics 2011-05-03 Olivier Francois , Guillaume Laval

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Approximate Bayesian Computation (ABC) is a popular computational method for likelihood-free Bayesian inference. The term "likelihood-free" refers to problems where the likelihood is intractable to compute or estimate directly, but where it…

Statistics Theory · Mathematics 2014-07-21 Stuart Barber , Jochen Voss , Mark Webster

Neural network pruning is a highly effective technique aimed at reducing the computational and memory demands of large neural networks. In this research paper, we present a novel approach to pruning neural networks utilizing Bayesian…

Machine Learning · Statistics 2023-08-07 Sunil Mathew , Daniel B. Rowe

Bayesian observer and actor models have provided normative explanations for many behavioral phenomena in perception, sensorimotor control, and other areas of cognitive science and neuroscience. They attribute behavioral variability and…

Machine Learning · Computer Science 2025-02-03 Dominik Straub , Tobias F. Niehues , Jan Peters , Constantin A. Rothkopf

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neural networks is…

Machine Learning · Computer Science 2019-07-18 Pavel Izmailov , Wesley J. Maddox , Polina Kirichenko , Timur Garipov , Dmitry Vetrov , Andrew Gordon Wilson

Bayesian statistics has gained popularity in psychological research due to its intuitive uncertainty quantification and convenient information-updating rules. In many applications, however, prior distributions are introduced merely as…

Methodology · Statistics 2026-03-10 Yang Liu , Jonathan P. Williams , Jan Hannig

In the Bayesian approach, the a priori knowledge about the input of a mathematical model is described via a probability measure. The joint distribution of the unknown input and the data is then conditioned, using Bayes' formula, giving rise…

Statistics Theory · Mathematics 2015-06-15 Sebastian J. Vollmer

We present a new approach to the electromagnetic inverse problem that explicitly addresses the ambiguity associated with its ill-posed character. Rather than calculating a single ``best'' solution according to some criterion, our approach…

Neurons and Cognition · Quantitative Biology 2007-05-23 David M. Schmidt , John S. George , C. C. Wood