English
Related papers

Related papers: Estimating Well-Performing Bayesian Networks using…

200 papers

Convolutional neural networks (CNNs) have been established as the main workhorse in image data processing; nonetheless, they require large amounts of data to train, often produce overconfident predictions, and frequently lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Sarah Harkins Dayton , Hayden Everett , Ioannis Schizas , David L. Boothe , Vasileios Maroulas

Bayesian Neural Networks (BNNs) offer robust uncertainty quantification in model predictions, but training them presents a significant computational challenge. This is mainly due to the problem of sampling multimodal posterior distributions…

Machine Learning · Computer Science 2025-01-14 Ratneel Deo , Scott Sisson , Jody M. Webster , Rohitash Chandra

As deep neural networks (DNNs) are applied to increasingly challenging problems, they will need to be able to represent their own uncertainty. Modeling uncertainty is one of the key features of Bayesian methods. Using Bernoulli dropout with…

Machine Learning · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

Correlation Networks (CNs) inherently suffer from redundant information in their network topology. Bayesian Networks (BNs), on the other hand, include only non-redundant information (from a probabilistic perspective) resulting in a sparse…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Catharina Graafland , José M. Gutiérrez , Juan M. López , Diego Pazó , Miguel A. Rodríguez

This paper considers the problem of sequential fusion of predictions from neural networks (NN) and fusion of predictions from multiple NN. This fusion strategy increases the robustness, i.e., reduces the impact of one incorrect…

Signal Processing · Electrical Eng. & Systems 2023-10-13 Magnus Malmström , Isaac Skog , Daniel Axehill , Fredrik Gustafsson

When expert systems based on causal probabilistic networks (CPNs) reach a certain size and complexity, the "combinatorial explosion monster" tends to be present. We propose an approximation scheme that identifies rarely occurring cases and…

Artificial Intelligence · Computer Science 2013-04-05 Frank Jensen , S. K. Anderson

Bayesian network (BN) modelling is extensively used in systems epidemiology. Usually it consists in selecting and reporting the best-fitting structure conditional to the data. A major practical concern is avoiding overfitting, on account of…

Computation · Statistics 2019-02-19 Gilles Kratzer , Reinhard Furrer

Clustering multivariate binary data is of interest in many scientific fields, including ecology, biomedicine, and social policy. Beyond heuristic clustering algorithms, such data can be modelled using multivariate Bernoulli mixture models.…

Methodology · Statistics 2026-04-24 Luisa Ferrari , Maria Franco Villoria , Garritt L. Page , Alex Laini

This paper introduces a novel parameter estimation method for the probability tables of Bayesian network classifiers (BNCs), using hierarchical Dirichlet processes (HDPs). The main result of this paper is to show that improved parameter…

Machine Learning · Computer Science 2018-05-09 Francois Petitjean , Wray Buntine , Geoffrey I. Webb , Nayyar Zaidi

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

Machine Learning · Computer Science 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

Bayesian networks (BNs) are a widely used graphical model in machine learning for representing knowledge with uncertainty. The mainstream BN structure learning methods require performing a large number of conditional independence (CI)…

Machine Learning · Computer Science 2022-12-09 Jiantong Jiang , Zeyi Wen , Ajmal Mian

Bayesian networks (BNs) are graphical \emph{first-order} probabilistic models that allow for a compact representation of large probability distributions, and for efficient inference, both exact and approximate. We introduce a…

Logic in Computer Science · Computer Science 2023-12-12 Claudia Faggian , Daniele Pautasso , Gabriele Vanoni

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

We propose the Bayesian bridge estimator for regularized regression and classification. Two key mixture representations for the Bayesian bridge model are developed: (1) a scale mixture of normals with respect to an alpha-stable random…

Methodology · Statistics 2012-10-30 Nicholas G. Polson , James G. Scott , Jesse Windle

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

Bayesian Neural Networks (BNNs) can overcome the problem of overconfidence that plagues traditional frequentist deep neural networks, and are hence considered to be a key enabler for reliable AI systems. However, conventional hardware…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Nicolas Skatchkovsky , Osvaldo Simeone , Bipin Rajendran , Bashir M. Al-Hashimi

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Bayesian method is capable of capturing real world uncertainties/incompleteness and properly addressing the over-fitting issue faced by deep neural networks. In recent years, Bayesian Neural Networks (BNNs) have drawn tremendous attentions…

Machine Learning · Computer Science 2020-05-11 Xiaotao Jia , Jianlei Yang , Runze Liu , Xueyan Wang , Sorin Dan Cotofana , Weisheng Zhao

Random graph mixture models are now very popular for modeling real data networks. In these setups, parameter estimation procedures usually rely on variational approximations, either combined with the expectation-maximisation (\textsc{em})…

Statistics Theory · Mathematics 2010-12-09 Christophe Ambroise , Catherine Matias