English
Related papers

Related papers: Beyond Uniform Priors in Bayesian Network Structur…

200 papers

Bayesian neural networks (BNNs) can account for both aleatoric and epistemic uncertainty. However, in BNNs the priors are often specified over the weights which rarely reflects true prior knowledge in large and complex neural network…

Machine Learning · Computer Science 2023-01-25 Vishnu Raj , Tianyu Cui , Markus Heinonen , Pekka Marttinen

The graph structure of a Bayesian network (BN) can be learned from data using the well-known score-and-search approach. Previous work has shown that incorporating structured representations of the conditional probability distributions…

Machine Learning · Computer Science 2022-06-22 Charupriya Sharma , Peter van Beek

We study the problem of learning Bayesian network structures from data. Koivisto and Sood (2004) and Koivisto (2006) presented algorithms that can compute the exact marginal posterior probability of a subnetwork, e.g., a single edge, in…

Machine Learning · Computer Science 2012-05-14 Jin Tian , Ru He

We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posterior of a learning…

Machine Learning · Statistics 2023-01-02 Nicholas Galioto , Alex Gorodetsky

We study the problem of learning the best Bayesian network structure with respect to a decomposable score such as BDe, BIC or AIC. This problem is known to be NP-hard, which means that solving it becomes quickly infeasible as the number of…

Artificial Intelligence · Computer Science 2012-07-02 Tomi Silander , Petri Myllymaki

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

A Bayesian network is a probabilistic graphical model that consists of a directed acyclic graph (DAG), where each node is a random variable and attached to each node is a conditional probability distribution (CPD). A Bayesian network can be…

Machine Learning · Computer Science 2020-11-04 Charupriya Sharma , Zhenyu A. Liao , James Cussens , Peter van Beek

Score-based approaches in the structure learning task are thriving because of their scalability. Continuous relaxation has been the key reason for this advancement. Despite achieving promising outcomes, most of these methods are still…

Machine Learning · Computer Science 2023-09-07 Quang-Duy Tran , Phuoc Nguyen , Bao Duong , Thin Nguyen

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

We introduce a method for the problem of learning the structure of a Bayesian network using the quantum adiabatic algorithm. We do so by introducing an efficient reformulation of a standard posterior-probability scoring function on graphs…

We describe algorithms for learning Bayesian networks from a combination of user knowledge and statistical data. The algorithms have two components: a scoring metric and a search procedure. The scoring metric takes a network structure,…

Artificial Intelligence · Computer Science 2021-06-29 Dan Geiger , David Heckerman

MCMC methods for sampling from the space of DAGs can mix poorly due to the local nature of the proposals that are commonly used. It has been shown that sampling from the space of node orders yields better results [FK03, EW06]. Recently,…

Machine Learning · Computer Science 2012-06-26 Daniel Eaton , Kevin Murphy

The key distinguishing property of a Bayesian approach is marginalization instead of optimization, not the prior, or Bayes rule. Bayesian inference is especially compelling for deep neural networks. (1) Neural networks are typically…

Machine Learning · Computer Science 2020-01-30 Andrew Gordon Wilson

We present a new method to approximate posterior probabilities of Bayesian Network using Deep Neural Network. Experiment results on several public Bayesian Network datasets shows that Deep Neural Network is capable of learning joint…

Machine Learning · Computer Science 2018-01-12 Jie Jia , Honggang Zhou , Yunchun Li

Bayesian Neural Networks (BNNs) provide a probabilistic interpretation for deep learning models by imposing a prior distribution over model parameters and inferring a posterior distribution based on observed data. The model sampled from the…

Machine Learning · Computer Science 2023-11-15 Van-Anh Nguyen , Tung-Long Vuong , Hoang Phan , Thanh-Toan Do , Dinh Phung , Trung Le

Deep neural networks have been successful in diverse discriminative classification tasks, although, they are poorly calibrated often assigning high probability to misclassified predictions. Potential consequences could lead to…

Machine Learning · Statistics 2020-10-06 John Mitros , Arjun Pakrashi , Brian Mac Namee

In a Bayesian network, we wish to evaluate the marginal probability of a query variable, which may be conditioned on the observed values of some evidence variables. Here we first present our "border algorithm," which converts a BN into a…

Artificial Intelligence · Computer Science 2014-11-25 Do Le Paul Minh

Bayesian neural networks (BNNs) have recently gained popularity due to their ability to quantify model uncertainty. However, specifying a prior for BNNs that captures relevant domain knowledge is often extremely challenging. In this work,…

Machine Learning · Computer Science 2024-02-22 Dylan Sam , Rattana Pukdee , Daniel P. Jeong , Yewon Byun , J. Zico Kolter

The fairness of a deep neural network is strongly affected by dataset bias and spurious correlations, both of which are usually present in modern feature-rich and complex visual datasets. Due to the difficulty and variability of the task,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane