English
Related papers

Related papers: Testing Sparsity Assumptions in Bayesian Networks

200 papers

In this study, a Bayesian Network (BN) is considered to represent a nuclear plant mechanical system degradation. It describes a causal representation of the phenomena involved in the degradation process. Inference from such a BN needs to…

Methodology · Statistics 2009-05-19 Gilles Celeux , Franck Corset , A. Lannoy , Benoit Ricard

This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification…

Systems and Control · Electrical Eng. & Systems 2022-06-02 Hongpeng Zhou , Chahine Ibrahim , Wei Xing Zheng , Wei Pan

Discovering and parameterising latent confounders represent important and challenging problems in causal structure learning and density estimation respectively. In this paper, we focus on both discovering and learning the distribution of…

Machine Learning · Computer Science 2022-08-23 Kiattikun Chobtham , Anthony C. Constantinou

The explainability of Graph Neural Networks (GNNs) is critical to various GNN applications, yet it remains a significant challenge. A convincing explanation should be both necessary and sufficient simultaneously. However, existing GNN…

Machine Learning · Computer Science 2024-12-31 Ruichu Cai , Yuxuan Zhu , Xuexin Chen , Yuan Fang , Min Wu , Jie Qiao , Zhifeng Hao

We study Bayesian hypernetworks: a framework for approximate Bayesian inference in neural networks. A Bayesian hypernetwork $\h$ is a neural network which learns to transform a simple noise distribution, $p(\vec\epsilon) = \N(\vec 0,\mat…

Machine Learning · Statistics 2018-04-26 David Krueger , Chin-Wei Huang , Riashat Islam , Ryan Turner , Alexandre Lacoste , Aaron Courville

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker

An algorithm for automated construction of a sparse Bayesian network given an unstructured probabilistic model and causal domain information from an expert has been developed and implemented. The goal is to obtain a network that explicitly…

Artificial Intelligence · Computer Science 2013-04-08 Sampath Srinivas , Stuart Russell , Alice M. Agogino

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to score-based structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent…

Machine Learning · Computer Science 2015-05-13 Eliot Brenner , David Sontag

This paper studies large sample properties of a Bayesian approach to inference about slope parameters $\gamma$ in linear regression models with a structural break. In contrast to the conventional approach to inference about $\gamma$ that…

Econometrics · Economics 2023-08-15 Kenichi Shimizu

Bayesian networks (BN) are used in a big range of applications but they have one issue concerning parameter learning. In real application, training data are always incomplete or some nodes are hidden. To deal with this problem many learning…

Artificial Intelligence · Computer Science 2012-04-12 Fradj Ben Lamine , Karim Kalti , Mohamed Ali Mahjoub

We investigate the parameterized complexity of Bayesian Network Structure Learning (BNSL), a classical problem that has received significant attention in empirical but also purely theoretical studies. We follow up on previous works that…

Data Structures and Algorithms · Computer Science 2026-02-12 Robert Ganian , Viktoriia Korchemna

Bayesian classifiers perform well when each of the features is completely independent of the other which is not always valid in real world application. The aim of this study is to implement and compare the performances of each variant of…

Machine Learning · Computer Science 2023-08-24 Tosin Ige , Christopher Kiekintveld

Modeling the associations between real world entities from their multivariate cross-sectional profiles can provide cues into the concerted working of these entities as a system. Several techniques have been proposed for deciphering these…

Machine Learning · Computer Science 2025-01-07 Radha Nagarajan , Marco Scutari

In this paper, we present an infinite hierarchical non-parametric Bayesian model to extract the hidden factors over observed data, where the number of hidden factors for each layer is unknown and can be potentially infinite. Moreover, the…

Machine Learning · Computer Science 2014-10-27 Erte Pan , Zhu Han

Bayesian networks (BNs) are graphical models that are useful for representing high-dimensional probability distributions. There has been a great deal of interest in recent years in the NP-hard problem of learning the structure of a BN from…

Machine Learning · Statistics 2016-10-04 D. Jennings , J. N. Corcoran

As data size and computing power increase, the architectures of deep neural networks (DNNs) have been getting more complex and huge, and thus there is a growing need to simplify such complex and huge DNNs. In this paper, we propose a novel…

Machine Learning · Statistics 2023-05-24 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Yongdai Kim

Background: Bayesian Networks (BNs) are probabilistic graphical models that leverage Bayes' theorem to portray dependencies and cause-and-effect relationships between variables. These networks have gained prominence in the field of health…

Learning the structure of Bayesian networks (BNs) from data is challenging, especially for datasets involving a large number of variables. The recently proposed divide-and-conquer (D\&D) strategies present a promising approach for learning…

Machine Learning · Computer Science 2025-07-01 Shengcai Liu , Hui Ou-yang , Zhiyuan Wang , Cheng Chen , Qijun Cai , Yew-Soon Ong , Ke Tang

Structure learning is essential for Bayesian networks (BNs) as it uncovers causal relationships, and enables knowledge discovery, predictions, inferences, and decision-making under uncertainty. Two novel algorithms, FSBN and SSBN, based on…

Machine Learning · Computer Science 2023-10-16 Minn Sein , Fu Shunkai

Bayesian neural networks (BNNs) offer a natural probabilistic formulation for inference in deep learning models. Despite their popularity, their optimality has received limited attention through the lens of statistical decision theory. In…

Statistics Theory · Mathematics 2026-04-07 Daniel Andrew Coulson , Martin T. Wells