English
Related papers

Related papers: Testing Sparsity Assumptions in Bayesian Networks

200 papers

We evaluate the uncertainty quality in neural networks using anomaly detection. We extract uncertainty measures (e.g. entropy) from the predictions of candidate models, use those measures as features for an anomaly detector, and gauge how…

Machine Learning · Statistics 2016-12-26 Ramon Oliveira , Pedro Tabacof , Eduardo Valle

Bayesian graphical models are powerful tools to infer complex relationships in high dimension, yet are often fraught with computational and statistical challenges. If exploited in a principled way, the increasing information collected…

Methodology · Statistics 2024-03-15 Xiaoyue Xi , Hélène Ruffieux

Searching the complete space of possible Bayesian networks is intractable for problems of interesting size, so Bayesian network structure learning algorithms, such as the commonly used Sparse Candidate algorithm, employ heuristics. However,…

Artificial Intelligence · Computer Science 2012-06-26 Eric Lantz , Soumya Ray , David Page

Probabilistic graphical models (PGMs) provide a compact and flexible framework to model very complex real-life phenomena. They combine the probability theory which deals with uncertainty and logical structure represented by a graph which…

Machine Learning · Statistics 2023-02-01 Maryia Shpak

Gaussian graphical models are widely used to infer dependence structures. Bayesian methods are appealing to quantify uncertainty associated with structural learning, i.e., the plausibility of conditional independence statements given the…

Methodology · Statistics 2025-11-05 Deborah Sulem , Jack Jewson , David Rossell

One of the most challenging tasks when adopting Bayesian Networks (BNs) is the one of learning their structure from data. This task is complicated by the huge search space of possible solutions, and by the fact that the problem is NP-hard.…

Machine Learning · Computer Science 2018-08-07 Stefano Beretta , Mauro Castelli , Ivo Goncalves , Roberto Henriques , Daniele Ramazzotti

Learning the directed acyclic graph (DAG) structure of a Bayesian network from observational data is a notoriously difficult problem for which many hardness results are known. In this paper we propose a provably polynomial-time algorithm…

Machine Learning · Computer Science 2019-06-04 Asish Ghoshal , Jean Honorio

One of the goals of current particle physics research is to obtain evidence for new physics, that is, physics beyond the Standard Model (BSM), at accelerators such as the Large Hadron Collider (LHC) at CERN. The searches for new physics are…

High Energy Physics - Phenomenology · Physics 2022-07-12 Braden Kronheim , Michelle Kuchera , Harrison Prosper , Alexander Karbo

Bayesian approaches to learn the graphical structure of Bayesian Belief Networks (BBNs) from databases share the assumption that the database is complete, that is, no entry is reported as unknown. Attempts to relax this assumption involve…

Artificial Intelligence · Computer Science 2013-02-08 Marco Ramoni , Paola Sebastiani

Bayesian Networks (BNs) are useful tools giving a natural and compact representation of joint probability distributions. In many applications one needs to learn a Bayesian Network (BN) from data. In this context, it is important to…

Machine Learning · Computer Science 2012-07-02 Or Zuk , Shiri Margel , Eytan Domany

We revisit the problem of simultaneously testing the means of $n$ independent normal observations under sparsity. We take a Bayesian approach to this problem by introducing a scale-mixture prior known as the normal-beta prime (NBP) prior.…

Methodology · Statistics 2020-07-29 Ray Bai , Malay Ghosh

Nonlinear system identification is important with a wide range of applications. The typical approaches for nonlinear system identification include Volterra series models, nonlinear autoregressive with exogenous inputs models,…

Systems and Control · Electrical Eng. & Systems 2019-11-28 Hongpeng Zhou , Chahine Ibrahim , Wei Pan

This paper builds on recent developments in Bayesian network (BN) structure learning under the controversial assumption that the input variables are dependent. This assumption can be viewed as a learning constraint geared towards cases…

Machine Learning · Computer Science 2020-06-08 Anthony Constantinou

Bayesian Networks (BNs) represent conditional probability relations among a set of random variables (nodes) in the form of a directed acyclic graph (DAG), and have found diverse applications in knowledge discovery. We study the problem of…

Optimization and Control · Mathematics 2022-05-10 Simge Kucukyavuz , Ali Shojaie , Hasan Manzour , Linchuan Wei , Hao-Hsiang Wu

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane

We show that training a deep network using batch normalization is equivalent to approximate inference in Bayesian models. We further demonstrate that this finding allows us to make meaningful estimates of the model uncertainty using…

Machine Learning · Statistics 2018-07-17 Mattias Teye , Hossein Azizpour , Kevin Smith

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

Gaussian Bayesian networks (a.k.a. linear Gaussian structural equation models) are widely used to model causal interactions among continuous variables. In this work, we study the problem of learning a fixed-structure Gaussian Bayesian…

Data Structures and Algorithms · Computer Science 2022-10-19 Arnab Bhattacharyya , Davin Choo , Rishikesh Gajjala , Sutanu Gayen , Yuhao Wang

Despite the dominant role of deep models in machine learning, limitations persist, including overconfident predictions, susceptibility to adversarial attacks, and underestimation of variability in predictions. The Bayesian paradigm provides…

Machine Learning · Statistics 2025-06-18 Alisa Sheinkman , Sara Wade

Bayesian network structure learning is often performed in a Bayesian setting, by evaluating candidate structures using their posterior probabilities for a given data set. Score-based algorithms then use those posterior probabilities as an…

Machine Learning · Statistics 2017-03-14 Marco Scutari