English
Related papers

Related papers: SparsityBoost: A New Scoring Function for Learning…

200 papers

To learn (statistical) dependencies among random variables requires exponentially large sample size in the number of observed random variables if any arbitrary joint probability distribution can occur. We consider the case that sparse data…

Machine Learning · Computer Science 2007-05-23 Dominik Janzing , Daniel Herrmann

Bayesian network structure learning is often performed in a Bayesian setting, evaluating candidate structures using their posterior probabilities for a given data set. Score-based algorithms then use those posterior probabilities as an…

Machine Learning · Statistics 2017-04-14 Marco Scutari

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework.…

Machine Learning · Statistics 2018-09-14 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Guy Koren , Gal Novik

Approaches to learning Bayesian networks from data typically combine a scoring function with a heuristic search procedure. Given a Bayesian network structure, many of the scoring functions derived in the literature return a score for the…

Artificial Intelligence · Computer Science 2013-02-18 David Maxwell Chickering

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane

Given data sampled from a number of variables, one is often interested in the underlying causal relationships in the form of a directed acyclic graph. In the general case, without interventions on some of the variables it is only possible…

Machine Learning · Statistics 2017-12-05 Christopher Nowzohour , Peter Bühlmann

We introduce a principled approach for unsupervised structure learning of deep neural networks. We propose a new interpretation for depth and inter-layer connectivity where conditional independencies in the input distribution are encoded…

Machine Learning · Statistics 2018-10-18 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Guy Koren , Gal Novik

For decomposable score-based structure learning of Bayesian networks, existing approaches first compute a collection of candidate parent sets for each variable and then optimize over this collection by choosing one parent set for each…

Artificial Intelligence · Computer Science 2017-07-20 Cassio P. de Campos , Mauro Scanagatta , Giorgio Corani , Marco Zaffalon

Probabilistic circuits (PCs) are a prominent representation of probability distributions with tractable inference. While parameter learning in PCs is rigorously studied, structure learning is often more based on heuristics than on…

Machine Learning · Computer Science 2023-02-24 Yang Yang , Gennaro Gala , Robert Peharz

Gaussian graphical models are widely used to infer dependence structures. Bayesian methods are appealing to quantify uncertainty associated with structural learning, i.e., the plausibility of conditional independence statements given the…

Methodology · Statistics 2025-11-05 Deborah Sulem , Jack Jewson , David Rossell

Probabilistic graphical models (PGMs) provide a compact and flexible framework to model very complex real-life phenomena. They combine the probability theory which deals with uncertainty and logical structure represented by a graph which…

Machine Learning · Statistics 2023-02-01 Maryia Shpak

Learning a Bayesian network structure from data is an NP-hard problem and thus exact algorithms are feasible only for small data sets. Therefore, network structures for larger networks are usually learned with various heuristics. Another…

Machine Learning · Computer Science 2012-10-19 Teppo Niinimaki , Pekka Parviainen

Several structure learning algorithms have been proposed towards discovering causal or Bayesian Network (BN) graphs. The validity of these algorithms tends to be evaluated by assessing the relationship between the learnt and the ground…

Machine Learning · Computer Science 2020-09-03 Anthony C. Constantinou

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

Data Structures and Algorithms · Computer Science 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

We present a hybrid constraint-based/Bayesian algorithm for learning causal networks in the presence of sparse data. The algorithm searches the space of equivalence classes of models (essential graphs) using a heuristic based on…

Artificial Intelligence · Computer Science 2013-01-30 Denver Dash , Marek J. Druzdzel

In Bayesian Networks (BNs), the direction of edges is crucial for causal reasoning and inference. However, Markov equivalence class considerations mean it is not always possible to establish edge orientations, which is why many BN structure…

Machine Learning · Computer Science 2022-10-19 Kiattikun Chobtham , Anthony C. Constantinou , Neville K. Kitson

In literature there are several studies on the performance of Bayesian network structure learning algorithms. The focus of these studies is almost always the heuristics the learning algorithms are based on, i.e. the maximisation algorithms…

Machine Learning · Statistics 2012-08-28 Marco Scutari , Adriana Brogini

There is an obvious need for improving the performance and accuracy of a Bayesian network as new data is observed. Because of errors in model construction and changes in the dynamics of the domains, we cannot afford to ignore the…

Artificial Intelligence · Computer Science 2013-02-08 Nir Friedman , Moises Goldszmidt

A classic approach for learning Bayesian networks from data is to identify a maximum a posteriori (MAP) network structure. In the case of discrete Bayesian networks, MAP networks are selected by maximising one of several possible Bayesian…

Statistics Theory · Mathematics 2018-12-13 Marco Scutari