English
Related papers

Related papers: On Pruning for Score-Based Bayesian Network Struct…

200 papers

Learning the structure of Bayesian networks (BNs) from data is challenging, especially for datasets involving a large number of variables. The recently proposed divide-and-conquer (D\&D) strategies present a promising approach for learning…

Machine Learning · Computer Science 2025-07-01 Shengcai Liu , Hui Ou-yang , Zhiyuan Wang , Cheng Chen , Qijun Cai , Yew-Soon Ong , Ke Tang

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to score-based structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent…

Machine Learning · Computer Science 2015-05-13 Eliot Brenner , David Sontag

It is well known in the literature that the problem of learning the structure of Bayesian networks is very hard to tackle: its computational complexity is super-exponential in the number of nodes in the worst case and polynomial in most…

Computation · Statistics 2017-04-14 Marco Scutari

Dynamic Bayesian networks have been well explored in the literature as discrete-time models: however, their continuous-time extensions have seen comparatively little attention. In this paper, we propose the first constraint-based algorithm…

Artificial Intelligence · Computer Science 2021-06-04 Alessandro Bregoli , Marco Scutari , Fabio Stella

We study the problem of learning a Bayesian network (BN) of a set of variables when structural side information about the system is available. It is well known that learning the structure of a general BN is both computationally and…

Machine Learning · Computer Science 2021-12-22 Ehsan Mokhtarian , Sina Akbari , Fateme Jamshidi , Jalal Etesami , Negar Kiyavash

Recently two search algorithms, A* and breadth-first branch and bound (BFBnB), were developed based on a simple admissible heuristic for learning Bayesian network structures that optimize a scoring function. The heuristic represents a…

Artificial Intelligence · Computer Science 2012-10-19 Changhe Yuan , Brandon Malone

Modern neural networks are often massively overparameterized leading to high compute costs during training and at inference. One effective method to improve both the compute and energy efficiency of neural networks while maintaining good…

Machine Learning · Computer Science 2024-12-23 Dustin Wright , Christian Igel , Raghavendra Selvan

The challenging task of learning structures of probabilistic graphical models is an important problem within modern AI research. Recent years have witnessed several major algorithmic advances in structure learning for Bayesian…

Artificial Intelligence · Computer Science 2016-12-20 James Cussens , Matti Järvisalo , Janne H. Korhonen , Mark Bartlett

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Bayesian structure learning is the NP-hard problem of discovering a Bayesian network that optimally represents a given set of training data. In this paper we study the computational worst-case complexity of exact Bayesian structure learning…

Machine Learning · Computer Science 2012-03-19 Sebastian Ordyniak , Stefan Szeider

The problem of learning discrete Bayesian networks from data is encoded as a weighted MAX-SAT problem and the MaxWalkSat local search algorithm is used to address it. For each dataset, the per-variable summands of the (BDeu) marginal…

Artificial Intelligence · Computer Science 2012-06-18 James Cussens

Pruning is an effective technique for convolutional neural networks (CNNs) model compression, but it is difficult to find the optimal pruning policy due to the large design space. To improve the usability of pruning, many auto pruning…

Machine Learning · Computer Science 2022-07-26 Hanwei Fan , Jiandong Mu , Wei Zhang

Bayesian networks are probabilistic graphical models often used in big data analytics. The problem of exact structure learning is to find a network structure that is optimal under certain scoring criteria. The problem is known to be NP-hard…

Artificial Intelligence · Computer Science 2017-03-22 Subhadeep Karan , Jaroslaw Zola

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

This dissertation investigates integer linear programming (ILP) formulation of Bayesian Network structure learning problem. We review the definition and key properties of Bayesian network and explain score metrics used to measure how well…

Machine Learning · Statistics 2020-07-07 Ronald Seoh

In this paper, we provide new complexity results for algorithms that learn discrete-variable Bayesian networks from data. Our results apply whenever the learning algorithm uses a scoring criterion that favors the simplest model able to…

Machine Learning · Computer Science 2012-12-12 David Maxwell Chickering , Christopher Meek , David Heckerman

In this paper, we consider a score-based Integer Programming (IP) approach for solving the Bayesian Network Structure Learning (BNSL) problem. State-of-the-art BNSL IP formulations suffer from the exponentially large number of variables and…

Machine Learning · Statistics 2025-09-10 Yiran Yang , Rui Chen

We study active structure learning of Bayesian networks in an observational setting, in which there are external limitations on the number of variable values that can be observed from the same sample. Random samples are drawn from the joint…

Machine Learning · Computer Science 2022-08-23 Noa Ben-David , Sivan Sabato

Compression and computational efficiency in deep learning have become a problem of great significance. In this work, we argue that the most principled and effective way to attack this problem is by adopting a Bayesian point of view, where…

Machine Learning · Statistics 2017-11-07 Christos Louizos , Karen Ullrich , Max Welling

This work presents novel algorithms for learning Bayesian network structures with bounded treewidth. Both exact and approximate methods are developed. The exact method combines mixed-integer linear programming formulations for structure…

Artificial Intelligence · Computer Science 2014-06-09 Siqi Nie , Denis Deratani Maua , Cassio Polpo de Campos , Qiang Ji