English
Related papers

Related papers: Entropy-based Pruning for Learning Bayesian Networ…

200 papers

Causal Bayesian networks (CBN) are popular graphical probabilistic models that encode causal relations among variables. Learning their graphical structure from observational data has received a lot of attention in the literature. When there…

Machine Learning · Computer Science 2024-08-22 Christophe Gonzales , Amir-Hosein Valizadeh

Score functions for learning the structure of Bayesian networks in the literature assume that data are a homogeneous set of observations; whereas it is often the case that they comprise different related, but not homogeneous, data sets…

Machine Learning · Statistics 2021-07-20 Laura Azzimonti , Giorgio Corani , Marco Scutari

A Bayesian net (BN) is more than a succinct way to encode a probabilistic distribution; it also corresponds to a function used to answer queries. A BN can therefore be evaluated by the accuracy of the answers it returns. Many algorithms for…

Artificial Intelligence · Computer Science 2013-02-08 Russell Greiner , Adam J. Grove , Dale Schuurmans

Score based learning (SBL) is a promising approach for learning Bayesian networks. The initial step in the majority of the SBL algorithms consists of computing the scores of all possible child and parent-set combinations for the variables.…

Numerical Analysis · Mathematics 2024-10-30 Borzou Alipourfard , Jean X. Gao

Pruning at initialization (PaI) reduces training costs by removing weights before training, which becomes increasingly crucial with the growing network size. However, current PaI methods still have a large accuracy gap with iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Shengkai Liu , Yaofeng Cheng , Fusheng Zha , Wei Guo , Lining Sun , Zhenshan Bing , Chenguang Yang

$n$-gram profiles have been successfully and widely used to analyse long sequences of potentially differing lengths for clustering or classification. Mainly, machine learning algorithms have been used for this purpose but, despite their…

Methodology · Statistics 2024-09-04 José A. Perusquía , Jim E. Griffin , Cristiano Villa

We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework.…

Machine Learning · Statistics 2018-09-14 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Guy Koren , Gal Novik

Automatic assessment of learner competencies is a fundamental task in intelligent tutoring systems. An assessment rubric typically and effectively describes relevant competencies and competence levels. This paper presents an approach to…

Computers and Society · Computer Science 2024-08-05 Francesca Mangili , Giorgia Adorni , Alberto Piatti , Claudio Bonesana , Alessandro Antonucci

A general Bayesian framework for model selection on random network models regarding their features is considered. The goal is to develop a principle Bayesian model selection approach to compare different fittable, not necessarily nested,…

Methodology · Statistics 2020-04-30 Papamichalis Marios

We propose a simultaneous learning and pruning algorithm capable of identifying and eliminating irrelevant structures in a neural network during the early stages of training. Thus, the computational cost of subsequent training iterations,…

Machine Learning · Computer Science 2023-01-16 Valentin Frank Ingmar Guenter , Athanasios Sideris

We propose a cooperative coevolutionary genetic algorithm for learning Bayesian network structures from fully observable data sets. Since this problem can be decomposed into two dependent subproblems, that is to find an ordering of the…

Neural and Evolutionary Computing · Computer Science 2013-05-29 Arthur Carvalho

Data sets are growing in complexity thanks to the increasing facilities we have nowadays to both generate and store data. This poses many challenges to machine learning that are leading to the proposal of new methods and paradigms, in order…

Machine Learning · Computer Science 2018-12-04 Irene Córdoba , Concha Bielza , Pedro Larrañaga

We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning…

Machine Learning · Computer Science 2018-02-20 Wenyi Wang , William J. Welch

The efficacy of family-based approaches to mixture model-based clustering and classification depends on the selection of parsimonious models. Current wisdom suggests the Bayesian information criterion (BIC) for mixture model selection.…

Methodology · Statistics 2013-11-12 Sakyajit Bhattacharya , Paul D. McNicholas

This paper considers the problem of removing costly features from a Bayesian network classifier. We want the classifier to be robust to these changes, and maintain its classification behavior. To this end, we propose a closeness metric…

Machine Learning · Computer Science 2018-05-30 YooJung Choi , Guy Van den Broeck

We propose a new method for parameter learning in Bayesian networks with qualitative influences. This method extends our previous work from networks of binary variables to networks of discrete variables with ordered values. The specified…

Artificial Intelligence · Computer Science 2012-06-26 Ad Feelders

This paper analyzes the circumstances under which Bayesian networks can be pruned in order to reduce computational complexity without altering the computation for variables of interest. Given a problem instance which consists of a query and…

Artificial Intelligence · Computer Science 2013-04-05 Michelle Baker , Terrance E. Boult

Bayesian model comparison (BMC) offers a principled approach for assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular…

Machine Learning · Statistics 2023-11-27 Lasse Elsemüller , Martin Schnuerch , Paul-Christian Bürkner , Stefan T. Radev

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman

We extend the Bayesian Information Criterion (BIC), an asymptotic approximation for the marginal likelihood, to Bayesian networks with hidden variables. This approximation can be used to select models given large samples of data. The…

Machine Learning · Computer Science 2015-05-19 Dan Geiger , David Heckerman , Christopher Meek