English
Related papers

Related papers: Learning Bayesian Nets that Perform Well

200 papers

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic…

Machine Learning · Computer Science 2023-10-16 Yilin Lyu , Liyuan Wang , Xingxing Zhang , Zicheng Sun , Hang Su , Jun Zhu , Liping Jing

Suppose that multiple experts (or learning algorithms) provide us with alternative Bayesian network (BN) structures over a domain, and that we are interested in combining them into a single consensus BN structure. Specifically, we are…

Machine Learning · Statistics 2015-03-17 Jose M. Peña

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

Bayesian networks (BN) are directed acyclic graphical (DAG) models that have been adopted into many fields for their strengths in transparency, interpretability, probabilistic reasoning, and causal modeling. Given a set of data, one hurdle…

Artificial Intelligence · Computer Science 2023-05-19 Christian D. Blakely

Bayesian optimization is a powerful framework for optimizing functions that are expensive or time-consuming to evaluate. Recent work has considered Bayesian optimization of function networks (BOFN), where the objective function is given by…

It is known that describing or calculating the conditional probabilities of multiple events is exponentially expensive. In this work, Bayesian tensor network (BTN) is proposed to efficiently capture the conditional probabilities of multiple…

Machine Learning · Statistics 2020-01-08 Shi-Ju Ran

We study the problem of certifying the robustness of Bayesian neural networks (BNNs) to adversarial input perturbations. Given a compact set of input points $T \subseteq \mathbb{R}^m$ and a set of output points $S \subseteq \mathbb{R}^n$,…

Machine Learning · Computer Science 2023-06-26 Matthew Wicker , Andrea Patane , Luca Laurenti , Marta Kwiatkowska

The problem of state estimation for unobservable distribution systems is considered. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning of…

Machine Learning · Statistics 2019-02-26 Kursat Rasim Mestav , Jaime Luengo-Rozas , Lang Tong

Traditional deep neural nets (NNs) have shown the state-of-the-art performance in the task of classification in various applications. However, NNs have not considered any types of uncertainty associated with the class probabilities to…

Machine Learning · Computer Science 2019-10-16 Xujiang Zhao , Yuzhe Ou , Lance Kaplan , Feng Chen , Jin-Hee Cho

Finding the most probable explanation for observed variables in a Bayesian network is a notoriously intractable problem, particularly if there are hidden variables in the network. In this paper we examine the complexity of a related…

Computational Complexity · Computer Science 2018-12-12 Johan Kwisthout

Bayesian networks (BNs) are a widely used graphical model in machine learning for representing knowledge with uncertainty. The mainstream BN structure learning methods require performing a large number of conditional independence (CI)…

Machine Learning · Computer Science 2022-12-09 Jiantong Jiang , Zeyi Wen , Ajmal Mian

Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought…

Methodology · Statistics 2024-03-04 Larissa N. A. Martins , Flávio B. Gonçalves , Thais P. Galletti

In this paper, we present a guide to the foundations of learning Dynamic Bayesian Networks (DBNs) from data in the form of multiple samples of trajectories for some length of time. We present the formalism for a generic as well as a set of…

Machine Learning · Computer Science 2024-09-02 Vyacheslav Kungurtsev , Fadwa Idlahcen , Petr Rysavy , Pavel Rytir , Ales Wodecki

In this paper, we provide new complexity results for algorithms that learn discrete-variable Bayesian networks from data. Our results apply whenever the learning algorithm uses a scoring criterion that favors the simplest model able to…

Machine Learning · Computer Science 2012-12-12 David Maxwell Chickering , Christopher Meek , David Heckerman

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Recently several researchers have investigated techniques for using data to learn Bayesian networks containing compact representations for the conditional probability distributions (CPDs) stored at each node. The majority of this work has…

Machine Learning · Computer Science 2015-05-19 David Maxwell Chickering , David Heckerman , Christopher Meek

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

Machine Learning · Computer Science 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik