English
Related papers

Related papers: A new parameter Learning Method for Bayesian Netwo…

200 papers

In a Bayesian context, theoretical parameters are correlated random variables. Then, the constraints on one parameter can be improved by either measuring this parameter more precisely - or by measuring the other parameters more precisely.…

Cosmology and Nongalactic Astrophysics · Physics 2016-02-17 L. Amendola , E. Sellentin

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

The continuous-time Bayesian networks (CTBNs) represent a class of stochastic processes, which can be used to model complex phenomena, for instance, they can describe interactions occurring in living processes, in social science models or…

Machine Learning · Statistics 2020-06-16 Maryia Shpak , Błażej Miasojedow , Wojciech Rejchel

Adding domain knowledge to a learning system is known to improve results. In multi-parameter Bayesian frameworks, such knowledge is incorporated as a prior. On the other hand, various model parameters can have different learning rates in…

Machine Learning · Computer Science 2022-06-22 Sareh Nabi , Houssam Nassif , Joseph Hong , Hamed Mamani , Guido Imbens

It has been argued that in supervised classification tasks, in practice it may be more sensible to perform model selection with respect to some more focused model selection score, like the supervised (conditional) marginal likelihood, than…

Machine Learning · Computer Science 2013-01-14 Petri Kontkanen , Petri Myllymaki , Henry Tirri

We study active structure learning of Bayesian networks in an observational setting, in which there are external limitations on the number of variable values that can be observed from the same sample. Random samples are drawn from the joint…

Machine Learning · Computer Science 2022-08-23 Noa Ben-David , Sivan Sabato

We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework.…

Machine Learning · Statistics 2018-09-14 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Guy Koren , Gal Novik

We present a new method to propagate lower bounds on conditional probability distributions in conventional Bayesian networks. Our method guarantees to provide outer approximations of the exact lower bounds. A key advantage is that we can…

Artificial Intelligence · Computer Science 2012-05-14 Daniel Andrade , Bernhard Sick

In this paper we examine a novel addition to the known methods for learning Bayesian networks from data that improves the quality of the learned networks. Our approach explicitly represents and learns the local structure in the conditional…

Artificial Intelligence · Computer Science 2013-02-18 Nir Friedman , Moises Goldszmidt

In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth. We do this by learning concrete distributions over these parameters. Our results show that regular…

Machine Learning · Statistics 2019-01-29 Georgi Dikov , Patrick van der Smagt , Justin Bayer

We present a method for learning treewidth-bounded Bayesian networks from data sets containing thousands of variables. Bounding the treewidth of a Bayesian greatly reduces the complexity of inferences. Yet, being a global property of the…

Artificial Intelligence · Computer Science 2016-05-12 Mauro Scanagatta , Giorgio Corani , Cassio P. de Campos , Marco Zaffalon

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning…

Optimization and Control · Mathematics 2025-03-10 Wyame Benslimane , Paul Grigas

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

Machine Learning · Computer Science 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

Computation · Statistics 2019-03-28 Chi Feng , Youssef M. Marzouk

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

This paper studies the problem of recursively estimating the weighted adjacency matrix of a network out of a temporal sequence of binary-valued observations. The observation sequence is generated from nonlinear networked dynamics in which…

Systems and Control · Electrical Eng. & Systems 2019-12-06 Yu Xing , Xingkang He , Haitao Fang , Karl Henrik Johansson

We consider the problem of learning Bayesian network classifiers that maximize the marginover a set of classification variables. We find that this problem is harder for Bayesian networks than for undirected graphical models like maximum…

Machine Learning · Computer Science 2012-07-09 Yuhong Guo , Dana Wilkinson , Dale Schuurmans

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Backpropagation with gradient descent is a common optimization strategy employed by most neural network architectures in machine learning. However, finding optimal hyperparameters to guide training has proven challenging. While it is widely…

Machine Learning · Computer Science 2026-05-20 Vy Bui , Hang Yu , Karthik Kantipudi , Ziv Yaniv , Stefan Jaeger