English
Related papers

Related papers: Non-parametric Bayesian modeling of complex networ…

200 papers

We show that training a deep network using batch normalization is equivalent to approximate inference in Bayesian models. We further demonstrate that this finding allows us to make meaningful estimates of the model uncertainty using…

Machine Learning · Statistics 2018-07-17 Mattias Teye , Hossein Azizpour , Kevin Smith

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

A common problem in natural sciences is the comparison of competing models in the light of observed data. Bayesian model comparison provides a statistically sound framework for this comparison based on the evidence each model provides for…

Machine Learning · Statistics 2022-03-23 Jan Boelts

We develop a scalable multi-step Monte Carlo algorithm for inference under a large class of nonparametric Bayesian models for clustering and classification. Each step is "embarrassingly parallel" and can be implemented using the same Markov…

Computation · Statistics 2018-06-08 Yang Ni , Peter Müller , Maurice Diesendruck , Sinead Williamson , Yitan Zhu , Yuan Ji

We propose a method for learning Markov network structures for continuous data without invoking any assumptions about the distribution of the variables. The method makes use of previous work on a non-parametric estimator for mutual…

Machine Learning · Computer Science 2017-08-09 Janne Leppä-aho , Santeri Räisänen , Xiao Yang , Teemu Roos

This paper uses Gaussian mixture model instead of linear Gaussian model to fit the distribution of every node in Bayesian network. We will explain why and how we use Gaussian mixture models in Bayesian network. Meanwhile we propose a new…

Machine Learning · Statistics 2022-05-17 Yiran Dong , Chuanhou Gao

In this paper we propose a Bayesian nonparametric approach to modelling sparse time-varying networks. A positive parameter is associated to each node of a network, which models the sociability of that node. Sociabilities are assumed to…

Machine Learning · Statistics 2022-04-18 Cian Naik , Francois Caron , Judith Rousseau , Yee Whye Teh , Konstantina Palla

This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network…

Machine Learning · Computer Science 2013-09-27 Yonatan Halpern , David Sontag

Mathematical models are invaluable for understanding and predicting how biological systems behave, although their construction requires specifying mechanisms and relationships that are often not perfectly known. In the presence of multiple…

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

Many biological networks include cyclic structures. In such cases, Bayesian networks (BNs), which must be acyclic, are not sound models for structure learning. Dynamic BNs can be used but require relatively large time series data. We…

Methodology · Statistics 2020-02-18 Witold Wiecek , Frederic Y. Bois , Ghislaine Gayraud

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Bayesian approaches to learn the graphical structure of Bayesian Belief Networks (BBNs) from databases share the assumption that the database is complete, that is, no entry is reported as unknown. Attempts to relax this assumption involve…

Artificial Intelligence · Computer Science 2013-02-08 Marco Ramoni , Paola Sebastiani

Scale-free networks play a fundamental role in the study of complex networks and various applied fields due to their ability to model a wide range of real-world systems. A key characteristic of these networks is their degree distribution,…

Physics and Society · Physics 2025-01-14 Nixon Jerez-Lillo , Francisco A. Rodrigues , Paulo H. Ferreira , Pedro L. Ramos

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

In many networks, including networks of protein-protein interactions, interdisciplinary collaboration networks, and semantic networks, connections are established between nodes with complementary rather than similar properties. While…

Physics and Society · Physics 2023-03-08 Gabriel Budel , Maksim Kitsak

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

The structure of a Bayesian network encodes most of the information about the probability distribution of the data, which is uniquely identified given some general distributional assumptions. Therefore it's important to study the…

Methodology · Statistics 2014-10-15 Marco Scutari

In this paper, we show how a complete and exact Bayesian analysis of a parametric mixture model is possible in some cases when components of the mixture are taken from exponential families and when conjugate priors are used. This restricted…

Computation · Statistics 2010-11-01 Christian P. Robert , Kerrie L. Mengersen