English
Related papers

Related papers: Information-theoretic limits of Bayesian network s…

200 papers

We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint-based methods are one of the main approaches for solving this problem, but the…

Machine Learning · Computer Science 2021-10-26 Sina Akbari , Ehsan Mokhtarian , AmirEmad Ghassami , Negar Kiyavash

Building on the framework introduced by Xu and Raginksy [1] for supervised learning problems, we study the best achievable performance for model-based Bayesian reinforcement learning problems. With this purpose, we define minimum Bayesian…

Machine Learning · Computer Science 2022-07-19 Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

Learning from data that contain missing values represents a common phenomenon in many domains. Relatively few Bayesian Network structure learning algorithms account for missing data, and those that do tend to rely on standard approaches…

Machine Learning · Computer Science 2022-05-23 Yang Liu , Anthony C. Constantinou

A representation of the cause-effect mechanism is needed to enable artificial intelligence to represent how the world works. Bayesian Networks (BNs) have proven to be an effective and versatile tool for this task. BNs require constructing a…

Artificial Intelligence · Computer Science 2026-03-18 Joverlyn Gaudillo , Nicole Astrologo , Fabio Stella , Enzo Acerbi , Francesco Canonaco

We study the problem of learning Bayesian network structures from data. We develop an algorithm for finding the k-best Bayesian network structures. We propose to compute the posterior probabilities of hypotheses of interest by Bayesian…

Machine Learning · Computer Science 2012-03-19 Jin Tian , Ru He , Lavanya Ram

We consider a non-projective class of inhomogeneous random graph models with interpretable parameters and a number of interesting asymptotic properties. Using the results of Bollob\'as et al. [2007], we show that i) the class of models is…

Machine Learning · Statistics 2018-10-04 Juho Lee , Lancelot F. James , Seungjin Choi , François Caron

Structural learning of Bayesian Networks (BNs) is a NP-hard problem, which is further complicated by many theoretical issues, such as the I-equivalence among different structures. In this work, we focus on a specific subclass of BNs, named…

Machine Learning · Computer Science 2018-10-24 Daniele Ramazzotti , Marco S. Nobile , Marco Antoniotti , Alex Graudenzi

It has been shown both experimentally and theoretically that sparse signal recovery can be significantly improved given that part of the signal's support is known \emph{a priori}. In practice, however, such prior knowledge is usually…

Information Theory · Computer Science 2014-10-21 Jun Fang , Yanning Shen , Fuwei Li , Hongbin Li

The motivation for this paper is to apply Bayesian structure learning using Model Averaging in large-scale networks. Currently, Bayesian model averaging algorithm is applicable to networks with only tens of variables, restrained by its…

Machine Learning · Computer Science 2012-10-19 Yang Lu , Mengying Wang , Menglu Li , Qili Zhu , Bo Yuan

The form of the primordial power spectrum has the potential to differentiate strongly between competing models of perturbation generation in the early universe and so is of considerable importance. The recent release of five years of WMAP…

Astrophysics · Physics 2015-05-13 M. Bridges , F. Feroz , M. P. Hobson , A. N. Lasenby

Continuous-time Bayesian networks (CTBNs) constitute a general and powerful framework for modeling continuous-time stochastic processes on networks. This makes them particularly attractive for learning the directed structures among…

Machine Learning · Statistics 2018-10-15 Dominik Linzner , Heinz Koeppl

We present a unifying picture of PAC-Bayesian and mutual information-based upper bounds on the generalization error of randomized learning algorithms. As we show, Tong Zhang's information exponential inequality (IEI) gives a general recipe…

Machine Learning · Computer Science 2021-10-26 Pradeep Kr. Banerjee , Guido Montúfar

A Bayesian network is a directed acyclic graph that represents statistical dependencies between variables of a joint probability distribution. A fundamental task in data science is to learn a Bayesian network from observed data.…

Data Structures and Algorithms · Computer Science 2021-05-21 Niels Grüttemeier , Christian Komusiewicz , Nils Morawietz

Structured sparsity has recently emerged in statistics, machine learning and signal processing as a promising paradigm for learning in high-dimensional settings. All existing methods for learning under the assumption of structured sparsity…

Machine Learning · Statistics 2015-09-16 Nino Shervashidze , Francis Bach

Bayesian approaches for learning deep neural networks (BNN) have been received much attention and successfully applied to various applications. Particularly, BNNs have the merit of having better generalization ability as well as better…

Machine Learning · Statistics 2023-05-25 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Gyuseung Baek , Yongdai Kim

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

Random network models, constrained to reproduce specific statistical features, are often used to represent and analyze network data and their mathematical descriptions. Chief among them, the configuration model constrains random networks by…

Social and Information Networks · Computer Science 2025-01-28 Laurent Hébert-Dufresne , Jean-Gabriel Young , Alexander Daniels , Alec Kirkley , Antoine Allard

Estimating dependence relationships between variables is a crucial issue in many applied domains, such as medicine, social sciences and psychology. When several variables are entertained, these can be organized into a network which encodes…

Methodology · Statistics 2025-01-01 Federico Castelletti

There is increasing interest in learning how human brain networks vary as a function of a continuous trait, but flexible and efficient procedures to accomplish this goal are limited. We develop a Bayesian semiparametric model, which…

Methodology · Statistics 2017-02-02 Lu Wang , Daniele Durante , Rex E. Jung , David B. Dunson

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik