English
Related papers

Related papers: Learning networks determined by the ratio of prior…

200 papers

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however,…

High Energy Physics - Phenomenology · Physics 2024-12-11 Shahzar Rizvi , Mariel Pettee , Benjamin Nachman

Discriminating between competing explanatory models as to which is more likely responsible for the growth of a network is a problem of fundamental importance for network science. The rules governing this growth are attributed to mechanisms…

Social and Information Networks · Computer Science 2021-04-21 Naomi A. Arnold , Raul J. Mondragon , Richard G. Clegg

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Traditional approaches to Bayes net structure learning typically assume little regularity in graph structure other than sparseness. However, in many cases, we expect more systematicity: variables in real-world systems often group into…

Machine Learning · Computer Science 2012-07-02 Vikash Mansinghka , Charles Kemp , Thomas Griffiths , Joshua Tenenbaum

Online learning is an inferential paradigm in which parameters are updated incrementally from sequentially available data, in contrast to batch learning, where the entire dataset is processed at once. In this paper, we assume that…

Statistics Theory · Mathematics 2026-02-12 Jeyong Lee , Junhyeok Choi , Minwoo Chae

Bayes nets are extensively used in practice to efficiently represent joint probability distributions over a set of random variables and capture dependency relations. In a seminal paper, Chickering et al. (JMLR 2004) showed that given a…

Machine Learning · Computer Science 2024-08-06 Arnab Bhattacharyya , Davin Choo , Sutanu Gayen , Dimitrios Myrisiotis

The marginal likelihood plays an important role in many areas of Bayesian statistics such as parameter estimation, model comparison, and model averaging. In most applications, however, the marginal likelihood is not analytically tractable…

Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but…

Machine Learning · Computer Science 2026-05-29 Jiaxiang Yi , Miguel A. Bessa

Learning, especially rapid learning, is critical for survival. However, learning is hard: a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, keeping track of…

Neurons and Cognition · Quantitative Biology 2021-03-22 Laurence Aitchison , Jannes Jegminat , Jorge Aurelio Menendez , Jean-Pascal Pfister , Alex Pouget , Peter E. Latham

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

The problem of learning discrete Bayesian networks from data is encoded as a weighted MAX-SAT problem and the MaxWalkSat local search algorithm is used to address it. For each dataset, the per-variable summands of the (BDeu) marginal…

Artificial Intelligence · Computer Science 2012-06-18 James Cussens

Bayesian networks (BNs) are a widely used class of probabilistic graphical models employed in numerous application domains. However, inferring the network's graphical structure from data remains challenging. Bayesian structure learners…

Machine Learning · Computer Science 2025-11-19 William Zhao , Guy Van den Broeck , Benjie Wang

Contemporary machine learning methods will try to approach the Bayes error, as it is the lowest possible error any model can achieve. This paper postulates that any decision is composed of not one but two Bayesian decisions and that…

Machine Learning · Computer Science 2024-10-18 Stefan Jaeger

The results of training a neural network are heavily dependent on the architecture chosen; and even a modification of only its size, however small, typically involves restarting the training process. In contrast to this, we begin training…

Machine Learning · Computer Science 2024-02-12 Rupert Mitchell , Robin Menzenbach , Kristian Kersting , Martin Mundt

In this paper the problem of learning appropriate bias for an environment of related tasks is examined from a Bayesian perspective. The environment of related tasks is shown to be naturally modelled by the concept of an {\em objective}…

Machine Learning · Computer Science 2019-11-15 Jonathan Baxter

Understanding information exchange and aggregation on networks is a central problem in theoretical economics, probability and statistics. We study a standard model of economic agents on the nodes of a social network graph who learn a binary…

Probability · Mathematics 2014-05-01 Elchanan Mossel , Allan Sly , Omer Tamuz

There is increasing interest in learning how human brain networks vary as a function of a continuous trait, but flexible and efficient procedures to accomplish this goal are limited. We develop a Bayesian semiparametric model, which…

Methodology · Statistics 2017-02-02 Lu Wang , Daniele Durante , Rex E. Jung , David B. Dunson

Recently several researchers have investigated techniques for using data to learn Bayesian networks containing compact representations for the conditional probability distributions (CPDs) stored at each node. The majority of this work has…

Machine Learning · Computer Science 2015-05-19 David Maxwell Chickering , David Heckerman , Christopher Meek

Differential Networks (DNs), tools that encapsulate interactions within intricate systems, are brought under the Bayesian lens in this research. A novel na{\i}ve Bayesian adaptive graphical elastic net (BAE) prior is introduced to estimate…

Methodology · Statistics 2023-06-27 J. Smith , A. Bekker , M. Arashi

The distributional simplicity bias (DSB) posits that neural networks learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we present compelling new evidence for the DSB by…

Machine Learning · Computer Science 2024-10-10 Nora Belrose , Quintin Pope , Lucia Quirke , Alex Mallen , Xiaoli Fern