English
Related papers

Related papers: Tutorial on Exact Belief Propagation in Bayesian N…

200 papers

Belief Propagation algorithms acting on Graphical Models of classical probability distributions, such as Markov Networks, Factor Graphs and Bayesian Networks, are amongst the most powerful known methods for deriving probabilistic inferences…

Quantum Physics · Physics 2009-11-13 Matthew Leifer , David Poulin

Bayesian models of cognition hypothesize that human brains make sense of data by representing probability distributions and applying Bayes' rule to find the best explanation for available data. Understanding the neural mechanisms underlying…

Neural and Evolutionary Computing · Computer Science 2021-07-02 Milad Kharratzadeh , Thomas R. Shultz

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought…

Methodology · Statistics 2024-03-04 Larissa N. A. Martins , Flávio B. Gonçalves , Thais P. Galletti

Classical Bayesian persuasion studies how a sender influences receivers through carefully designed signaling policies within a single strategic interaction. In many real-world environments, such interactions are repeated across multiple…

Computer Science and Game Theory · Computer Science 2026-03-24 Ata Poyraz Turna , Asrin Efe Yorulmaz , Tamer Başar

The evolution of molecular and phenotypic traits is commonly modelled using Markov processes along a phylogeny. This phylogeny can be a tree, or a network if it includes reticulations, representing events such as hybridization or admixture.…

Populations and Evolution · Quantitative Biology 2024-08-28 Benjamin Teo , Paul Bastide , Cécile Ané

We define an evolving in-time Bayesian neural network called a Hidden Markov Neural Network, which addresses the crucial challenge in time-series forecasting and continual learning: striking a balance between adapting to new data and…

Machine Learning · Statistics 2025-01-17 Lorenzo Rimella , Nick Whiteley

A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the…

Machine Learning · Computer Science 2019-06-28 KiJung Yoon , Renjie Liao , Yuwen Xiong , Lisa Zhang , Ethan Fetaya , Raquel Urtasun , Richard Zemel , Xaq Pitkow

We study online Bayesian persuasion problems in which an informed sender repeatedly faces a receiver with the goal of influencing their behavior through the provision of payoff-relevant information. Previous works assume that the sender has…

Computer Science and Game Theory · Computer Science 2024-11-12 Francesco Bacchiocchi , Matteo Bollini , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Backward simulation is an approximate inference technique for Bayesian belief networks. It differs from existing simulation methods in that it starts simulation from the known evidence and works backward (i.e., contrary to the direction of…

Artificial Intelligence · Computer Science 2013-02-28 Robert Fung , Brendan del Favero

Networks and network computations have become a primary mathematical tool for analyzing the structure of many kinds of complex systems, ranging from the Internet and transportation networks to biochemical interactions and social networks. A…

Social and Information Networks · Computer Science 2023-07-11 M. E. J. Newman

The computational burden of probabilistic inference remains a hurdle for applying probabilistic programming languages to practical problems of interest. In this work, we provide a semantic and algorithmic foundation for efficient exact…

Programming Languages · Computer Science 2019-07-02 Steven Holtzen , Todd Millstein , Guy Van den Broeck

Incomplete data are a common feature in many domains, from clinical trials to industrial applications. Bayesian networks (BNs) are often used in these domains because of their graphical and causal interpretations. BN parameter learning from…

Machine Learning · Statistics 2025-01-13 Andrea Ruggieri , Francesco Stranieri , Fabio Stella , Marco Scutari

Attention-based neural networks have achieved state-of-the-art results on a wide range of tasks. Most such models use deterministic attention while stochastic attention is less explored due to the optimization difficulties or complicated…

Machine Learning · Computer Science 2021-06-10 Shujian Zhang , Xinjie Fan , Bo Chen , Mingyuan Zhou

A reliable modeling of uncertain evidence in Bayesian networks based on a set-valued quantification is proposed. Both soft and virtual evidences are considered. We show that evidence propagation in this setup can be reduced to standard…

Artificial Intelligence · Computer Science 2018-02-16 Sabina Marchetti , Alessandro Antonucci

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

As one of the classic models that describe the belief dynamics over social networks, a non-Bayesian social learning model assumes that members in the network possess accurate signal knowledge through the process of Bayesian inference. In…

Social and Information Networks · Computer Science 2019-05-21 Sannyuya Liu , Zhonghua Yan , Xiufeng Cheng , Liang Zhao

Expectation Propagation (EP) is a widely used iterative message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions as ``beliefs'' using intermediate functions called…

Machine Learning · Statistics 2026-04-07 Zilu Zhao , Jichao Chen , Dirk Slock

In recent years, researchers in decision analysis and artificial intelligence (AI) have used Bayesian belief networks to build models of expert opinion. Using standard methods drawn from the theory of computational complexity, workers in…

Artificial Intelligence · Computer Science 2013-04-05 R. Martin Chavez , Gregory F. Cooper

Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for…

Machine Learning · Statistics 2016-12-16 Theofanis Karaletsos