English
Related papers

Related papers: A Channel-based Exact Inference Algorithm for Baye…

200 papers

We present an exact Bayesian inference method for inferring posterior distributions encoded by probabilistic programs featuring possibly unbounded loops. Our method is built on a denotational semantics represented by probability generating…

Programming Languages · Computer Science 2024-03-06 Lutz Klinkenberg , Christian Blumenthal , Mingshuai Chen , Darion Haase , Joost-Pieter Katoen

Modern Bayesian inference involves a mixture of computational techniques for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows for data analysis. Typical problems in Bayesian workflows…

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

We present a new method to propagate lower bounds on conditional probability distributions in conventional Bayesian networks. Our method guarantees to provide outer approximations of the exact lower bounds. A key advantage is that we can…

Artificial Intelligence · Computer Science 2012-05-14 Daniel Andrade , Bernhard Sick

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

We present two sampling algorithms for probabilistic confidence inference in Bayesian networks. These two algorithms (we call them AIS-BN-mu and AIS-BN-sigma algorithms) guarantee that estimates of posterior probabilities are with a given…

Artificial Intelligence · Computer Science 2013-01-14 Jian Cheng , Marek J. Druzdzel

Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought…

Methodology · Statistics 2024-03-04 Larissa N. A. Martins , Flávio B. Gonçalves , Thais P. Galletti

Neural network pruning is a highly effective technique aimed at reducing the computational and memory demands of large neural networks. In this research paper, we present a novel approach to pruning neural networks utilizing Bayesian…

Machine Learning · Statistics 2023-08-07 Sunil Mathew , Daniel B. Rowe

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Bayesian networks (BNs) are graphical \emph{first-order} probabilistic models that allow for a compact representation of large probability distributions, and for efficient inference, both exact and approximate. We introduce a…

Logic in Computer Science · Computer Science 2023-12-12 Claudia Faggian , Daniele Pautasso , Gabriele Vanoni

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Performing exact inference on Bayesian networks is known to be #P-hard. Typically approximate inference techniques are used instead to sample from the distribution on query variables given the values $e$ of evidence variables. Classically,…

Quantum Physics · Physics 2014-10-02 Guang Hao Low , Theodore J. Yoder , Isaac L. Chuang

We present two algorithms for exact and approximate inference in causal networks. The first algorithm, dynamic conditioning, is a refinement of cutset conditioning that has linear complexity on some networks for which cutset conditioning is…

Artificial Intelligence · Computer Science 2013-02-21 Adnan Darwiche

Attack graphs are a powerful tool for security risk assessment by analysing network vulnerabilities and the paths attackers can use to compromise network resources. The uncertainty about the attacker's behaviour makes Bayesian networks…

Cryptography and Security · Computer Science 2016-11-07 Luis Muñoz-González , Daniele Sgandurra , Martín Barrère , Emil Lupu

Quantum machine learning promises great speedups over classical algorithms, but it often requires repeated computations to achieve a desired level of accuracy for its point estimates. Bayesian learning focuses more on sampling from…

Quantum Physics · Physics 2021-07-21 Noah Berner , Vincent Fortuin , Jonas Landman

An increasing number of applications require real-time reasoning under uncertainty with streaming input. The temporal (dynamic) Bayes net formalism provides a powerful representational framework for such applications. However, existing…

Artificial Intelligence · Computer Science 2013-01-07 Masami Takikawa , Bruce D'Ambrosio , Ed Wright

This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each individual learning…

Machine Learning · Computer Science 2014-06-13 Trevor Campbell , Jonathan P. How

Bayesian inference is an effective approach for solving statistical learning problems especially with uncertainty and incompleteness. However, inference efficiencies are physically limited by the bottlenecks of conventional computing…

Emerging Technologies · Computer Science 2017-11-06 Xiaotao Jia , Jianlei Yang , Zhaohao Wang , Yiran Chen , Hai , Li , Weisheng Zhao