English
Related papers

Related papers: Cautious Propagation in Bayesian Networks

200 papers

Considering a probability distribution over parameters is known as an efficient strategy to learn a neural network with non-differentiable activation functions. We study the expectation of a probabilistic neural network as a predictor by…

Machine Learning · Computer Science 2023-04-17 Louis Fortier-Dubois , Gaël Letarte , Benjamin Leblanc , François Laviolette , Pascal Germain

Compressive sensing (CS) is an emerging field based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable, sub-Nyquist signal acquisition. When a statistical…

Information Theory · Computer Science 2009-06-25 Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

The standard approach to answering an identifiable causal-effect query (e.g., $P(Y|do(X)$) when given a causal diagram and observational data is to first generate an estimand, or probabilistic expression over the observable variables, which…

Artificial Intelligence · Computer Science 2024-08-28 Anna Raichev , Alexander Ihler , Jin Tian , Rina Dechter

How to estimate heterogeneity, e.g. the effect of some variable differing across observations, is a key question in political science. Methods for doing so make simplifying assumptions about the underlying nature of the heterogeneity to…

Methodology · Statistics 2021-03-31 Max Goplerud

We develop simple methods for constructing likelihoods and parameter priors for learning about the parameters and structure of a Bayesian network. In particular, we introduce several assumptions that permit the construction of likelihoods…

Machine Learning · Computer Science 2021-07-01 David Heckerman , Dan Geiger

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

This paper presents Sparse Partitioning, a Bayesian method for identifying predictors that either individually or in combination with others affect a response variable. The method is designed for regression problems involving binary or…

Quantitative Methods · Quantitative Biology 2011-08-31 Doug Speed , Simon Tavaré

This paper builds on recent developments in Bayesian network (BN) structure learning under the controversial assumption that the input variables are dependent. This assumption can be viewed as a learning constraint geared towards cases…

Machine Learning · Computer Science 2020-06-08 Anthony Constantinou

In a given problem, the Bayesian statistical paradigm requires the specification of a prior distribution that quantifies relevant information about the unknowns of main interest external to the data. In cases where little such information…

Statistics Theory · Mathematics 2017-10-11 Alexander Terenin , David Draper

Even though probabilistic treatments of neural networks have a long history, they have not found widespread use in practice. Sampling approaches are often too slow already for simple networks. The size of the inputs and the depth of typical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Jochen Gast , Stefan Roth

Obtaining heteroscedastic predictive uncertainties from a Bayesian Neural Network (BNN) is vital to many applications. Often, heteroscedastic aleatoric uncertainties are learned as outputs of the BNN in addition to the predictive means,…

Machine Learning · Computer Science 2026-05-01 David J. Schodt , Ryan Brown , Michael Merritt , Samuel Park , Delsin Menolascino , Mark A. Peot

Multivariate point processes are widely applied to model event-type data such as natural disasters, online message exchanges, financial transactions or neuronal spike trains. One very popular point process model in which the probability of…

Statistics Theory · Mathematics 2023-01-27 Deborah Sulem , Vincent Rivoirard , Judith Rousseau

We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to…

Statistics Theory · Mathematics 2011-12-26 Rina Foygel , Mathias Drton

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

Machine Learning · Statistics 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

Searching the complete space of possible Bayesian networks is intractable for problems of interesting size, so Bayesian network structure learning algorithms, such as the commonly used Sparse Candidate algorithm, employ heuristics. However,…

Artificial Intelligence · Computer Science 2012-06-26 Eric Lantz , Soumya Ray , David Page

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on…

Artificial Intelligence · Computer Science 2015-12-23 Zuhe Zhang , Benjamin Rubinstein , Christos Dimitrakakis

Empirical networks are often globally sparse, with a small average number of connections per node, when compared to the total size of the network. However, this sparsity tends not to be homogeneous, and networks can also be locally dense,…

Physics and Society · Physics 2020-07-20 Tiago P. Peixoto

After experimenting with a number of non-probabilistic methods for dealing with uncertainty many researchers reaffirm a preference for probability methods [1] [2], although this remains controversial. The importance of being able to form…

Artificial Intelligence · Computer Science 2013-04-11 Thomas Slack

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker