English
Related papers

Related papers: Top-Down Bayesian Posterior Sampling for Sum-Produ…

200 papers

Structural learning of Bayesian Networks (BNs) is a NP-hard problem, which is further complicated by many theoretical issues, such as the I-equivalence among different structures. In this work, we focus on a specific subclass of BNs, named…

Machine Learning · Computer Science 2018-10-24 Daniele Ramazzotti , Marco S. Nobile , Marco Antoniotti , Alex Graudenzi

Large multilayer neural networks trained with backpropagation have recently achieved state-of-the-art results in a wide range of problems. However, using backprop for neural net learning still has some disadvantages, e.g., having to tune a…

Machine Learning · Statistics 2015-07-16 José Miguel Hernández-Lobato , Ryan P. Adams

Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to…

Machine Learning · Computer Science 2020-02-27 Ishaq Aden-Ali , Hassan Ashtiani

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the…

Machine Learning · Statistics 2023-04-24 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Sum-Product Networks (SPNs) are expressive probabilistic models that provide exact, tractable inference. They achieve this efficiency by making use of local independence. On the other hand, mixtures of exchangeable variable models (MEVMs)…

Machine Learning · Computer Science 2022-04-29 Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

Sum-Product Networks (SPNs) are recently introduced deep tractable probabilistic models by which several kinds of inference queries can be answered exactly and in a tractable time. Up to now, they have been largely used as black box density…

Machine Learning · Computer Science 2018-08-27 Antonio Vergari , Nicola Di Mauro , Floriana Esposito

A sum-product network (SPN) is a graphical model that allows several types of inferences to be drawn efficiently. There are two types of learning for SPNs: Learning the architecture of the model, and learning the parameters. In this paper,…

Machine Learning · Computer Science 2021-10-18 Ernst Althaus , Mohammad Sadeq Dousti , Stefan Kramer , Nick Johannes Peter Rassau

Sum-Product Networks (SPNs) are a class of expressive yet tractable hierarchical graphical models. LearnSPN is a structure learning algorithm for SPNs that uses hierarchical co-clustering to simultaneously identifying similar entities and…

Artificial Intelligence · Computer Science 2016-04-26 Viktoriya Krakovna , Moshe Looks

We present a new method to approximate posterior probabilities of Bayesian Network using Deep Neural Network. Experiment results on several public Bayesian Network datasets shows that Deep Neural Network is capable of learning joint…

Machine Learning · Computer Science 2018-01-12 Jie Jia , Honggang Zhou , Yunchun Li

Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow the explicit specification of prior knowledge and accurately capture model uncertainty. We present Prior-Data Fitted Networks (PFNs). PFNs…

Machine Learning · Computer Science 2024-08-14 Samuel Müller , Noah Hollmann , Sebastian Pineda Arango , Josif Grabocka , Frank Hutter

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in…

Machine Learning · Computer Science 2024-01-01 Melrose Roderick , Felix Berkenkamp , Fatemeh Sheikholeslami , Zico Kolter

Spiking Neural Networks (SNNs) capture some of the efficiency of biological brains for inference and learning via the dynamic, online, event-driven processing of binary time series. Most existing learning algorithms for SNNs are based on…

Machine Learning · Computer Science 2021-01-06 Hyeryung Jang , Osvaldo Simeone

We introduce Graph-Structured Sum-Product Networks (GraphSPNs), a probabilistic approach to structured prediction for problems where dependencies between latent variables are expressed in terms of arbitrary, dynamic graphs. While many…

Machine Learning · Computer Science 2017-11-23 Kaiyu Zheng , Andrzej Pronobis , Rajesh P. N. Rao

Gaussian Process Networks (GPNs) are a class of directed graphical models which employ Gaussian processes as priors for the conditional expectation of each variable given its parents in the network. The model allows the description of…

Machine Learning · Statistics 2024-02-20 Enrico Giudice , Jack Kuipers , Giusi Moffa

There exists a dichotomy between classical probabilistic graphical models, such as Bayesian networks (BNs), and modern tractable models, such as sum-product networks (SPNs). The former generally have intractable inference, but provide a…

Artificial Intelligence · Computer Science 2020-05-20 Cory J. Butz , Jhonatan S. Oliveira , Robert Peharz

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

Recent investigations into sum-product-max networks (SPMN) that generalize sum-product networks (SPN) offer a data-driven alternative for decision making, which has predominantly relied on handcrafted models. SPMNs computationally represent…

Artificial Intelligence · Computer Science 2020-06-15 Hari Teja Tatavarti , Prashant Doshi , Layton Hayes

Sum-product networks have recently emerged as an attractive representation due to their dual view as a special type of deep neural network with clear semantics and a special type of probabilistic graphical model for which inference is…

Machine Learning · Statistics 2017-01-20 Wilson Hsu , Agastya Kalra , Pascal Poupart