English
Related papers

Related papers: Sum-product networks: A survey

200 papers

In this work, we propose Sum-Product-Transform Networks (SPTN), an extension of sum-product networks that uses invertible transformations as additional internal nodes. The type and placement of transformations determine properties of the…

Machine Learning · Statistics 2020-05-05 Tomas Pevny , Vasek Smidl , Martin Trapp , Ondrej Polacek , Tomas Oberhuber

Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to…

Machine Learning · Computer Science 2020-02-27 Ishaq Aden-Ali , Hassan Ashtiani

While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions…

Machine Learning · Computer Science 2021-10-26 Matej Zečević , Devendra Singh Dhami , Athresh Karanam , Sriraam Natarajan , Kristian Kersting

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant. While most semi-supervised approaches enforce restrictive assumptions on the data distribution, recent work has managed to…

Machine Learning · Statistics 2017-10-11 Martin Trapp , Tamas Madl , Robert Peharz , Franz Pernkopf , Robert Trappl

Probabilistic representations, such as Bayesian and Markov networks, are fundamental to much of statistical machine learning. Thus, learning probabilistic representations directly from data is a deep challenge, the main computational…

Machine Learning · Computer Science 2018-09-20 Andreas Bueff , Stefanie Speichert , Vaishak Belle

We present a unified approach for learning the parameters of Sum-Product networks (SPNs). We prove that any complete and decomposable SPN is equivalent to a mixture of trees where each tree corresponds to a product of univariate…

Machine Learning · Computer Science 2016-08-29 Han Zhao , Pascal Poupart , Geoff Gordon

Probabilistic graphical models are a central tool in AI; however, they are generally not as expressive as deep neural models, and inference is notoriously hard and slow. In contrast, deep probabilistic models such as sum-product networks…

Machine Learning · Computer Science 2019-10-01 Xiaoting Shao , Alejandro Molina , Antonio Vergari , Karl Stelzner , Robert Peharz , Thomas Liebig , Kristian Kersting

While all kinds of mixed data -from personal data, over panel and scientific data, to public and commercial data- are collected and stored, building probabilistic graphical models for these hybrid domains becomes more difficult. Users spend…

Machine Learning · Computer Science 2017-11-07 Alejandro Molina , Antonio Vergari , Nicola Di Mauro , Sriraam Natarajan , Floriana Esposito , Kristian Kersting

Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even…

Machine Learning · Computer Science 2016-11-14 Abram L. Friesen , Pedro Domingos

We introduce factorize sum split product networks (FSPNs), a new class of probabilistic graphical models (PGMs). FSPNs are designed to overcome the drawbacks of existing PGMs in terms of estimation accuracy and inference efficiency.…

Artificial Intelligence · Computer Science 2020-11-23 Ziniu Wu , Rong Zhu , Andreas Pfadler , Yuxing Han , Jiangneng Li , Zhengping Qian , Kai Zeng , Jingren Zhou

We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific…

Machine Learning · Computer Science 2022-09-23 Athresh Karanam , Saurabh Mathur , Predrag Radivojac , David M. Haas , Kristian Kersting , Sriraam Natarajan

Sum-product networks have recently emerged as an attractive representation due to their dual view as a special type of deep neural network with clear semantics and a special type of probabilistic graphical model for which inference is…

Machine Learning · Statistics 2017-01-20 Wilson Hsu , Agastya Kalra , Pascal Poupart

Probabilistic circuits (PCs) have become the de-facto standard for learning and inference in probabilistic modeling. We introduce Sum-Product-Attention Networks (SPAN), a new generative model that integrates probabilistic circuits with…

Machine Learning · Computer Science 2021-09-15 Zhongjie Yu , Devendra Singh Dhami , Kristian Kersting

Recent investigations into sum-product-max networks (SPMN) that generalize sum-product networks (SPN) offer a data-driven alternative for decision making, which has predominantly relied on handcrafted models. SPMNs computationally represent…

Artificial Intelligence · Computer Science 2020-06-15 Hari Teja Tatavarti , Prashant Doshi , Layton Hayes

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

Machine Learning · Computer Science 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf

We present simplicial neural networks (SNNs), a generalization of graph neural networks to data that live on a class of topological spaces called simplicial complexes. These are natural multi-dimensional extensions of graphs that encode not…

Machine Learning · Computer Science 2020-12-29 Stefania Ebli , Michaël Defferrard , Gard Spreemann

Sum-product networks (SPNs) are a class of probabilistic graphical models that allow tractable marginal inference. However, the maximum a posteriori (MAP) inference in SPNs is NP-hard. We investigate MAP inference in SPNs from both…

Artificial Intelligence · Computer Science 2017-11-21 Jun Mei , Yong Jiang , Kewei Tu

Sum Product Networks (SPNs) are a recently developed class of deep generative models which compute their associated unnormalized density functions using a special type of arithmetic circuit. When certain sufficient conditions, called the…

Machine Learning · Computer Science 2015-01-26 James Martens , Venkatesh Medabalimi

We present a novel tractable generative model that extends Sum-Product Networks (SPNs) and significantly boosts their power. We call it Sum-Product-Quotient Networks (SPQNs), whose core concept is to incorporate conditional distributions…

Machine Learning · Computer Science 2018-02-22 Or Sharir , Amnon Shashua

Simulation-Grounded Neural Networks (SGNNs) are predictive models trained entirely on synthetic data from mechanistic simulations. They have achieved state-of-the-art performance in domains where real-world labels are limited or unobserved,…

Machine Learning · Computer Science 2025-10-03 Carson Dudley , Marisa Eisenberg