English
Related papers

Related papers: Dynamic Sum Product Networks for Tractable Inferen…

200 papers

Sum-product networks have recently emerged as an attractive representation due to their dual view as a special type of deep neural network with clear semantics and a special type of probabilistic graphical model for which inference is…

Machine Learning · Statistics 2017-01-20 Wilson Hsu , Agastya Kalra , Pascal Poupart

We present a novel tractable generative model that extends Sum-Product Networks (SPNs) and significantly boosts their power. We call it Sum-Product-Quotient Networks (SPQNs), whose core concept is to incorporate conditional distributions…

Machine Learning · Computer Science 2018-02-22 Or Sharir , Amnon Shashua

Sum Product Networks (SPNs) are a recently developed class of deep generative models which compute their associated unnormalized density functions using a special type of arithmetic circuit. When certain sufficient conditions, called the…

Machine Learning · Computer Science 2015-01-26 James Martens , Venkatesh Medabalimi

Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to…

Machine Learning · Computer Science 2020-02-27 Ishaq Aden-Ali , Hassan Ashtiani

While all kinds of mixed data -from personal data, over panel and scientific data, to public and commercial data- are collected and stored, building probabilistic graphical models for these hybrid domains becomes more difficult. Users spend…

Machine Learning · Computer Science 2017-11-07 Alejandro Molina , Antonio Vergari , Nicola Di Mauro , Sriraam Natarajan , Floriana Esposito , Kristian Kersting

Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even…

Machine Learning · Computer Science 2016-11-14 Abram L. Friesen , Pedro Domingos

Sum-Product Networks (SPNs) are a class of expressive yet tractable hierarchical graphical models. LearnSPN is a structure learning algorithm for SPNs that uses hierarchical co-clustering to simultaneously identifying similar entities and…

Artificial Intelligence · Computer Science 2016-04-26 Viktoriya Krakovna , Moshe Looks

Sum-product networks (SPNs) are flexible density estimators and have received significant attention due to their attractive inference properties. While parameter learning in SPNs is well developed, structure learning leaves something to be…

Machine Learning · Computer Science 2019-11-05 Martin Trapp , Robert Peharz , Hong Ge , Franz Pernkopf , Zoubin Ghahramani

We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific…

Machine Learning · Computer Science 2022-09-23 Athresh Karanam , Saurabh Mathur , Predrag Radivojac , David M. Haas , Kristian Kersting , Sriraam Natarajan

A sum-product network (SPN) is a graphical model that allows several types of inferences to be drawn efficiently. There are two types of learning for SPNs: Learning the architecture of the model, and learning the parameters. In this paper,…

Machine Learning · Computer Science 2021-10-18 Ernst Althaus , Mohammad Sadeq Dousti , Stefan Kramer , Nick Johannes Peter Rassau

We introduce Graph-Structured Sum-Product Networks (GraphSPNs), a probabilistic approach to structured prediction for problems where dependencies between latent variables are expressed in terms of arbitrary, dynamic graphs. While many…

Machine Learning · Computer Science 2017-11-23 Kaiyu Zheng , Andrzej Pronobis , Rajesh P. N. Rao

In this work, we propose Sum-Product-Transform Networks (SPTN), an extension of sum-product networks that uses invertible transformations as additional internal nodes. The type and placement of transformations determine properties of the…

Machine Learning · Statistics 2020-05-05 Tomas Pevny , Vasek Smidl , Martin Trapp , Ondrej Polacek , Tomas Oberhuber

Motivation: Several different threads of research have been proposed for modeling and mining temporal data. On the one hand, approaches such as dynamic Bayesian networks (DBNs) provide a formal probabilistic basis to model relationships…

Machine Learning · Computer Science 2009-04-15 Debprakash Patnaik , Srivatsan Laxman , Naren Ramakrishnan

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

Machine Learning · Computer Science 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf

Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces…

Artificial Intelligence · Computer Science 2021-10-14 Ayush Raina , Jonathan Cagan , Christopher McComb

While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions…

Machine Learning · Computer Science 2021-10-26 Matej Zečević , Devendra Singh Dhami , Athresh Karanam , Sriraam Natarajan , Kristian Kersting

This paper introduces a new probabilistic architecture called Sum-Product Graphical Model (SPGM). SPGMs combine traits from Sum-Product Networks (SPNs) and Graphical Models (GMs): Like SPNs, SPGMs always enable tractable inference using a…

Machine Learning · Statistics 2017-08-23 Mattia Desana , Christoph Schnörr

Bayesian online algorithms for Sum-Product Networks (SPNs) need to update their posterior distribution after seeing one single additional instance. To do so, they must compute moments of the model parameters under this distribution. The…

Machine Learning · Computer Science 2017-11-07 Han Zhao , Geoff Gordon

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

Semantic concept hierarchy is still under-explored for semantic segmentation due to the inefficiency and complicated optimization of incorporating structural inference into dense prediction. This lack of modeling semantic correlations also…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Xiaodan Liang , Hongfei Zhou , Eric Xing