English
Related papers

Related papers: Probabilistic Deep Learning using Random Sum-Produ…

200 papers

Sum-Product Networks (SPNs) are expressive probabilistic models that provide exact, tractable inference. They achieve this efficiency by making use of local independence. On the other hand, mixtures of exchangeable variable models (MEVMs)…

Machine Learning · Computer Science 2022-04-29 Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

Deep generative models have recently made a remarkable progress in capturing complex probability distributions over graphs. However, they are intractable and thus unable to answer even the most basic probabilistic inference queries without…

Machine Learning · Computer Science 2024-08-20 Milan Papež , Martin Rektoris , Václav Šmídl , Tomáš Pevný

While all kinds of mixed data -from personal data, over panel and scientific data, to public and commercial data- are collected and stored, building probabilistic graphical models for these hybrid domains becomes more difficult. Users spend…

Machine Learning · Computer Science 2017-11-07 Alejandro Molina , Antonio Vergari , Nicola Di Mauro , Sriraam Natarajan , Floriana Esposito , Kristian Kersting

We introduce factorize sum split product networks (FSPNs), a new class of probabilistic graphical models (PGMs). FSPNs are designed to overcome the drawbacks of existing PGMs in terms of estimation accuracy and inference efficiency.…

Artificial Intelligence · Computer Science 2020-11-23 Ziniu Wu , Rong Zhu , Andreas Pfadler , Yuxing Han , Jiangneng Li , Zhengping Qian , Kai Zeng , Jingren Zhou

Sum-product networks have recently emerged as an attractive representation due to their dual view as a special type of deep neural network with clear semantics and a special type of probabilistic graphical model for which inference is…

Machine Learning · Statistics 2017-01-20 Wilson Hsu , Agastya Kalra , Pascal Poupart

Even though probabilistic treatments of neural networks have a long history, they have not found widespread use in practice. Sampling approaches are often too slow already for simple networks. The size of the inputs and the depth of typical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Jochen Gast , Stefan Roth

Outlier explanation is the task of identifying a set of features that distinguish a sample from normal data, which is important for downstream (human) decision-making. Existing methods are based on beam search in the space of feature…

Machine Learning · Computer Science 2022-07-19 Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

In order to perform complex actions in human environments, an autonomous robot needs the ability to understand the environment, that is, to gather and maintain spatial knowledge. Topological map is commonly used for representing large…

Robotics · Computer Science 2017-07-11 Kaiyu Zheng

Deep neural networks (DNNs) and Kolmogorov-Arnold networks (KANs) are popular methods for function approximation due to their flexibility and expressivity. However, they typically require a large number of trainable parameters to produce a…

Machine Learning · Computer Science 2025-11-27 Zachary Morrow , Michael Penwarden , Brian Chen , Aurya Javeed , Akil Narayan , John D. Jakeman

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

Machine Learning · Computer Science 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf

Daily internet communication relies heavily on tree-structured graphs, embodied by popular data formats such as XML and JSON. However, many recent generative (probabilistic) models utilize neural networks to learn a probability distribution…

Machine Learning · Computer Science 2024-08-20 Milan Papež , Martin Rektoris , Tomáš Pevný , Václav Šmídl

Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to…

Machine Learning · Computer Science 2020-02-27 Ishaq Aden-Ali , Hassan Ashtiani

Probabilistic circuits (PCs) have become the de-facto standard for learning and inference in probabilistic modeling. We introduce Sum-Product-Attention Networks (SPAN), a new generative model that integrates probabilistic circuits with…

Machine Learning · Computer Science 2021-09-15 Zhongjie Yu , Devendra Singh Dhami , Kristian Kersting

Inference in expressive probabilistic models is generally intractable, which makes them difficult to learn and limits their applicability. Sum-product networks are a class of deep models where, surprisingly, inference remains tractable even…

Machine Learning · Computer Science 2016-11-14 Abram L. Friesen , Pedro Domingos

Probabilistic representations, such as Bayesian and Markov networks, are fundamental to much of statistical machine learning. Thus, learning probabilistic representations directly from data is a deep challenge, the main computational…

Machine Learning · Computer Science 2018-09-20 Andreas Bueff , Stefanie Speichert , Vaishak Belle

Tractable yet expressive density estimators are a key building block of probabilistic machine learning. While sum-product networks (SPNs) offer attractive inference capabilities, obtaining structures large enough to fit complex,…

Machine Learning · Computer Science 2019-08-12 Fabrizio Ventola , Karl Stelzner , Alejandro Molina , Kristian Kersting

Recent investigations into sum-product-max networks (SPMN) that generalize sum-product networks (SPN) offer a data-driven alternative for decision making, which has predominantly relied on handcrafted models. SPMNs computationally represent…

Artificial Intelligence · Computer Science 2020-06-15 Hari Teja Tatavarti , Prashant Doshi , Layton Hayes

Deep learning and symbolic learning are two frequently employed methods in Sequential Recommendation (SR). Recent neural-symbolic SR models demonstrate their potential to enable SR to be equipped with concurrent perception and cognition…

Artificial Intelligence · Computer Science 2023-05-16 Huanhuan Yuan , Pengpeng Zhao , Xuefeng Xian , Guanfeng Liu , Victor S. Sheng , Lei Zhao

Merging the two cultures of deep and statistical learning provides insights into structured high-dimensional data. Traditional statistical modeling is still a dominant strategy for structured tabular data. Deep learning can be viewed…

Methodology · Statistics 2021-10-25 Anindya Bhadra , Jyotishka Datta , Nick Polson , Vadim Sokolov , Jianeng Xu

This paper investigates the use of probabilistic neural networks (PNNs) to model aleatoric uncertainty, which refers to the inherent variability in the input-output relationships of a system, often characterized by unequal variance or…

Machine Learning · Statistics 2024-02-22 Farhad Pourkamali-Anaraki , Jamal F. Husseini , Scott E. Stapleton