English
Related papers

Related papers: Building Expressive and Tractable Probabilistic Ge…

200 papers

Daily internet communication relies heavily on tree-structured graphs, embodied by popular data formats such as XML and JSON. However, many recent generative (probabilistic) models utilize neural networks to learn a probability distribution…

Machine Learning · Computer Science 2024-08-20 Milan Papež , Martin Rektoris , Tomáš Pevný , Václav Šmídl

Despite extensive progress on image generation, common deep generative model architectures are not easily applied to lossless compression. For example, VAEs suffer from a compression cost overhead due to their latent variables. This…

Machine Learning · Computer Science 2022-03-17 Anji Liu , Stephan Mandt , Guy Van den Broeck

Probabilistic programming is considered as a framework, in which basic components of cognitive architectures can be represented in unified and elegant fashion. At the same time, necessity of adopting some component of cognitive…

Artificial Intelligence · Computer Science 2016-05-05 Alexey Potapov

A large amount of recent research has the far-reaching goal of finding training methods for deep neural networks that can serve as alternatives to backpropagation (BP). A prominent example is predictive coding (PC), which is a…

Machine Learning · Computer Science 2022-11-08 Luca Pinchetti , Tommaso Salvatori , Yordan Yordanov , Beren Millidge , Yuhang Song , Thomas Lukasiewicz

This study addresses the predictive limitation of probabilistic circuits and introduces transformations as a remedy to overcome it. We demonstrate this limitation in robotic scenarios. We motivate that independent component analysis is a…

Machine Learning · Statistics 2023-10-09 Tom Schierenbeck , Vladimir Vutov , Thorsten Dickhaus , Michael Beetz

Automata expressiveness is an essential feature in understanding which of the formalisms available should be chosen for modelling a particular problem. Probabilistic and stochastic automata are suitable for modelling systems exhibiting…

Logic in Computer Science · Computer Science 2019-03-19 Valentin Bura , Tim French , Mark Reynolds

Probabilistic Circuits (PCs) are prominent tractable probabilistic models, allowing for a range of exact inferences. This paper focuses on the main algorithm for training PCs, LearnSPN, a gold standard due to its efficiency, performance,…

Machine Learning · Computer Science 2024-03-22 Soroush Ghandi , Benjamin Quost , Cassio de Campos

Exchangeability is a central notion in statistics and probability theory. The assumption that an infinite sequence of data points is exchangeable is at the core of Bayesian statistics. However, finite exchangeability as a statistical…

Artificial Intelligence · Computer Science 2014-04-24 Mathias Niepert , Guy Van den Broeck

Constructive type theory combines logic and programming in one language. This is useful both for reasoning about programs written in type theory, as well as for reasoning about other programming languages inside type theory. It is…

Programming Languages · Computer Science 2024-10-25 Philipp Jan Andries Stassen , Rasmus Ejlers Møgelberg , Maaike Zwart , Alejandro Aguirre , Lars Birkedal

Random graph models are frequently used as a controllable and versatile data source for experimental campaigns in various research fields. Generating such data-sets at scale is a non-trivial task as it requires design decisions typically…

Data Structures and Algorithms · Computer Science 2020-03-03 Manuel Penschuck , Ulrik Brandes , Michael Hamann , Sebastian Lamm , Ulrich Meyer , Ilya Safro , Peter Sanders , Christian Schulz

Complex networks theory has commonly been used for modelling and understanding the interactions taking place between the elements composing complex systems. More recently, the use of generative models has gained momentum, as they allow…

Physics and Society · Physics 2016-05-19 Massimiliano Zanin , Marco Correia , Pedro A. C. Sousa , Jorge Cruz

Probabilistic representations, such as Bayesian and Markov networks, are fundamental to much of statistical machine learning. Thus, learning probabilistic representations directly from data is a deep challenge, the main computational…

Machine Learning · Computer Science 2020-06-16 Amelie Levray , Vaishak Belle

Learning uncertain dynamics models using Gaussian process~(GP) regression has been demonstrated to enable high-performance and safety-aware control strategies for challenging real-world applications. Yet, for computational tractability,…

Optimization and Control · Mathematics 2024-09-17 Manish Prajapat , Amon Lahr , Johannes Köhler , Andreas Krause , Melanie N. Zeilinger

Probabilistic Circuits (PCs) have emerged as an efficient framework for representing and learning complex probability distributions. Nevertheless, the existing body of research on PCs predominantly concentrates on data-driven parameter…

Machine Learning · Computer Science 2024-12-20 Athresh Karanam , Saurabh Mathur , Sahil Sidheekh , Sriraam Natarajan

Probabilistic circuits (PCs) have emerged as a powerful framework to compactly represent probability distributions for efficient and exact probabilistic inference. It has been shown that PCs with a general directed acyclic graph (DAG)…

Artificial Intelligence · Computer Science 2024-10-28 Lang Yin , Han Zhao

We propose a computationally tractable, tube-based robust nonlinear model predictive control (MPC) framework using difference-of-convex (DC) functions and sequential convex programming. For systems with differentiable discrete time…

Optimization and Control · Mathematics 2026-02-03 Martin Doff-Sotta , Zaheen A-Rahman , Mark Cannon

Expressibility is a crucial factor of a Parameterized Quantum Circuit (PQC). In the context of Variational Quantum Algorithms (VQA) based Quantum Machine Learning (QML), a QML model composed of highly expressible PQC and sufficient number…

Quantum Physics · Physics 2024-08-12 Yu Liu , Kentaro Baba , Kazuya Kaneko , Naoyuki Takeda , Junpei Koyama , Koichi Kimura

We review old and new uses of exchangeability, emphasizing the general theme of exchangeable representations of complex random structures. Illustrations of this theme include processes of stochastic coalescence and fragmentation; continuum…

Probability · Mathematics 2010-02-22 David J. Aldous

Probabilistic circuits (PCs) are models that allow exact and tractable probabilistic inference. In contrast to neural networks, they are often assumed to be well-calibrated and robust to out-of-distribution (OOD) data. In this paper, we…

Machine Learning · Computer Science 2023-06-13 Fabrizio Ventola , Steven Braun , Zhongjie Yu , Martin Mundt , Kristian Kersting

Bayesian structure learning allows one to capture uncertainty over the causal directed acyclic graph (DAG) responsible for generating given data. In this work, we present Tractable Uncertainty for STructure learning (TRUST), a framework for…

Machine Learning · Computer Science 2022-07-05 Benjie Wang , Matthew Wicker , Marta Kwiatkowska