English
Related papers

Related papers: Continuous Mixtures of Tractable Probabilistic Mod…

200 papers

Probabilistic Circuits (PCs) are deep generative models that support exact and efficient probabilistic inference. Yet in autoregressive language modeling, PCs still lag behind Transformer-based large language models (LLMs), suggesting an…

Machine Learning · Computer Science 2026-05-14 Zhiyu Zhao , Xuejie Liu , Muhan Zhang , Anji Liu

Deep generative models with discrete latent space, such as the Vector-Quantized Variational Autoencoder (VQ-VAE), offer excellent data generation capabilities, but, due to the large size of their latent space, their probabilistic inference…

Machine Learning · Computer Science 2025-09-03 Armin Hadžić , Milan Papez , Tomáš Pevný

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

Mixture models are probabilistic models aimed at uncovering and representing latent subgroups within a population. In the realm of network data analysis, the latent subgroups of nodes are typically identified by their connectivity…

Methodology · Statistics 2020-05-27 Giacomo De Nicola , Benjamin Sischka , Göran Kauermann

Improving the predictive accuracy of a dynamics model is crucial to obtaining good control performance and safety from Model Predictive Controllers (MPC). One approach involves learning unmodelled (residual) dynamics, in addition to nominal…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Leroy D'Souza , Yash Vardhan Pant , Sebastian Fischmeister

Probabilistic sentential decision diagrams are logic circuits where the inputs of disjunctive gates are annotated by probability values. They allow for a compact representation of joint probability mass functions defined over sets of…

Artificial Intelligence · Computer Science 2020-08-20 Lilith Mattei , Alessandro Antonucci , Denis Deratani Mauá , Alessandro Facchini , Julissa Villanueva Llerena

Incorporating constraints is a major concern in probabilistic machine learning. A wide variety of problems require predictions to be integrated with reasoning about constraints, from modelling routes on maps to approving loan predictions.…

Machine Learning · Computer Science 2020-01-31 Ioannis Papantonis , Vaishak Belle

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

Probabilistic programs with dynamic computation graphs can define measures over sample spaces with unbounded dimensionality, which constitute programmatic analogues to Bayesian nonparametrics. Owing to the generality of this model class,…

Machine Learning · Computer Science 2018-11-30 Eli Sennesh , Adam Ścibior , Hao Wu , Jan-Willem van de Meent

Spatial reaction-diffusion models have been employed to describe many emergent phenomena in biological systems. The modelling technique most commonly adopted in the literature implements systems of partial differential equations (PDEs),…

Quantitative Methods · Quantitative Biology 2015-10-05 Christian A. Yates , Mark B. Flegg

Probabilistic circuits compute multilinear polynomials that represent multivariate probability distributions. They are tractable models that support efficient marginal inference. However, various polynomial semantics have been considered in…

Artificial Intelligence · Computer Science 2024-08-09 Oliver Broadrick , Honghua Zhang , Guy Van den Broeck

Despite extensive progress on image generation, common deep generative model architectures are not easily applied to lossless compression. For example, VAEs suffer from a compression cost overhead due to their latent variables. This…

Machine Learning · Computer Science 2022-03-17 Anji Liu , Stephan Mandt , Guy Van den Broeck

This study addresses the predictive limitation of probabilistic circuits and introduces transformations as a remedy to overcome it. We demonstrate this limitation in robotic scenarios. We motivate that independent component analysis is a…

Machine Learning · Statistics 2023-10-09 Tom Schierenbeck , Vladimir Vutov , Thorsten Dickhaus , Michael Beetz

Probabilistic circuits (PCs) are a powerful modeling framework for representing tractable probability distributions over combinatorial spaces. In machine learning and probabilistic programming, one is often interested in understanding…

Data Structures and Algorithms · Computer Science 2021-12-10 Yash Pote , Kuldeep S. Meel

Many popular approaches in the field of robust model predictive control (MPC) are based on nominal predictions. This paper presents a novel formulation of this class of controller with proven input-to-state stability and robust constraint…

Systems and Control · Electrical Eng. & Systems 2022-02-22 Ignacio Alvarado , Pablo Krupa , Daniel Limon , Teodoro Alamo

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

The past decade has seen a significant interest in learning tractable probabilistic representations. Arithmetic circuits (ACs) were among the first proposed tractable representations, with some subsequent representations being instances of…

Artificial Intelligence · Computer Science 2017-08-25 Arthur Choi , Adnan Darwiche

This article surveys computational methods for posterior inference with intractable likelihoods, that is where the likelihood function is unavailable in closed form, or where evaluation of the likelihood is infeasible. We review recent…

Computation · Statistics 2020-04-10 Matthew T. Moores , Anthony N. Pettitt , Kerrie Mengersen

In this paper, we present Robust Model Predictive Control (MPC) problems with adjustable uncertainty sets. In contrast to standard Robust MPC problems with known uncertainty sets, we treat the uncertainty sets in our problems as additional…

Optimization and Control · Mathematics 2018-09-21 Yeojun Kim , Xiaojing Zhang , Jacopo Guanetti , Francesco Borrelli

This article is devoted to providing a review of mathematical formulations in which Polynomial Chaos Theory (PCT) has been incorporated into stochastic model predictive control (SMPC). In the past decade, PCT has been shown to provide a…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Prabhat K. Mishra , Joel A. Paulson , Richard D. Braatz