English
Related papers

Related papers: Deriving Probability Density Functions from Probab…

200 papers

Probabilistic programming languages represent complex data with intermingled models in a few lines of code. Efficient inference algorithms in probabilistic programming languages make possible to build unified frameworks to compute…

Machine Learning · Statistics 2016-07-15 Anh Tong , Jaesik Choi

We consider the problem of fitting a probability density function when it is constrained to have a given number of modal intervals. We propose a dynamic programming approach to solving this problem numerically. When this number is not…

Optimization and Control · Mathematics 2022-07-25 Ery Arias-Castro , He Jiang

In this pedagogical text aimed at those wanting to start thinking about or brush up on probabilistic inference, I review the rules by which probability distribution functions can (and cannot) be combined. I connect these rules to the…

Data Analysis, Statistics and Probability · Physics 2012-05-22 David W. Hogg

In this paper we address the complexity of solving linear programming problems with a set of differential equations that converge to a fixed point that represents the optimal solution. Assuming a probabilistic model, where the inputs are…

Computational Complexity · Computer Science 2007-05-23 Asa Ben-Hur , Joshua Feinberg , Shmuel Fishman , Hava T. Siegelmann

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

Probability density estimation is a classical and well studied problem, but standard density estimation methods have historically lacked the power to model complex and high-dimensional image distributions. More recent generative models…

Machine Learning · Computer Science 2019-02-27 Ryen Krusinga , Sohil Shah , Matthias Zwicker , Tom Goldstein , David Jacobs

While probability theory is normally applied to external environments, there has been some recent interest in probabilistic modeling of the outputs of computations that are too expensive to run. Since mathematical logic is a powerful tool…

Artificial Intelligence · Computer Science 2016-10-10 Scott Garrabrant , Benya Fallenstein , Abram Demski , Nate Soares

Probabilistic programming makes it easy to represent a probabilistic model as a program. Building an individual model, however, is only one step of probabilistic modeling. The broader challenge of probabilistic modeling is in understanding…

Programming Languages · Computer Science 2022-08-15 Ryan Bernstein

The field of statistical relational learning aims at unifying logic and probability to reason and learn from data. Perhaps the most successful paradigm in the field is probabilistic logic programming: the enabling of stochastic primitives…

Machine Learning · Computer Science 2018-09-20 Stefanie Speichert , Vaishak Belle

For a variant of the algorithm in [Pit19] (arXiv:1903.10816) to compute the approximate density or distribution function of a linear mixture of independent random variables known by a finite sample, it is presented a proof of the functional…

Statistics Theory · Mathematics 2019-06-19 Thomas Pitschel

We study discrete probabilistic programs with potentially unbounded looping behaviors over an infinite state space. We present, to the best of our knowledge, the first decidability result for the problem of determining whether such a…

Logic in Computer Science · Computer Science 2022-06-22 Mingshuai Chen , Joost-Pieter Katoen , Lutz Klinkenberg , Tobias Winkler

Forward inference techniques such as sequential Monte Carlo and particle Markov chain Monte Carlo for probabilistic programming can be implemented in any programming language by creative use of standardized operating system functionality…

Artificial Intelligence · Computer Science 2014-07-11 Brooks Paige , Frank Wood

Arguing for the need to combine declarative and probabilistic programming, B\'ar\'any et al. (TODS 2017) recently introduced a probabilistic extension of Datalog as a "purely declarative probabilistic programming language." We revisit this…

Databases · Computer Science 2022-02-17 Martin Grohe , Benjamin Lucien Kaminski , Joost-Pieter Katoen , Peter Lindner

Probabilistic programs are typically normal-looking programs describing posterior probability distributions. They intrinsically code up randomized algorithms and have long been at the heart of modern machine learning and approximate…

Programming Languages · Computer Science 2023-02-14 Lutz Klinkenberg , Tobias Winkler , Mingshuai Chen , Joost-Pieter Katoen

Within psychology, neuroscience and artificial intelligence, there has been increasing interest in the proposal that the brain builds probabilistic models of sensory and linguistic input: that is, to infer a probabilistic model from a…

Machine Learning · Computer Science 2017-08-08 Paul M. B. Vitanyi , Nick Chater

We study the semantic foundation of expressive probabilistic programming languages, that support higher-order functions, continuous distributions, and soft constraints (such as Anglican, Church, and Venture). We define a metalanguage (an…

Programming Languages · Computer Science 2017-03-31 Sam Staton , Hongseok Yang , Chris Heunen , Ohad Kammar , Frank Wood

Recursive calls over recursive data are useful for generating probability distributions, and probabilistic programming allows computations over these distributions to be expressed in a modular and intuitive way. Exact inference is also…

Programming Languages · Computer Science 2023-03-28 David Chiang , Colin McDonald , Chung-chieh Shan

Machine learning (ML) has emerged as a powerful tool for tackling complex regression and classification tasks, yet its success often hinges on the quality of training data. This study introduces an ML paradigm inspired by domain knowledge…

Machine Learning · Computer Science 2025-01-10 Mohsen Rashki

Probabilistic word embeddings have shown effectiveness in capturing notions of generality and entailment, but there is very little work on doing the analogous type of investigation for sentences. In this paper we define probabilistic models…

Computation and Language · Computer Science 2020-05-19 Mingda Chen , Kevin Gimpel

Probability generating functionals (PGFLs) are efficient and powerful tools for tracking independent objects in clutter. It was shown that PGFLs could be used for the elegant derivation of practical multi-object tracking algorithms, e.g.,…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Jan Krejčí , Ondřej Straka , Petr Girg , Jiří Benedikt