English
Related papers

Related papers: Nesting Probabilistic Programs

200 papers

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon

This paper examines the accuracy of the PROSPECTOR model for uncertain reasoning. PROSPECTOR's solutions for a large number of computer-generated inference networks were compared to those obtained from probability theory and minimum…

Artificial Intelligence · Computer Science 2013-04-12 Robert M. Yadrick , Bruce M. Perrin , David S. Vaughan , Peter D. Holden , Karl G. Kempf

Agent-based models of disease transmission involve stochastic rules that specify how a number of individuals would infect one another, recover or be removed from the population. Common yet stringent assumptions stipulate interchangeability…

Computation · Statistics 2021-01-29 Nianqiao Ju , Jeremy Heng , Pierre E. Jacob

Estimating nested expectations is an important task in computational mathematics and statistics. In this paper we propose a new Monte Carlo method using post-stratification to estimate nested expectations efficiently without taking samples…

Numerical Analysis · Mathematics 2023-04-28 Tomohiko Hironaka , Takashi Goda

This paper concerns numerical assessment of Monte Carlo error in particle filters. We show that by keeping track of certain key features of the genealogical structure arising from resampling operations, it is possible to estimate variances…

Computation · Statistics 2016-06-29 Anthony Lee , Nick Whiteley

We use Monte Carlo techniques to simulate an organized prediction competition between a group of a scientific experts acting under the influence of a ``self-governing'' prediction reward algorithm. Our aim is to illustrate the advantages of…

Social and Information Networks · Computer Science 2023-05-09 J. O. Gonzalez-Hernandez , Jonathan Marino , Ted Rogers , Brandon Velasco

We propose nested sequential Monte Carlo (NSMC), a methodology to sample from sequences of probability distributions, even where the random variables are high-dimensional. NSMC generalises the SMC framework by requiring only approximate,…

Computation · Statistics 2015-09-14 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

We consider the problem of estimating the expected outcomes of Monte Carlo processes whose outputs are described by multidimensional random variables. We tightly characterize the quantum query complexity of this problem for various choices…

Quantum Physics · Physics 2021-07-09 Arjan Cornelissen , Sofiene Jerbi

This thesis describes work on two applications of probabilistic programming: the learning of probabilistic program code given specifications, in particular program code of one-dimensional samplers; and the facilitation of sequential Monte…

Artificial Intelligence · Computer Science 2020-05-21 Yura N Perov

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

Intelligent systems sometimes need to infer the probable goals of people, cars, and robots, based on partial observations of their motion. This paper introduces a class of probabilistic programs for formulating and solving these problems.…

Artificial Intelligence · Computer Science 2017-04-19 Marco F. Cusumano-Towner , Alexey Radul , David Wingate , Vikash K. Mansinghka

The causal (belief) network is a well-known graphical structure for representing independencies in a joint probability distribution. The exact methods and the approximation methods, which perform probabilistic inference in causal networks,…

Artificial Intelligence · Computer Science 2013-04-05 Richard E. Neapolitan , James Kenevan

We develop a technique for generalising from data in which models are samplers represented as program text. We establish encouraging empirical results that suggest that Markov chain Monte Carlo probabilistic programming inference techniques…

Artificial Intelligence · Computer Science 2014-07-11 Yura N. Perov , Frank D. Wood

Neural network potentials (NNPs) combine the computational efficiency of classical interatomic potentials with the high accuracy and flexibility of the ab initio methods used to create the training set, but can also result in unphysical…

Materials Science · Physics 2022-01-24 Leonid Kahle , Federico Zipoli

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

We present probabilistic neural programs, a framework for program induction that permits flexible specification of both a computational model and inference algorithm while simultaneously enabling the use of deep neural networks.…

Neural and Evolutionary Computing · Computer Science 2016-12-05 Kenton W. Murray , Jayant Krishnamurthy

Nested sampling is a powerful approach to Bayesian inference ultimately limited by the computationally demanding task of sampling from a heavily constrained probability distribution. An effective algorithm in its own right, Hamiltonian…

Data Analysis, Statistics and Probability · Physics 2015-03-02 M. J. Betancourt

People routinely infer the goals of others by observing their actions over time. Remarkably, we can do so even when those actions lead to failure, enabling us to assist others when we detect that they might not achieve their goals. How…

Artificial Intelligence · Computer Science 2020-10-27 Tan Zhi-Xuan , Jordyn L. Mann , Tom Silver , Joshua B. Tenenbaum , Vikash K. Mansinghka

A plethora of problems in AI, engineering and the sciences are naturally formalized as inference in discrete probabilistic models. Exact inference is often prohibitively expensive, as it may require evaluating the (unnormalized) target…

Machine Learning · Computer Science 2019-10-16 Lars Buesing , Nicolas Heess , Theophane Weber

Monte Carlo inference has asymptotic guarantees, but can be slow when using generic proposals. Handcrafted proposals that rely on user knowledge about the posterior distribution can be efficient, but are difficult to derive and implement.…

Artificial Intelligence · Computer Science 2018-01-16 Marco F. Cusumano-Towner , Vikash K. Mansinghka