English
Related papers

Related papers: Exact Bayesian Inference for Loopy Probabilistic P…

200 papers

This report outlines an approach to learning generative models from data. We express models as probabilistic programs, which allows us to capture abstract patterns within the examples. By choosing our language for programs to be an…

Artificial Intelligence · Computer Science 2011-10-27 Irvin Hwang , Andreas Stuhlmüller , Noah D. Goodman

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

Binary regression models represent a popular model-based approach for binary classification. In the Bayesian framework, computational challenges in the form of the posterior distribution motivate still-ongoing fruitful research. Here, we…

Computation · Statistics 2023-09-06 Augusto Fasano , Niccolò Anceschi , Beatrice Franzolini , Giovanni Rebaudo

We describe the LoopInvGen tool for generating loop invariants that can provably guarantee correctness of a program with respect to a given specification. LoopInvGen is an efficient implementation of the inference technique originally…

Programming Languages · Computer Science 2019-11-01 Saswat Padhi , Rahul Sharma , Todd Millstein

Probabilistic programming languages aim to describe and automate Bayesian modeling and inference. Modern languages support programmable inference, which allows users to customize inference algorithms by incorporating guide programs to…

Programming Languages · Computer Science 2021-04-09 Di Wang , Jan Hoffmann , Thomas Reps

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

In Bayesian probabilistic programming, a central problem is to estimate the normalised posterior distribution (NPD) of a probabilistic program with conditioning via score (a.k.a. observe) statements. Most previous approaches address this…

Programming Languages · Computer Science 2024-08-02 Peixin Wang , Tengshun Yang , Hongfei Fu , Guanyan Li , C. -H. Luke Ong

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of…

Numerical Analysis · Mathematics 2015-06-18 Matthias Gehre , Bangti Jin

We consider the problem of diagnosing faults in a system represented by a Bayesian network, where diagnosis corresponds to recovering the most likely state of unobserved nodes given the outcomes of tests (observed nodes). Finding an optimal…

Artificial Intelligence · Computer Science 2012-07-09 Alice X. Zheng , Irina Rish , Alina Beygelzimer

Automatic workflow generation is the process of automatically synthesizing sequences of LLM calls, tool invocations, and post-processing steps for complex end-to-end tasks. Most prior methods cast this task as an optimization problem with…

Machine Learning · Computer Science 2026-02-02 Bo Yuan , Yun Zhou , Zhichao Xu , Kiran Ramnath , Aosong Feng , Balasubramaniam Srinivasan

This paper presents a new method for automatically generating numerical invariants for imperative programs. Given a program, our procedure computes a binary input/output relation on program states which over-approximates the behaviour of…

Programming Languages · Computer Science 2015-02-03 Azadeh Farzan , Zachary Kincaid

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Probabilistic logic programs are logic programs in which some of the facts are annotated with probabilities. This paper investigates how classical inference and learning tasks known from the graphical model community can be tackled for…

Artificial Intelligence · Computer Science 2020-02-19 Daan Fierens , Guy Van den Broeck , Joris Renkens , Dimitar Shterionov , Bernd Gutmann , Ingo Thon , Gerda Janssens , Luc De Raedt

Approximate Bayesian inference methods provide a powerful suite of tools for finding approximations to intractable posterior distributions. However, machine learning applications typically involve selecting actions, which -- in a Bayesian…

Machine Learning · Statistics 2022-01-11 Michael J. Morais , Jonathan W. Pillow

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

One of the main challenges in the analysis of probabilistic programs is to compute invariant properties that summarise loop behaviours. Automation of invariant generation is still at its infancy and most of the times targets only expected…

Symbolic Computation · Computer Science 2019-05-30 Ezio Bartocci , Laura Kovács , Miroslav Stankovič

We present a formulation of the problem of probabilistic model checking as one of query evaluation over probabilistic logic programs. To the best of our knowledge, our formulation is the first of its kind, and it covers a rich class of…

Logic in Computer Science · Computer Science 2012-04-24 Andrey Gorlin , C. R. Ramakrishnan , Scott A. Smolka

Provably correct software is one of the key challenges of our software-driven society. Program synthesis -- the task of constructing a program satisfying a given specification -- is one strategy for achieving this. The result of this task…

Logic in Computer Science · Computer Science 2022-06-24 Andreas Humenberger , Daneshvar Amrollahi , Nikolaj Bjørner , Laura Kovács

When using Bayesian inference to support conservative software reliability assessments, it is useful to consider a collection of Bayesian inference problems, with the aim of determining the worst-case value (from this collection) for a…

Applications · Statistics 2025-11-11 Kizito Salako , Rabiu Tsoho Muhammad

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper