English
Related papers

Related papers: Synthesizing Probabilistic Invariants via Doob's D…

200 papers

We propose a simple technique for verifying probabilistic models whose transition probabilities are parametric. The key is to replace parametric transitions by nondeterministic choices of extremal values. Analysing the resulting…

Logic in Computer Science · Computer Science 2016-05-27 Tim Quatmann , Christian Dehnert , Nils Jansen , Sebastian Junges , Joost-Pieter Katoen

Probabilistic programming is the idea of writing models from statistics and machine learning using program notations and reasoning about these models using generic inference engines. Recently its combination with deep learning has been…

Programming Languages · Computer Science 2019-11-19 Wonyeol Lee , Hangyeol Yu , Xavier Rival , Hongseok Yang

The computational burden of probabilistic inference remains a hurdle for applying probabilistic programming languages to practical problems of interest. In this work, we provide a semantic and algorithmic foundation for efficient exact…

Programming Languages · Computer Science 2019-07-02 Steven Holtzen , Todd Millstein , Guy Van den Broeck

We provide an overview on how to use the measurable selection techniques to derive the dynamic programming principle for a general stochastic optimal control/stopping problem. By considering its martingale problem formulation on the…

Optimization and Control · Mathematics 2024-10-03 Nicole El Karoui , Xiaolu Tan

The concept of finitely additive supermartingales, originally due to Bochner, is revived and developed. We exploit it to study measure decompositions over filtered probability spaces and the properties of the associated Dol\'{e}ans-Dade…

Probability · Mathematics 2008-04-21 Gianluca Cassese

We present a methodology for obtaining explicit solutions to infinite time horizon optimal stopping problems involving general, one-dimensional, It\^o diffusions, payoff functions that need not be smooth and state-dependent discounting.…

Computational Finance · Quantitative Finance 2012-10-10 Timothy C. Johnson

Probabilistic programming has emerged as a powerful paradigm in statistics, applied science, and machine learning: by decoupling modelling from inference, it promises to allow modellers to directly reason about the processes generating…

Machine Learning · Statistics 2019-06-10 Maria I. Gorinova , Dave Moore , Matthew D. Hoffman

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to…

Statistical Mechanics · Physics 2021-01-14 Tom H. E. Oakes , Adam Moss , Juan P. Garrahan

Formalisms for specifying statistical models, such as probabilistic-programming languages, typically consist of two components: a specification of a stochastic process (the prior), and a specification of observations that restrict the…

Databases · Computer Science 2015-01-06 Vince Barany , Balder ten Cate , Benny Kimelfeld , Dan Olteanu , Zografoula Vagena

Consider a setting where there are $N$ heterogeneous units and $p$ interventions. Our goal is to learn unit-specific potential outcomes for any combination of these $p$ interventions, i.e., $N \times 2^p$ causal parameters. Choosing a…

Methodology · Statistics 2024-01-17 Abhineet Agarwal , Anish Agarwal , Suhas Vijaykumar

Every submartingale S of class D has a unique Doob-Meyer decomposition S=M+A, where M is a martingale and A is a predictable increasing process starting at 0. We provide a short and elementary prove of the Doob-Meyer decomposition theorem.…

Probability · Mathematics 2010-12-24 Mathias Beiglboeck , Walter Schachermayer , Bezirgen Veliyev

We present new techniques for automatically constructing probabilistic programs for data analysis, interpretation, and prediction. These techniques work with probabilistic domain-specific data modeling languages that capture key properties…

Programming Languages · Computer Science 2019-07-16 Feras A. Saad , Marco F. Cusumano-Towner , Ulrich Schaechtle , Martin C. Rinard , Vikash K. Mansinghka

We define dynamic treatment regimes and associated potential outcomes for data described by marked point processes (MPPs). These definitions motivate MPP analogues of the commonly used consistency, exchangeability, and positivity conditions…

Methodology · Statistics 2026-04-15 Pål Christie Ryalen , Mats Julius Stensrud , Kjetil Røysland

We introduce the concept of structured synthesis for Markov decision processes where the structure is induced from finitely many pre-specified options for a system configuration. The resulting synthesis problem is in general a nonlinear…

Software Engineering · Computer Science 2018-07-18 Nils Jansen , Laura Humphrey , Jana Tumova , Ufuk Topcu

Inference metaprogramming enables effective probabilistic programming by supporting the decomposition of executions of probabilistic programs into subproblems and the deployment of hybrid probabilistic inference algorithms that apply…

Programming Languages · Computer Science 2019-07-16 Shivam Handa , Vikash Mansinghka , Martin Rinard

The termination behavior of probabilistic programs depends on the outcomes of random assignments. Almost sure termination (AST) is concerned with the question whether a program terminates with probability one on all possible inputs.…

Programming Languages · Computer Science 2021-01-29 Marcel Moosbrugger , Ezio Bartocci , Joost-Pieter Katoen , Laura Kovács

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from…

Machine Learning · Computer Science 2013-01-30 Thomas Hofmann

The aim of a probabilistic output analysis is to derive a probability distribution of possible output values for a program from a probability distribution of its input. We present a method for performing static output analysis, based on…

Programming Languages · Computer Science 2015-09-30 Mads Rosendahl , Maja H. Kirkeby

The study of stochastic variational principles involves the problem of constructing fixed-endpoint and adapted variations of semimartingales. We provide a detailed construction of variations of semimartingales that are not only fixed at…

Mathematical Physics · Physics 2025-09-11 Archishman Saha