English
Related papers

Related papers: Guaranteed Bounds for Posterior Inference in Unive…

200 papers

A novel, non-trivial, probabilistic upper bound on the entropy of an unknown one-dimensional distribution, given the support of the distribution and a sample from that distribution, is presented. No knowledge beyond the support of the…

Information Theory · Computer Science 2007-07-13 Joseph DeStefano , Erik Learned-Miller

We present a stochastic model predictive control framework for nonlinear systems subject to unbounded process noise with closed-loop guarantees. First, we provide a conceptual shrinking-horizon framework that utilizes general probabilistic…

Systems and Control · Electrical Eng. & Systems 2025-06-06 Johannes Köhler , Melanie N. Zeilinger

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

Control policies from imitation learning can often fail to generalize to novel environments due to imperfect demonstrations or the inability of imitation learning algorithms to accurately infer the expert's policies. In this paper, we…

Robotics · Computer Science 2020-12-04 Allen Z. Ren , Sushant Veer , Anirudha Majumdar

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Learned index structures aim to accelerate queries by training machine learning models to approximate the rank function associated with a database attribute. While effective in practice, their theoretical limitations are not fully…

Data Structures and Algorithms · Computer Science 2026-01-13 Luis Alberto Croquevielle , Roman Sokolovskii , Thomas Heinis

We cast motion planning under uncertainty as a stochastic optimal control problem, where the optimal posterior distribution has an explicit form. To approximate this posterior, this work frames an optimization problem in the space of…

Robotics · Computer Science 2026-01-06 Zinuo Chang , Hongzhe Yu , Patricio Vela , Yongxin Chen

Computing the conditional mode of a distribution, better known as the $\mathit{maximum\ a\ posteriori}$ (MAP) assignment, is a fundamental task in probabilistic inference. However, MAP estimation is generally intractable, and remains hard…

Machine Learning · Computer Science 2026-01-23 Matthew Shorvon , Frederik Mallmann-Trenn , David S. Watson

A priori bound for the parameter to be estimated is incorporated into confidence intervals within frequentistic approach in a straightforward and optimal fashion, ensuring the best resolution of non-boundary values as well as robustness for…

Data Analysis, Statistics and Probability · Physics 2011-04-06 Fyodor V. Tkachov

We consider fully connected and feedforward deep neural networks with dependent and possibly heavy-tailed weights, as introduced in [26], to address limitations of the standard Gaussian prior. It has been proved in [26] that, as the number…

Machine Learning · Statistics 2026-05-14 Nicola Apollonio , Giovanni Franzina , Giovanni Luca Torrisi

Posterior computation for high-dimensional data with many parameters can be challenging. This article focuses on a new method for approximating posterior distributions of a low- to moderate-dimensional parameter in the presence of a…

Computation · Statistics 2022-04-08 Willem van den Boom , Galen Reeves , David B. Dunson

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

Gaussian processes (GPs) offer a flexible class of priors for nonparametric Bayesian regression, but popular GP posterior inference methods are typically prohibitively slow or lack desirable finite-data guarantees on quality. We develop an…

Machine Learning · Statistics 2019-03-28 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Dominik Narnhofer , Andreas Habring , Martin Holler , Thomas Pock

Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats…

Machine Learning · Statistics 2019-09-27 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in $[0,1]$. This distance plays a fundamental role in machine learning and signal…

Machine Learning · Computer Science 2018-07-02 Frank Nielsen , Ke Sun

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth