中文
相关论文

相关论文: Variational Inference with Coverage Guarantees in …

200 篇论文

In this work, we investigate the large-scale mean-field variational inference (MFVI) problem from a mini-batch primal-dual perspective. By reformulating MFVI as a constrained finite-sum problem, we develop a novel primal-dual algorithm…

机器学习 · 统计学 2026-02-11 Jinhua Lyu , Tianmin Yu , Ying Ma , Naichen Shi

Recent advances in neural density estimation have enabled powerful simulation-based inference (SBI) methods that can flexibly approximate Bayesian inference for intractable stochastic models. Although these methods have demonstrated…

机器学习 · 统计学 2025-12-17 Matthew O'Callaghan , Kaisey S. Mandel , Gerry Gilmore

We extend the existing framework of semi-implicit variational inference (SIVI) and introduce doubly semi-implicit variational inference (DSIVI), a way to perform variational inference and learning when both the approximate posterior and the…

机器学习 · 统计学 2019-03-19 Dmitry Molchanov , Valery Kharitonov , Artem Sobolev , Dmitry Vetrov

We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample,…

统计理论 · 数学 2022-03-02 Leying Guan

Variational inference is a popular method for estimating model parameters and conditional distributions in hierarchical and mixed models, which arise frequently in many settings in the health, social, and biological sciences. Variational…

统计方法学 · 统计学 2019-01-10 Ted Westling , Tyler H. McCormick

In many scientific applications, uncertainty of estimates from an earlier (upstream) analysis needs to be propagated in subsequent (downstream) Bayesian analysis, without feedback. Cutting feedback methods, also termed cut-Bayes, achieve…

机器学习 · 统计学 2025-10-28 Jiafang Song , Sandipan Pramanik , Abhirup Datta

We develop scalable methods for producing conformal Bayesian predictive intervals with finite sample calibration guarantees. Bayesian posterior predictive distributions, $p(y \mid x)$, characterize subjective beliefs on outcomes of…

统计方法学 · 统计学 2021-06-15 Edwin Fong , Chris Holmes

Conformal prediction is a powerful distribution-free framework for constructing prediction sets with coverage guarantees. Classical methods, such as split conformal prediction, provide marginal coverage, ensuring that the prediction set…

机器学习 · 计算机科学 2025-08-01 Konstantina Bairaktari , Jiayun Wu , Zhiwei Steven Wu

The mean field variational Bayes (VB) algorithm implemented in Stan is relatively fast and efficient, making it feasible to produce model-estimated official statistics on a rapid timeline. Yet, while consistent point estimates of parameters…

统计方法学 · 统计学 2024-07-08 Terrance D. Savitsky , Julie Gershunskaya

Conformal predictors are an important class of algorithms that allow predictions to be made with a user-defined confidence level. They are able to do this by outputting prediction sets, rather than simple point predictions. The conformal…

机器学习 · 计算机科学 2021-05-25 Anthony Bellotti

Conformal prediction offers a distribution-free framework for constructing prediction sets with coverage guarantees. In practice, multiple valid conformal prediction sets may be available, arising from different models or methodologies.…

机器学习 · 统计学 2025-06-26 Mahmoud Hegazy , Liviu Aolaritei , Michael I. Jordan , Aymeric Dieuleveut

Estimating a distribution given access to its unnormalized density is pivotal in Bayesian inference, where the posterior is generally known only up to an unknown normalizing constant. Variational inference and Markov chain Monte Carlo…

机器学习 · 统计学 2025-05-06 Daniel Ward , Mark Beaumont , Matteo Fasiolo

In this paper, we introduce a new form of amortized variational inference by using the forward KL divergence in a joint-contrastive variational loss. The resulting forward amortized variational inference is a likelihood-free method as its…

In imaging inverse problems, one seeks to recover an image from missing/corrupted measurements. Because such problems are ill-posed, there is great motivation to quantify the uncertainty induced by the measurement-and-recovery process.…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Jeffrey Wen , Rizwan Ahmad , Philip Schniter

The main computational challenge in Bayesian inference is to compute integrals against a high-dimensional posterior distribution. In the past decades, variational inference (VI) has emerged as a tractable approximation to these integrals,…

统计理论 · 数学 2024-01-09 Anya Katsevich , Philippe Rigollet

Stochastic variational inference offers an attractive option as a default method for differentiable probabilistic programming. However, the performance of the variational approach depends on the choice of an appropriate variational family.…

机器学习 · 统计学 2021-02-11 Luca Ambrogioni , Kate Lin , Emily Fertig , Sharad Vikram , Max Hinne , Dave Moore , Marcel van Gerven

Zero-shot diffusion posterior sampling offers a flexible framework for inverse problems by accommodating arbitrary degradation operators at test time, but incurs high computational cost due to repeated likelihood-guided updates. In…

机器学习 · 统计学 2026-02-10 Léon Zheng , Thomas Hirtz , Yazid Janati , Eric Moulines

The multinomial probit (MNP) model is widely used to analyze categorical outcomes due to its ability to capture flexible substitution patterns among alternatives. Conventional likelihood based and Markov chain Monte Carlo (MCMC) estimators…

统计方法学 · 统计学 2026-01-08 Gyeongjun Kim , Yeseul Kang , Lucas Kock , Prateek Bansal , Keemin Sohn

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Conservative inference is a major concern in simulation-based inference. It has been shown that commonly used algorithms can produce overconfident posterior approximations. Balancing has empirically proven to be an effective way to mitigate…