中文
相关论文

相关论文: Bend to Mend: Toward Trustworthy Variational Bayes…

200 篇论文

Computer models play a crucial role in numerous scientific and engineering domains. To ensure the accuracy of simulations, it is essential to properly calibrate the input parameters of these models through statistical inference. While…

应用统计 · 统计学 2024-03-07 Dongkyu Derek Cho , Won Chang , Jaewoo Park

Variational Bayes methods approximate the posterior density by a family of tractable distributions whose parameters are estimated by optimisation. Variational approximation is useful when exact inference is intractable or very costly. Our…

统计计算 · 统计学 2023-08-15 David Gunawan , Robert Kohn , David Nott

We propose a computationally efficient method to construct nonparametric, heteroscedastic prediction bands for uncertainty quantification, with or without any user-specified predictive model. Our approach provides an alternative to the…

机器学习 · 统计学 2023-01-18 Tengyuan Liang

The practice of uncertainty quantification (UQ) validation, notably in machine learning for the physico-chemical sciences, rests on several graphical methods (scattering plots, calibration curves, reliability diagrams and confidence curves)…

化学物理 · 物理学 2023-03-31 Pascal Pernot

In this paper, we study the behavior of the Upper Confidence Bound-Variance (UCB-V) algorithm for the Multi-Armed Bandit (MAB) problems, a variant of the canonical Upper Confidence Bound (UCB) algorithm that incorporates variance estimates…

机器学习 · 统计学 2025-02-18 Yingying Fan , Yuxuan Han , Jinchi Lv , Xiaocong Xu , Zhengyuan Zhou

Recent years have witnessed an upsurge of interest in employing flexible machine learning models for instrumental variable (IV) regression, but the development of uncertainty quantification methodology is still lacking. In this work we…

机器学习 · 统计学 2021-11-04 Ziyu Wang , Yuhao Zhou , Tongzheng Ren , Jun Zhu

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

In this paper, we consider the problem of parametric empirical Bayes estimation of an i.i.d. prior in high-dimensional Bayesian linear regression, with random design. We obtain the asymptotic distribution of the variational Empirical Bayes…

统计理论 · 数学 2026-02-25 Seunghyun Lee , Nabarun Deb

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

机器学习 · 计算机科学 2024-01-24 Sebastian W. Ober

Variational inference (VI) provides fast approximations of a Bayesian posterior in part because it formulates posterior approximation as an optimization problem: to find the closest distribution to the exact posterior over some family of…

机器学习 · 统计学 2017-03-03 Fangjian Guo , Xiangyu Wang , Kai Fan , Tamara Broderick , David B. Dunson

The deployment of deep neural networks in safety-critical systems necessitates reliable and efficient uncertainty quantification (UQ). A practical and widespread strategy for UQ is repurposing stochastic regularizers as scalable approximate…

机器学习 · 计算机科学 2026-04-15 Adam T. Müller , Tobias Rögelein , Nicolaj C. Stache

Bayesian statistics has gained popularity in psychological research due to its intuitive uncertainty quantification and convenient information-updating rules. In many applications, however, prior distributions are introduced merely as…

统计方法学 · 统计学 2026-03-10 Yang Liu , Jonathan P. Williams , Jan Hannig

We study a mean-field spike and slab variational Bayes (VB) approximation to Bayesian model selection priors in sparse high-dimensional linear regression. Under compatibility conditions on the design matrix, oracle inequalities are derived…

统计方法学 · 统计学 2020-11-20 Kolyan Ray , Botond Szabo

The problem of adaptive sampling for estimating probability mass functions (pmf) uniformly well is considered. Performance of the sampling strategy is measured in terms of the worst-case mean squared error. A Bayesian variant of the…

统计方法学 · 统计学 2020-12-09 Dhruva Kartik , Neeraj Sood , Urbashi Mitra , Tara Javidi

We propose a simple approach that provides accurate uncertainty quantification for Bayesian inference in misspecified or approximate models, and for generalized (Gibbs) posteriors. While existing solutions in this context are based on…

统计方法学 · 统计学 2026-03-11 David T. Frazier , Christopher Drovandi , Robert Kohn

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

机器学习 · 计算机科学 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

The Mean Field Variational Bayes (MFVB) method is one of the most computationally efficient techniques for Bayesian inference. However, its use has been restricted to models with conjugate priors or those that require analytical…

统计计算 · 统计学 2023-05-18 Minh-Ngoc Tran , Paco Tseng , Robert Kohn

Probabilistic approaches for tensor factorization aim to extract meaningful structure from incomplete data by postulating low rank constraints. Recently, variational Bayesian (VB) inference techniques have successfully been applied to large…

机器学习 · 计算机科学 2014-10-01 Beyza Ermis , A. Taylan Cemgil

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the…

核理论 · 物理学 2022-09-28 Pablo Giuliani , Kyle Godbey , Edgard Bonilla , Frederi Viens , Jorge Piekarewicz

Uncertainty quantification (UQ) for adaptively collected data, such as that coming from adaptive experiments, bandits, or reinforcement learning, is necessary for critical elements of data collection such as ensuring safety and conducting…

统计理论 · 数学 2025-11-11 Kevin Du , Yash Nair , Lucas Janson