English
Related papers

Related papers: Linear Response Methods for Accurate Covariance Es…

200 papers

We consider the problem of approximate Bayesian inference in log-supermodular models. These models encompass regular pairwise MRFs with binary variables, but allow to capture high-order interactions, which are intractable for existing…

Machine Learning · Computer Science 2015-02-25 Josip Djolonga , Andreas Krause

Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become…

Methodology · Statistics 2023-06-01 Viet Hung Dao , David Gunawan , Robert Kohn , Minh-Ngoc Tran , Guy E. Hawkins , Scott D. Brown

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as Visual Question Answering (VQA) and Visual Reasoning. Bayesian methods can potentially improve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Tobias Jan Wieczorek , Nathalie Daun , Mohammad Emtiyaz Khan , Marcus Rohrbach

Latent variable (LV) models are widely used in psychological research to investigate relationships among unobservable constructs. When one-stage estimation of the overall LV model is challenging, two-stage factor score regression (FSR)…

Methodology · Statistics 2026-01-27 Yang Liu , Xiaohui Luo , Jieyuan Dong , Youjin Sung , Yueqin Hu , Hongyun Liu , Daniel J. Bauer

We develop a Bayesian framework for variable selection in linear regression with autocorrelated errors, accommodating lagged covariates and autoregressive structures. This setting occurs in time series applications where responses depend on…

Methodology · Statistics 2025-08-18 Alokesh Manna , Sujit K. Ghosh

Variational inference enables approximate posterior inference of the highly over-parameterized neural networks that are popular in modern machine learning. Unfortunately, such posteriors are known to exhibit various pathological behaviors.…

Machine Learning · Computer Science 2021-06-15 Beau Coker , Weiwei Pan , Finale Doshi-Velez

We propose Radial Bayesian Neural Networks (BNNs): a variational approximate posterior for BNNs which scales well to large models while maintaining a distribution over weight-space with full support. Other scalable Bayesian deep learning…

Machine Learning · Statistics 2021-06-01 Sebastian Farquhar , Michael Osborne , Yarin Gal

Mean-field variational inference (MFVI) is a widely used method for approximating high-dimensional probability distributions by product measures. This paper studies the stability properties of the mean-field approximation when the target…

Probability · Mathematics 2025-06-10 Shunan Sheng , Bohan Wu , Alberto González-Sanz , Marcel Nutz

We challenge the longstanding assumption that the mean-field approximation for variational inference in Bayesian neural networks is severely restrictive, and show this is not the case in deep networks. We prove several results indicating…

Machine Learning · Computer Science 2021-03-11 Sebastian Farquhar , Lewis Smith , Yarin Gal

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone

This paper studies the high-dimensional mixed linear regression (MLR) where the output variable comes from one of the two linear regression models with an unknown mixing proportion and an unknown covariance structure of the random…

Methodology · Statistics 2020-11-10 Linjun Zhang , Rong Ma , T. Tony Cai , Hongzhe Li

Fast variational approximate algorithms are developed for Bayesian semiparametric regression when the response variable is a count, i.e. a non-negative integer. We treat both the Poisson and Negative Binomial families as models for the…

Methodology · Statistics 2013-09-18 Jan Luts , Matt P. Wand

Sparse models are desirable for many applications across diverse domains as they can perform automatic variable selection, aid interpretability, and provide regularization. When fitting sparse models in a Bayesian framework, however,…

Statistics Theory · Mathematics 2020-10-15 Jeffrey P. Spence

In high-dimensions, the prior tails can have a significant effect on both posterior computation and asymptotic concentration rates. To achieve optimal rates while keeping the posterior computations relatively simple, an empirical Bayes…

Methodology · Statistics 2020-08-03 Yue Yang , Ryan Martin

We propose to perform mean-field variational inference (MFVI) in a rotated coordinate system that reduces correlations between variables. The rotation is determined by principal component analysis (PCA) of a cross-covariance matrix…

Computation · Statistics 2025-10-10 Yifan Chen , Sifan Liu

Seismic full waveform inversion (FWI) is a powerful technique to generate high resolution images of the Earth's interior. However, significant uncertainty exists in all FWI solutions due to imperfect acquisition geometries, inherent noise…

Geophysics · Physics 2026-03-13 Xuebin Zhao , Andrew Curtis

The effects of different parametrizations on the convergence of Bayesian computational algorithms for hierarchical models are well explored. Techniques such as centering, noncentering and partial noncentering can be used to accelerate…

Computation · Statistics 2015-03-20 Linda S. L. Tan , David J. Nott

Spatial concurrent linear models, in which the model coefficients are spatial processes varying at a local level, are flexible and useful tools for analyzing spatial data. One approach places stationary Gaussian process priors on the…

Applications · Statistics 2012-02-03 Zuofeng Shang , Murray K. Clayton

Estimating the uncertainty of responses from Large Language Models (LLMs) remains a critical challenge. While recent Bayesian methods have demonstrated effectiveness in quantifying uncertainty through low-rank weight updates, they typically…

Machine Learning · Statistics 2025-09-29 Haizhou Shi , Yibin Wang , Ligong Han , Huan Zhang , Hao Wang