English
Related papers

Related papers: Fast Variational Block-Sparse Bayesian Learning

200 papers

Bayesian model selection procedures based on nonlocal alternative prior densities are extended to ultrahigh dimensional settings and compared to other variable selection procedures using precision-recall curves. Variable selection…

Methodology · Statistics 2017-01-19 Minsuk Shin , Anirban Bhattacharya , Valen E. Johnson

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

This paper begins with considering the identification of sparse linear time-invariant networks described by multivariable ARX models. Such models possess relatively simple structure thus used as a benchmark to promote further research. With…

Systems and Control · Computer Science 2016-10-03 J. Jin , Y. Yuan , W. Pan , D. L. T. Pham , C. J. Tomlin , A. Webb , J. Goncalves

We propose a Machine Learning approach for optimal macroeconomic density forecasting in a high-dimensional setting where the underlying model exhibits a known group structure. Our approach is general enough to encompass specific forecasting…

Econometrics · Economics 2024-11-18 Matteo Mogliani , Anna Simoni

We study high-dimensional Bayesian linear regression with a general beta prime distribution for the scale parameter. Under the assumption of sparsity, we show that appropriate selection of the hyperparameters in the beta prime prior leads…

Methodology · Statistics 2019-07-19 Ray Bai , Malay Ghosh

Posterior distributions arising in ill-posed Bayesian inverse problems are often both analytically intractable and highly sensitive to parameters of the chosen prior family. We aim to understand the sensitivity of intractable posterior…

Methodology · Statistics 2026-04-20 Yucong Liu , Zilai Si , Alexander Strang

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

We consider the problem of estimating complex statistical latent variable models using variational Bayes methods. These methods are used when exact posterior inference is either infeasible or computationally expensive, and they approximate…

Methodology · Statistics 2025-02-28 David Gunawan , David Nott , Robert Kohn

Bayesian flow networks (BFNs) iteratively refine the parameters, instead of the samples in diffusion models (DMs), of distributions at various noise levels through Bayesian inference. Owing to its differentiable nature, BFNs are promising…

Machine Learning · Computer Science 2024-06-04 Kaiwen Xue , Yuhao Zhou , Shen Nie , Xu Min , Xiaolu Zhang , Jun Zhou , Chongxuan Li

Bayesian synthetic likelihood (BSL) is a popular method for performing approximate Bayesian inference when the likelihood function is intractable. In synthetic likelihood methods, the likelihood function is approximated parametrically via…

Computation · Statistics 2020-07-06 Jacob W. Priddle , Christopher Drovandi

This paper presents a sparse Bayesian learning (SBL) algorithm for linear inverse problems with a high order total variation (HOTV) sparsity prior. For the problem of sparse signal recovery, SBL often produces more accurate estimates than…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Victor Churchill , Anne Gelb

This study addresses the problem of discrete signal reconstruction from the perspective of sparse Bayesian learning (SBL). Generally, it is intractable to perform the Bayesian inference with the ideal discretization prior under the SBL…

Signal Processing · Electrical Eng. & Systems 2023-04-19 Jisheng Dai , An Liu , Hing Cheung So

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

The stochastic block model (SBM) is a generative model revealing macroscopic structures in graphs. Bayesian methods are used for (i) cluster assignment inference and (ii) model selection for the number of clusters. In this paper, we study…

Machine Learning · Computer Science 2016-02-09 Kohei Hayashi , Takuya Konishi , Tatsuro Kawamoto

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

Methodology · Statistics 2025-09-16 Gregor Zens , Mark F. J. Steel

We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we…

Methodology · Statistics 2025-04-16 Nicolas Bianco , Mauro Bernardi , Daniele Bianchi

Many probabilistic models of interest in scientific computing and machine learning have expensive, black-box likelihoods that prevent the application of standard techniques for Bayesian inference, such as MCMC, which would require access to…

Machine Learning · Statistics 2018-11-30 Luigi Acerbi

The Variational Bayesian method (VB) is used to solve the probability distributions of latent variables with the minimum free energy criterion. This criterion is not easy to understand, and the computation is complex. For these reasons,…

Machine Learning · Computer Science 2026-05-01 Chenguang Lu

A robust uncertainty estimate in global analyses of Parton Distribution Functions (PDFs) is essential at the Large Hadron Collider (LHC), especially in view of the high-precision data anticipated by experimentalists in the High-Luminosity…

High Energy Physics - Phenomenology · Physics 2026-04-14 Mark N. Costantini , Luca Mantani , James M. Moore , Maria Ubiali

Super-resolution methods form high-resolution images from low-resolution images. In this paper, we develop a new Bayesian nonparametric model for super-resolution. Our method uses a beta-Bernoulli process to learn a set of recurring visual…

Machine Learning · Computer Science 2012-09-25 Gungor Polatkan , Mingyuan Zhou , Lawrence Carin , David Blei , Ingrid Daubechies