中文
相关论文

相关论文: Fast Exact Bayesian Inference for Sparse Signals i…

200 篇论文

In this article, we propose a novel spatial global-local spike-and-slab selection prior for image-on-scalar regression. We consider a Bayesian hierarchical Gaussian process model for image smoothing, that uses a flexible Inverse-Wishart…

统计方法学 · 统计学 2022-12-19 Zijian Zeng , Meng Li , Marina Vannucci

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

This paper introduces a novel Bayesian approach for variable selection in high-dimensional and potentially sparse regression settings. Our method replaces the indicator variables in the traditional spike and slab prior with continuous,…

统计方法学 · 统计学 2025-02-07 Linduni M. Rodrigo , Robert Kohn , Hadi M. Afshar , Sally Cripps

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

统计理论 · 数学 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

Model selection in machine learning (ML) is a crucial part of the Bayesian learning procedure. Model choice may impose strong biases on the resulting predictions, which can hinder the performance of methods such as Bayesian neural networks…

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

数值分析 · 数学 2021-03-17 Yating Wang , Wei Deng , Lin Guang

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

机器学习 · 统计学 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

Predictive inference in the sparse Gaussian sequence model has received considerably less attention than its non-sparse, finite-sample counterpart. Existing work has largely been confined to discrete mixture priors. In this paper, we study…

统计理论 · 数学 2026-04-21 Percy S. Zhai , Veronika Ročková

Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the…

统计计算 · 统计学 2022-10-25 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Sparse principal component analysis (SPCA) is a popular tool for dimensionality reduction in high-dimensional data. However, there is still a lack of theoretically justified Bayesian SPCA methods that can scale well computationally. One of…

统计方法学 · 统计学 2023-08-08 Bo Y. -C. Ning , Ning Ning

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

机器学习 · 统计学 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

统计方法学 · 统计学 2025-04-08 Qiushuang Li , Recai Yucel

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless,…

信息论 · 计算机科学 2015-01-21 Fuwei Li , Jun Fang , Huiping Duan , Zhi Chen , Hongbin Li

In this paper, we propose a scalable Bayesian method for sparse covariance matrix estimation by incorporating a continuous shrinkage prior with a screening procedure. In the first step of the procedure, the off-diagonal elements with small…

统计方法学 · 统计学 2023-11-22 Kyoungjae Lee , Seongil Jo , Kyeongwon Lee , Jaeyong Lee

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

机器学习 · 计算机科学 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

In high-dimensional generalized linear models, it is crucial to identify a sparse model that adequately accounts for response variation. Although the best subset section has been widely regarded as the Holy Grail of problems of this type,…

机器学习 · 统计学 2023-08-02 Junxian Zhu , Jin Zhu , Borui Tang , Xuanyu Chen , Hongmei Lin , Xueqin Wang

Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large…

数值分析 · 数学 2021-10-12 Feng Wu , Kailing Zhang , Li Zhu , Jiayao Hu

Scientists continue to develop increasingly complex mechanistic models to reflect their knowledge more realistically. Statistical inference using these models can be challenging since the corresponding likelihood function is often…

统计计算 · 统计学 2026-01-07 Joshua J Bon , David J Warne , David J Nott , Christopher Drovandi

Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of…

机器学习 · 计算机科学 2022-11-28 Jonas Beck , Michael Deistler , Yves Bernaerts , Jakob Macke , Philipp Berens

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

机器学习 · 计算机科学 2018-12-10 Xueqiang Zeng , Gang Luo