中文
相关论文

相关论文: Neuronized Priors for Bayesian Sparse Linear Regre…

200 篇论文

Modeled along the truncated approach in Panigrahi (2016), selection-adjusted inference in a Bayesian regime is based on a selective posterior. Such a posterior is determined together by a generative model imposed on data and the selection…

统计方法学 · 统计学 2017-09-12 Snigdha Panigrahi , Jonathan Taylor

We present a novel Bayesian approach for high-dimensional grouped regression under sparsity. We leverage a sparse projection method that uses a sparsity-inducing map to derive an induced posterior on a lower-dimensional parameter space. Our…

统计方法学 · 统计学 2026-05-25 Samhita Pal , Subhashis Ghosal

Predictive inference in the sparse Gaussian sequence model has received considerably less attention than its non-sparse, finite-sample counterpart. Existing work has largely been confined to discrete mixture priors. In this paper, we study…

统计理论 · 数学 2026-04-21 Percy S. Zhai , Veronika Ročková

This paper develops a slice sampler for Bayesian linear regression models with arbitrary priors. The new sampler has two advantages over current approaches. One, it is faster than many custom implementations that rely on auxiliary latent…

统计计算 · 统计学 2018-06-18 P. Richard Hahn , Jingyu He , Hedibert Lopes

This study proposes a novel hierarchical prior for inferring possibly low-rank matrices measured with noise. We consider three-component matrix factorization, as in singular value decomposition, and its fully Bayesian inference. The…

统计方法学 · 统计学 2020-10-09 Masahiro Tanaka

We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…

统计理论 · 数学 2009-09-29 Aad van der Vaart , Harry van Zanten

Bayesian approaches for learning deep neural networks (BNN) have been received much attention and successfully applied to various applications. Particularly, BNNs have the merit of having better generalization ability as well as better…

机器学习 · 统计学 2023-05-25 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Gyuseung Baek , Yongdai Kim

This paper presents the use of spike-and-slab (SS) priors for discovering governing differential equations of motion of nonlinear structural dynamic systems. The problem of discovering governing equations is cast as that of selecting…

统计方法学 · 统计学 2021-06-02 Rajdip Nayek , Ramon Fuentes , Keith Worden , Elizabeth J. Cross

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

Feed-forward neural networks (NN) are a staple machine learning method widely used in many areas of science and technology. While even a single-hidden layer NN is a universal approximator, its expressive power is limited by the use of…

机器学习 · 统计学 2023-09-28 Sergei Manzhos , Manabu Ihara

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

机器学习 · 统计学 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Bayesian neural networks provide a direct and natural way to extend standard deep neural networks to support probabilistic deep learning through the use of probabilistic layers that, traditionally, encode weight (and bias) uncertainty. In…

机器学习 · 计算机科学 2021-07-16 Daniel T. Chang

There has been an intense development on the estimation of a sparse regression coefficient vector in statistics, machine learning and related fields. In this paper, we focus on the Bayesian approach to this problem, where sparsity is…

统计计算 · 统计学 2016-02-25 Xichen Huang , Jin Wang , Feng Liang

While Bayesian neural networks have many appealing characteristics, current priors do not easily allow users to specify basic properties such as expected lengthscale or amplitude variance. In this work, we introduce Poisson Process Radial…

机器学习 · 计算机科学 2019-12-13 Beau Coker , Melanie F. Pradier , Finale Doshi-Velez

We consider exact algorithms for Bayesian inference with model selection priors (including spike-and-slab priors) in the sparse normal sequence model. Because the best existing exact algorithm becomes numerically unstable for sample sizes…

统计方法学 · 统计学 2020-04-16 Tim van Erven , Botond Szabo

Locally adaptive shrinkage in the Bayesian framework is achieved through the use of local-global prior distributions that model both the global level of sparsity as well as individual shrinkage parameters for mean structure parameters. The…

统计理论 · 数学 2019-03-05 Andrew Womack , Zikun Yang

Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference, the prior distribution must be shaped by sampling noisy external…

神经元与认知 · 定量生物学 2022-10-25 Kohei Ichikawa , Kunihiko Kaneko

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

机器学习 · 计算机科学 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

In the literature surrounding Bayesian penalized regression, the two primary choices of prior distribution on the regression coefficients are zero-mean Gaussian and Laplace. While both have been compared numerically and theoretically, there…

统计方法学 · 统计学 2010-01-26 Luke Bornn , Raphael Gottardo , Arnaud Doucet

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

机器学习 · 统计学 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto