English
Related papers

Related papers: Shrinkage with Robustness: Log-Adjusted Priors for…

200 papers

The impracticality of posterior sampling has prevented the widespread adoption of spike-and-slab priors in high-dimensional applications. To alleviate the computational burden, optimization strategies have been proposed that quickly find…

Methodology · Statistics 2021-03-30 Lizhen Nie , Veronika Ročková

Both parametric distribution functions appearing in extreme value theory - the generalized extreme value distribution and the generalized Pareto distribution - have log-concave densities if the extreme value index gamma is in [-1,0].…

Statistics Theory · Mathematics 2023-04-17 Samuel Müller , Kaspar Rufibach

Factor Analysis has traditionally been utilized across diverse disciplines to extrapolate latent traits that influence the behavior of multivariate observed variables. Historically, the focus has been on analyzing data from a single study,…

Methodology · Statistics 2026-01-22 Elena Bortolato , Antonio Canale

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

Statistics Theory · Mathematics 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

Statistics Theory · Mathematics 2025-06-17 Takeyuki Sasai , Hironori Fujisawa

Consider the problem of high dimensional variable selection for the Gaussian linear model when the unknown error variance is also of interest. In this paper, we show that the use of conjugate shrinkage priors for Bayesian variable selection…

Methodology · Statistics 2025-04-17 Gemma E. Moran , Veronika Rockova , Edward I. George

Robust and sparse estimation of linear regression coefficients is investigated. The situation addressed by the present paper is that covariates and noises are sampled from heavy-tailed distributions, and the covariates and noises are…

Machine Learning · Statistics 2022-10-11 Takeyuki Sasai

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

Statistics Theory · Mathematics 2007-06-13 Hemant Ishwaran , J. Sunil Rao

Bayesian neural networks (BNNs) treat neural network weights as random variables, which aim to provide posterior uncertainty estimates and avoid overfitting by performing inference on the posterior weights. However, the selection of…

Machine Learning · Computer Science 2025-05-27 Tsai Hor Chan , Dora Yan Zhang , Guosheng Yin , Lequan Yu

Many approximate Bayesian inference methods assume a particular parametric form for approximating the posterior distribution. A multivariate Gaussian distribution provides a convenient density for such approaches; examples include the…

Methodology · Statistics 2023-02-20 Jackson Zhou , Clara Grazian , John Ormerod

We generalize the targeted $\mathcal{B}$-statistic for continuous gravitational waves by modeling the $h_0$-prior as a half-Gaussian distribution with scale parameter $H$. This approach retains analytic tractability for two of the four…

General Relativity and Quantum Cosmology · Physics 2026-02-27 Reinhard Prix

Signal denoising---also known as non-parametric regression---is often performed through shrinkage estimation in a transformed (e.g., wavelet) domain; shrinkage in the transformed domain corresponds to smoothing in the original domain. A key…

Methodology · Statistics 2020-09-09 Zhengrong Xing , Peter Carbonetto , Matthew Stephens

Robust Bayesian analysis has been mainly devoted to detecting and measuring robustness w.r.t. the prior distribution. Many contributions in the literature aim to define suitable classes of priors which allow the computation of variations of…

Statistics Theory · Mathematics 2025-09-04 Antonio Di Noia , Fabrizio Ruggeri , Antonietta Mira

We propose a new prior for ultra-sparse signal detection that we term the "horseshoe+ prior." The horseshoe+ prior is a natural extension of the horseshoe prior that has achieved success in the estimation and detection of sparse signals and…

Statistics Theory · Mathematics 2015-06-16 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

This paper studies posterior contraction rates in multi-category logit models with priors incorporating group sparse structures. We consider a general class of logit models that includes the well-known multinomial logit models as a special…

Statistics Theory · Mathematics 2022-02-01 Seonghyun Jeong

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

In this paper, we consider simultaneous estimation of Poisson parameters in situations where we can use side information in aggregated data. We use standardized squared error and entropy loss functions. Bayesian shrinkage estimators are…

Statistics Theory · Mathematics 2023-11-06 Yasuyuki Hamura

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij