English
Related papers

Related papers: On Global-local Shrinkage Priors for Count Data

200 papers

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be…

Machine Learning · Computer Science 2024-07-22 Giovanni Piccioli , Emanuele Troiani , Lenka Zdeborová

Motivated by the increasing use of and rapid changes in array technologies, we consider the prediction problem of fitting a linear regression relating a continuous outcome $Y$ to a large number of covariates $\mathbf {X}$, for example,…

Applications · Statistics 2014-01-13 Philip S. Boonstra , Bhramar Mukherjee , Jeremy M. G. Taylor

In recent years, Bayesian inference in large-scale inverse problems found in science, engineering and machine learning has gained significant attention. This paper examines the robustness of the Bayesian approach by analyzing the stability…

Machine Learning · Statistics 2023-03-06 Alfredo Garbuno-Inigo , Tapio Helin , Franca Hoffmann , Bamdad Hosseini

We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable both statistically…

Computation · Statistics 2023-07-13 Qijia Jiang

The Frequentist, Assisted by Bayes (FAB) framework constructs confidence regions that leverage prior information about parameter values. FAB confidence regions (FAB-CRs) have smaller volume for values of the parameter that are likely under…

Methodology · Statistics 2025-07-01 Stefano Cortinovis , François Caron

We investigate the asymptotic behavior of posterior distributions of regression coefficients in high-dimensional linear models as the number of dimensions grows with the number of observations. We show that the posterior distribution…

Methodology · Statistics 2018-03-06 Artin Armagan , David B. Dunson , Jaeyong Lee , Waheed U. Bajwa , Nate Strawn

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

The proposed approach extends the confidence posterior distribution to the semi-parametric empirical Bayes setting. Whereas the Bayesian posterior is defined in terms of a prior distribution conditional on the observed data, the confidence…

Methodology · Statistics 2012-05-02 David R. Bickel

Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical. This paper…

Methodology · Statistics 2023-09-04 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

Time-varying parameter (TVP) regression models can involve a huge number of coefficients. Careful prior elicitation is required to yield sensible posterior and predictive inferences. In addition, the computational demands of Markov Chain…

Econometrics · Economics 2023-05-15 Niko Hauzenberger , Florian Huber , Gary Koop

We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…

Statistics Theory · Mathematics 2009-09-29 Aad van der Vaart , Harry van Zanten

The need for tomographic reconstruction from sparse measurements arises when the measurement process is potentially harmful, needs to be rapid, or is uneconomical. In such cases, prior information from previous longitudinal scans of the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Preeti Gopal , Sharat Chandran , Imants Svalbe , Ajit Rajwade

Robust Bayesian analysis has been mainly devoted to detecting and measuring robustness w.r.t. the prior distribution. Many contributions in the literature aim to define suitable classes of priors which allow the computation of variations of…

Statistics Theory · Mathematics 2025-09-04 Antonio Di Noia , Fabrizio Ruggeri , Antonietta Mira

An influential line of recent work has focused on the generalization properties of unregularized gradient-based learning procedures applied to separable linear classification with exponentially-tailed loss functions. The ability of such…

Machine Learning · Computer Science 2022-06-24 Matan Schliserman , Tomer Koren

This paper studies the influence of perturbations of conjugate priors in Bayesian inference. A perturbed prior is defined inside a larger family, local mixture models, and the effect on posterior inference is studied. The perturbation, in…

Methodology · Statistics 2015-09-01 Vahed Maroufy , Paul Marriott

In this paper, we propose the application of shrinkage strategies to estimate coefficients in the Bell regression models when prior information about the coefficients is available. The Bell regression models are well-suited for modeling…

Statistics Theory · Mathematics 2024-01-03 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Motivated by the proliferation of extensive macroeconomic and health datasets necessitating accurate forecasts, a novel approach is introduced to address Vector Autoregressive (VAR) models. This approach employs the global-local…

Methodology · Statistics 2024-03-06 Luca Rossini , Cristiano Villa , Sotiris Prevenas , Rachel McCrea

Stochastic gradient descent (SGD) and its variants enable modern artificial intelligence. However, theoretical understanding lags far behind their empirical success. It is widely believed that SGD has a curious ability to avoid sharp local…

Machine Learning · Computer Science 2025-10-27 Xingyu Wang , Chang-Han Rhee

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

We study how the posterior contraction rate under a Gaussian process (GP) prior depends on the intrinsic dimension of the predictors and the smoothness of the regression function. An open question is whether a generic GP prior that does not…

Statistics Theory · Mathematics 2025-06-26 Tao Tang , Nan Wu , Xiuyuan Cheng , David Dunson