English
Related papers

Related papers: Posterior shrinkage towards linear subspaces

200 papers

In machine learning, the selection of a promising model from a potentially large number of competing models and the assessment of its generalization performance are critical tasks that need careful consideration. Typically, model selection…

Machine Learning · Statistics 2023-02-06 Pascal Rink , Werner Brannath

Experts in a population hold (a) beliefs over a state (call these state beliefs), as well as (b) beliefs over the distribution of beliefs in the population (call these hypothetical beliefs). If these are generated via updating a common…

Theoretical Economics · Economics 2023-04-18 Jonathan Libgober

While Bayesian inference techniques are standard in cosmological analyses, it is common to interpret resulting parameter constraints with a frequentist intuition. This intuition can fail, for example, when marginalizing high-dimensional…

Cosmology and Nongalactic Astrophysics · Physics 2025-01-22 Bernardita Ried Guachalla , Dylan Britt , Daniel Gruen , Oliver Friedrich

Reconstructing a gene network from high-throughput molecular data is often a challenging task, as the number of parameters to estimate easily is much larger than the sample size. A conventional remedy is to regularize or penalize the model…

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

In this paper we adopt the familiar sparse, high-dimensional linear regression model and focus on the important but often overlooked task of prediction. In particular, we consider a new empirical Bayes framework that incorporates data in…

Statistics Theory · Mathematics 2020-07-28 Ryan Martin , Yiqi Tang

During the past decade, shrinkage priors have received much attention in Bayesian analysis of high-dimensional data. This paper establishes the posterior consistency for high-dimensional linear regression with a class of shrinkage priors,…

Statistics Theory · Mathematics 2022-10-11 Qifan Song , Faming Liang

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neural networks is…

Machine Learning · Computer Science 2019-07-18 Pavel Izmailov , Wesley J. Maddox , Polina Kirichenko , Timur Garipov , Dmitry Vetrov , Andrew Gordon Wilson

In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Omer Yair , Elias Nehme , Tomer Michaeli

Motivated by the empirical observation of power-law distributions in the credits (e.g., ``likes'') of viral posts in social media, we introduce a high-dimensional tail index regression model and propose methods for estimation and inference…

Machine Learning · Statistics 2026-01-19 Yuya Sasaki , Jing Tao , Yulong Wang

Bayesian inference provides a natural way of incorporating prior beliefs and assigning a probability measure to the space of hypotheses. Current solutions rely on iterative routines like Markov Chain Monte Carlo (MCMC) sampling and…

Machine Learning · Computer Science 2025-02-11 Sarthak Mittal , Niels Leif Bracher , Guillaume Lajoie , Priyank Jaini , Marcus Brubaker

This paper considers improved forecasting in possibly nonlinear dynamic settings, with high-dimension predictors ("big data" environments). To overcome the curse of dimensionality and manage data and model complexity, we examine shrinkage…

Econometrics · Economics 2019-04-26 Ali Habibnia , Esfandiar Maasoumi

We present vir, an R package for variational inference with shrinkage priors. Our package implements variational and stochastic variational algorithms for linear and probit regression models, the use of which is a common first step in many…

Computation · Statistics 2021-02-18 Suchit Mehrotra , Arnab Maity

Scale-mixture shrinkage priors have recently been shown to possess robust empirical performance and excellent theoretical properties such as model selection consistency and (near) minimax posterior contraction rates. In this paper, the…

Methodology · Statistics 2022-12-27 Ahmed Alhamzawi , Gorgees Shaheed Mohammad

This paper outlines a framework for quantifying the prior's contribution to posterior inference in the presence of prior-likelihood discordance, a broader concept than the usual notion of prior-likelihood conflict. We achieve this dual…

Methodology · Statistics 2021-01-08 Matthew Reimherr , Xiao-Li Meng , Dan L. Nicolae

The statistical evidence (or marginal likelihood) is a key quantity in Bayesian statistics, allowing one to assess the probability of the data given the model under investigation. This paper focuses on refining the power posterior approach…

Computation · Statistics 2013-06-14 Nial Friel , Merrilee Hurn , Jason Wyse

We present a novel and easy-to-use method for calibrating error-rate based confidence intervals to evidence-based support intervals. Support intervals are obtained from inverting Bayes factors based on a parameter estimate and its standard…

Methodology · Statistics 2023-06-28 Samuel Pawel , Alexander Ly , Eric-Jan Wagenmakers

We study how the training data distribution affects confidence and performance in image classification models. We introduce Embedding Density, a model-agnostic framework that estimates prediction confidence by measuring the distance of test…

Machine Learning · Computer Science 2026-01-28 Maksim Kazanskii , Artem Kasianov

The pooling of prior opinions is an important area of research and has been for a number of decades. The idea is to obtain a single belief probability distribution from a set of expert opinion belief distributions. The paper proposes a new…

Methodology · Statistics 2022-07-27 A. Kume , C. Villa , S. G. Walker