English
Related papers

Related papers: A Class of Conjugate Priors for Multinomial Probit…

200 papers

This paper explores Bayesian inference for a biased sampling model in situations where the population of interest cannot be sampled directly, but rather through an indirect and inherently biased method. Observations are viewed as being the…

Applications · Statistics 2007-11-26 Russell Zaretzki , Michael A. Gilchrist , William M. Briggs , Artin Armagan

The Bayesian conjugate gradient method offers probabilistic solutions to linear systems but suffers from poor calibration, limiting its utility in uncertainty quantification tasks. Recent approaches leveraging postiterations to construct…

Machine Learning · Statistics 2025-08-13 Niall Vyas , Disha Hegde , Jon Cockayne

The literature on "benign overfitting" in overparameterized models has been mostly restricted to regression or binary classification; however, modern machine learning operates in the multiclass setting. Motivated by this discrepancy, we…

Machine Learning · Statistics 2023-07-13 Ke Wang , Vidya Muthukumar , Christos Thrampoulidis

We propose an objective Bayesian approach to the selection of covariates and their penalised splines transformations in generalised additive models. Specification of a reasonable default prior for the model parameters and combination with a…

Methodology · Statistics 2012-08-21 Daniel Sabanés Bové , Leonhard Held , Göran Kauermann

Neural networks are the cornerstone of modern machine learning, yet can be difficult to interpret, give overconfident predictions and are vulnerable to adversarial attacks. Bayesian neural networks (BNNs) provide some alleviation of these…

Machine Learning · Statistics 2026-02-24 August Arnstad , Leiv Rønneberg , Geir Storvik

Bayesian Optimization is methodology used in statistical modelling that utilizes a Gaussian process prior distribution to iteratively update a posterior distribution towards the true distribution of the data. Finding unbiased informative…

Machine Learning · Computer Science 2021-01-05 Ruduan Plug

Macroeconomists using large datasets often face the choice of working with either a large Vector Autoregression (VAR) or a factor model. In this paper, we develop methods for combining the two using a subspace shrinkage prior. Subspace…

Econometrics · Economics 2021-07-19 Florian Huber , Gary Koop

Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffective in federated data scenarios where local data…

Machine Learning · Computer Science 2025-02-28 Pei-Yau Weng , Minh Hoang , Lam M. Nguyen , My T. Thai , Tsui-Wei Weng , Trong Nghia Hoang

We theoretically justify the recent empirical finding of [Teh et al., 2025] that a transformer pretrained on synthetically generated data achieves strong performance on empirical Bayes (EB) problems. We take an indirect approach to this…

Machine Learning · Statistics 2026-02-18 Nick Cannella , Anzo Teh , Yanjun Han , Yury Polyanskiy

Pattern recognition applications often suffer from skewed data distributions between classes, which may vary during operations w.r.t. the design data. Two-class classification systems designed using skewed data tend to recognize the…

Machine Learning · Computer Science 2019-12-02 Roghayeh Soleymani , Eric Granger , Giorgio Fumera

In this work, we propose a novel prior learning method for advancing generalization and uncertainty estimation in deep neural networks. The key idea is to exploit scalable and structured posteriors of neural networks as informative priors…

Machine Learning · Computer Science 2026-03-31 Dominik Schnaus , Jongseok Lee , Daniel Cremers , Rudolph Triebel

Regression classes modeling more than the mean of the response have found a lot of attention in the last years. Expectile regression is a special and computationally convenient case of this family of models. Expectiles offer a quantile-like…

Methodology · Statistics 2013-12-19 Elisabeth Waldmann , Fabian Sobotka , Thomas Kneib

The problem of transformation selection is thoroughly treated from a Bayesian perspective. Several families of transformations are considered with a view to achieving normality: the Box-Cox, the Modulus, the Yeo & Johnson and the Dual…

Methodology · Statistics 2013-12-13 Efstratia Charitidou , Dimitris Fouskakis , Ioannis Ntzoufras

Deep Bayesian neural networks (BNNs) are a powerful tool, though computationally demanding, to perform parameter estimation while jointly estimating uncertainty around predictions. BNNs are typically implemented using arbitrary…

Machine Learning · Computer Science 2020-05-12 Daniele Silvestro , Tobias Andermann

Mixture models provide a flexible representation of heterogeneity in a finite number of latent classes. From the Bayesian point of view, Markov Chain Monte Carlo methods provide a way to draw inferences from these models. In particular,…

Methodology · Statistics 2020-05-06 Carolina Valani Cavalcante , Kelly Cristina Mota Gonçalves

This work studies the large sample properties of the posterior-based inference in the curved exponential family under increasing dimension. The curved structure arises from the imposition of various restrictions on the model, such as moment…

Statistics Theory · Mathematics 2017-10-05 Alexandre Belloni , Victor Chernozhukov

The implementation of Bayesian predictive procedures under standard normal models is considered. Two distributions are of particular interest, the K-prime and K-square distributions. They also give exact inferences for simple and multiple…

Methodology · Statistics 2020-07-17 Jacques Poitevineau , Bruno Lecoutre

Inferring the means in the multivariate normal model $X \sim N_n(\theta, I)$ with unknown mean vector $\theta=(\theta_1,...,\theta_n)' \in \mathbb{R}^n$ and observed data $X=(X_1,...,X_n)'\in {\mathbb R}^n$ is a challenging task, known as…

Methodology · Statistics 2023-06-21 Chuanhai Liu

Standard Bayesian inference schemes are infeasible for inverse problems with computationally expensive forward models. A common solution is to replace the model with a cheaper surrogate. To avoid overconfident conclusions, it is essential…

Methodology · Statistics 2026-01-09 Andrew Gerard Roberts , Michael Dietze , Jonathan H. Huggins

As modern neural networks get more complex, specifying a model with high predictive performance and sound uncertainty quantification becomes a more challenging task. Despite some promising theoretical results on the true posterior…

Machine Learning · Computer Science 2025-06-18 Alisa Sheinkman , Sara Wade