English
Related papers

Related papers: Learning from a lot: Empirical Bayes in high-dimen…

200 papers

We develop scalable methods for producing conformal Bayesian predictive intervals with finite sample calibration guarantees. Bayesian posterior predictive distributions, $p(y \mid x)$, characterize subjective beliefs on outcomes of…

Methodology · Statistics 2021-06-15 Edwin Fong , Chris Holmes

This essay looks at decision-making with interval-valued probability measures. Existing decision methods have either supplemented expected utility methods with additional criteria of optimality, or have attempted to supplement the…

Artificial Intelligence · Computer Science 2013-04-15 Ronald P. Loui

The recent success of machine learning models, especially large-scale classifiers and language models, relies heavily on training with massive data. These data are often collected from online sources. This raises serious concerns about the…

Artificial Intelligence · Computer Science 2025-11-12 Ruihan Zhang , Jun Sun , Ee-Peng Lim , Peixin Zhang

The Bayesian measure of sample information about the parameter, known as Lindley's measure, is widely used in various problems such as developing prior distributions, models for the likelihood functions and optimal designs. The predictive…

Methodology · Statistics 2011-01-06 Nader Ebrahimi , Ehsan S. Soofi , Refik Soyer

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes

In data sets with many predictors, algorithms for identifying a good subset of predictors are often used. Most such algorithms do not account for any relationships between predictors. For example, stepwise regression might select a model…

bayes-an · Physics 2008-02-03 Hugh Chipman

Prediction-powered inference (PPI) enables valid statistical inference by combining experimental data with machine learning predictions. When a sufficient number of high-quality predictions is available, PPI results in more accurate…

Machine Learning · Statistics 2025-08-18 Stefano Cortinovis , François Caron

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

Methodology · Statistics 2025-09-16 Gregor Zens , Mark F. J. Steel

For in vivo research experiments with small sample sizes and available historical data, we propose a sequential Bayesian method for the Behrens-Fisher problem. We consider it as a model choice question with two models in competition: one…

Statistics Theory · Mathematics 2016-11-22 Antoine Barbieri , Jean-Michel Marin , Karine Florin

We provide a brief overview of both Bayes and classical model selection. We argue tentatively that model selection has at least two major goals, that of finding the correct model or predicting well, and that in general both these goals may…

Statistics Theory · Mathematics 2015-10-05 Ritabrata Dutta , Malgortaza Bogdan , Jayanta K. Ghosh

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

A wide range of machine learning algorithms iteratively add data to the training sample. Examples include semi-supervised learning, active learning, multi-armed bandits, and Bayesian optimization. We embed this kind of data addition into…

Machine Learning · Statistics 2024-06-25 Julian Rodemann

Familiar statistical tests and estimates are obtained by the direct observation of cases of interest: a clinical trial of a new drug, for instance, will compare the drug's effects on a relevant set of patients and controls. Sometimes,…

Methodology · Statistics 2010-12-09 Bradley Efron

Bayesian and frequentist methods differ in many aspects, but share some basic optimality properties. In practice, there are situations in which one of the methods is more preferred by some criteria. We consider the case of inference about a…

Statistics Theory · Mathematics 2009-08-25 Ao Yuan

Bayesian statistics has gained popularity in psychological research due to its intuitive uncertainty quantification and convenient information-updating rules. In many applications, however, prior distributions are introduced merely as…

Methodology · Statistics 2026-03-10 Yang Liu , Jonathan P. Williams , Jan Hannig

This paper develops Bayesian sample size formulae for experiments comparing two groups. We assume the experimental data will be analysed in the Bayesian framework, where pre-experimental information from multiple sources can be represented…

Methodology · Statistics 2022-03-09 Haiyan Zheng , Thomas Jaki , James M. S. Wason

Bayesian decision theory outlines a rigorous framework for making optimal decisions based on maximizing expected utility over a model posterior. However, practitioners often do not have access to the full posterior and resort to approximate…

Machine Learning · Statistics 2019-10-29 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Quantifying uncertainty in neural networks is a highly relevant problem which is essential to many applications. The two predominant paradigms to tackle this task are Bayesian neural networks (BNNs) and deep ensembles. Despite some…

Machine Learning · Computer Science 2025-01-31 Gabriel Loaiza-Ganem , Valentin Villecroze , Yixin Wang

In a bivariate meta-analysis the number of diagnostic studies involved is often very low so that frequentist methods may result in problems. Bayesian inference is attractive as informative priors that add small amount of information can…

Methodology · Statistics 2015-12-22 Jingyi Guo , Håvard Rue , Andrea Riebler

In high-dimensions, the prior tails can have a significant effect on both posterior computation and asymptotic concentration rates. To achieve optimal rates while keeping the posterior computations relatively simple, an empirical Bayes…

Methodology · Statistics 2020-08-03 Yue Yang , Ryan Martin