English
Related papers

Related papers: Efficient Empirical Bayes prediction under check l…

200 papers

We consider tests of hypotheses when the parameters are not identifiable under the null in semiparametric models, where regularity conditions for profile likelihood theory fail. Exponential average tests based on integrated profile…

Statistics Theory · Mathematics 2009-08-25 Rui Song , Michael R. Kosorok , Jason P. Fine

This paper establishes the asymptotic consistency of the {\it loss-calibrated variational Bayes} (LCVB) method. LCVB was proposed in~\cite{LaSiGh2011} as a method for approximately computing Bayesian posteriors in a `loss aware' manner.…

Machine Learning · Statistics 2019-11-05 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

As machine learning-based prediction systems are increasingly used in high-stakes situations, it is important to understand how such predictive models will perform upon deployment. Distribution-free uncertainty quantification techniques…

Machine Learning · Computer Science 2025-06-12 Jake C. Snell , Thomas L. Griffiths

We study the convergence rates of empirical Bayes posterior distributions for nonparametric and high-dimensional inference. We show that as long as the hyperparameter set is discrete, the empirical Bayes posterior distribution induced by…

Statistics Theory · Mathematics 2020-09-10 Fengshuo Zhang , Chao Gao

Bayesian decision theory provides an elegant framework for acting optimally under uncertainty when tractable posterior distributions are available. Modern Bayesian models, however, typically involve intractable posteriors that are…

Machine Learning · Computer Science 2021-06-15 Meet P. Vadera , Soumya Ghosh , Kenney Ng , Benjamin M. Marlin

We propose a new method to test the effectiveness of a spatial point process forecast based on a log-likelihood score for predicted point density and the information gain for events that actually occurred in the test period. The method…

Data Analysis, Statistics and Probability · Physics 2010-11-24 Yan Y. Kagan

The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capable of estimating their own uncertainty. In the context of regression, instead of estimating…

Machine Learning · Computer Science 2026-05-14 Quentin Duchemin , Guillaume Obozinski

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

Statistics Theory · Mathematics 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

In this paper, we consider simultaneous estimation of Poisson parameters in situations where we can use side information in aggregated data. We use standardized squared error and entropy loss functions. Bayesian shrinkage estimators are…

Statistics Theory · Mathematics 2023-11-06 Yasuyuki Hamura

Training machine learning and statistical models often involves optimizing a data-driven risk criterion. The risk is usually computed with respect to the empirical data distribution, but this may result in poor and unstable out-of-sample…

Machine Learning · Statistics 2024-11-11 Nicola Bariletto , Nhat Ho

Predictability is an emerging metric that quantifies the highest possible prediction accuracy for a given time series, being widely utilized in assessing known prediction algorithms and characterizing intrinsic regularities in human…

Information Theory · Computer Science 2023-03-29 En Xu , Tao Zhou , Zhiwen Yu , Zhuo Sun , Bin Guo

In inference problems involving a multi-dimensional parameter $\theta$, it is often natural to consider decision rules that have a risk which is invariant under some group $G$ of permutations of $\theta$. We show that this implies that the…

Methodology · Statistics 2014-07-01 Erik van Zwet

Confidence sequences based on test martingales provide time-uniform uncertainty quantification for the mean of bounded IID observations without parametric distributional assumptions. Their practical efficiency, however, depends strongly on…

Machine Learning · Statistics 2026-05-12 Valentin Kilian , Stefano Cortinovis , François Caron

Statistical inference can be seen as information processing involving input information and output information that updates belief about some unknown parameters. We consider the Bayesian framework for making inferences about dynamical…

Statistics Theory · Mathematics 2022-01-17 Artur O. Lopes , Silvia R. C. Lopes , Paulo Varandas

We introduce a flexible empirical Bayes approach for fitting Bayesian generalized linear models. Specifically, we adopt a novel mean-field variational inference (VI) method and the prior is estimated within the VI algorithm, making the…

Machine Learning · Statistics 2026-01-30 Dongyue Xie , Wanrong Zhu , Matthew Stephens

In this paper, we study a novel approach for the estimation of quantiles when facing potential right censoring of the responses. Contrary to the existing literature on the subject, the adopted strategy of this paper is to tackle censoring…

Methodology · Statistics 2017-03-24 Mickaël De Backer , Anouar El Ghouch , Ingrid Van Keilegom

To address model uncertainty under flexible loss functions in prediction problems, we propose a model averaging method that accommodates various loss functions, including asymmetric linear and quadratic loss functions, as well as many other…

Methodology · Statistics 2025-01-23 Dieqi Gu , Qingfeng Liu , Xinyu Zhang

In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. At the…

Statistics Theory · Mathematics 2025-05-29 Oliver Y. Feng , Yu-Chun Kao , Min Xu , Richard J. Samworth

We demonstrate how data fission, a method for creating synthetic replicates from single observations, can be applied to empirical Bayes estimation. This extends recent work on empirical Bayes with multiple replicates to the classical…

Methodology · Statistics 2024-10-17 Nikolaos Ignatiadis , Dennis L. Sun