English
Related papers

Related papers: A second-order efficient empirical Bayes confidenc…

200 papers

In this paper, we consider the problem of parametric empirical Bayes estimation of an i.i.d. prior in high-dimensional Bayesian linear regression, with random design. We obtain the asymptotic distribution of the variational Empirical Bayes…

Statistics Theory · Mathematics 2026-02-25 Seunghyun Lee , Nabarun Deb

Empirical Bayes small area estimation based on the well-known Fay-Herriot model may produce unreliable estimates when outlying areas exist. Existing robust methods against outliers or model misspecification are generally inefficient when…

Methodology · Statistics 2022-06-28 Daisuke Kurisu , Takuya Ishihara , Shonosuke Sugasawa

We construct robust empirical Bayes confidence intervals (EBCIs) in a normal means problem. The intervals are centered at the usual linear empirical Bayes estimator, but use a critical value accounting for shrinkage. Parametric EBCIs that…

Econometrics · Economics 2022-11-22 Timothy B. Armstrong , Michal Kolesár , Mikkel Plagborg-Møller

A difficulty in MSE estimation occurs because we do not specify a full distribution for the survey weights. This obfuscates the use of fully parametric bootstrap procedures. To overcome this challenge, we develop a novel MSE estimator. We…

Methodology · Statistics 2022-10-25 Yanghyeon Cho , Emily Berg

Parametric empirical Bayes (EB) estimators have been widely used in variety of fields including small area estimation, disease mapping. Since EB estimator is constructed by plugging in the estimator of parameters in prior distributions, it…

Methodology · Statistics 2017-04-28 Shonosuke Sugasawa

We propose a general maximum likelihood empirical Bayes (GMLEB) method for the estimation of a mean vector based on observations with i.i.d. normal errors. We prove that under mild moment conditions on the unknown means, the average mean…

Statistics Theory · Mathematics 2009-08-13 Wenhua Jiang , Cun-Hui Zhang

Bootstrapping is often applied to get confidence limits for semiparametric inference of a target parameter in the presence of nuisance parameters. Bootstrapping with replacement can be computationally expensive and problematic when…

Empirical likelihood is a popular nonparametric or semi-parametric statistical method with many nice statistical properties. Yet when the sample size is small, or the dimension of the accompanying estimating function is high, the…

Statistics Theory · Mathematics 2010-10-05 Yukun Liu , Jiahua Chen

There is an increasing amount of literature focused on Bayesian computational methods to address problems with intractable likelihood. One approach is a set of algorithms known as Approximate Bayesian Computational (ABC) methods. One of the…

Methodology · Statistics 2015-10-27 Weixuan Zhu , Juan Miguel Marin , Fabrizio Leisen

We consider the issue of performing accurate small sample inference in beta autoregressive moving average model, which is useful for modeling and forecasting continuous variables that assumes values in the interval $(0,1)$. The inferences…

Computation · Statistics 2017-02-16 Bruna Gregory Palm , Fábio M. Bayer

The multivariate Fay-Herriot model is quite effective in combining information through correlations among small area survey estimates of related variables or historical survey estimates of the same variable or both. Though the literature on…

Methodology · Statistics 2020-06-29 Takumi Saegusa , Shonosuke Sugasawa , Partha Lahiri

The envelope model provides a dimension-reduction framework for multivariate linear regression. However, existing envelope methods typically assume normally distributed random errors and do not accommodate repeated measures in longitudinal…

Methodology · Statistics 2025-12-11 Peng Zeng , Yushan Mu

Reliable uncertainty quantification remains a central challenge in predictive modeling. While Bayesian methods are theoretically appealing, their predictive intervals can exhibit poor frequentist calibration, particularly with small sample…

Methodology · Statistics 2025-08-05 Graham Gibson

In the fields of clinical trials, biomedical surveys, marketing, banking, with dichotomous response variable, the logistic regression is considered as an alternative convenient approach to linear regression. In this paper, we develop a…

Statistics Theory · Mathematics 2025-12-29 Debraj Das , Priyam Das

Empirical Bayes methods are widely used for large-scale estimation and inference in the Poisson means problem. Existing results establish theoretical properties of the nonparametric maximum likelihood estimator (NPMLE) for optimal posterior…

Statistics Theory · Mathematics 2026-05-06 Taehyun Kim

How can we precisely estimate a large language model's (LLM) accuracy on questions belonging to a specific topic within a larger question-answering dataset? The standard direct estimator, which averages the model's accuracy on the questions…

Machine Learning · Computer Science 2024-10-08 Riccardo Fogliato , Pratik Patil , Nil-Jana Akpinar , Mathew Monfort

Many recently developed Bayesian methods have focused on sparse signal detection. However, much less work has been done addressing the natural follow-up question: how to make valid inferences for the magnitude of those signals after…

Methodology · Statistics 2021-03-02 Spencer Woody , Oscar Hernan Madrid Padilla , James G. Scott

To go beyond standard first-order asymptotics for Cox regression, we develop parametric bootstrap and second-order methods. In general, computation of $P$-values beyond first order requires more model specification than is required for the…

Statistics Theory · Mathematics 2015-04-14 Donald A. Pierce , Ruggero Bellio

We study a parametric estimation problem related to moment condition models. As an alternative to the generalized empirical likelihood (GEL) and the generalized method of moments (GMM), a Bayesian approach to the problem can be adopted,…

Statistics Theory · Mathematics 2012-03-02 Paul Rochet

The Robbins estimator is the most iconic and widely used procedure in the empirical Bayes literature for the Poisson model. On one hand, this method has been recently shown to be minimax optimal in terms of the regret (excess risk over the…

Statistics Theory · Mathematics 2025-09-16 Soham Jana , Yury Polyanskiy , Yihong Wu