English
Related papers

Related papers: Asymptotically optimal nonparametric empirical Bay…

200 papers

Empirical risk minimization is a standard principle for choosing algorithms in learning theory. In this paper we study the properties of empirical risk minimization for time series. The analysis is carried out in a general framework that…

Machine Learning · Statistics 2021-08-12 Christian Brownlees , Jordi Llorens-Terrazas

The Peaks Over Threshold (POT) method is the most popular statistical method for the analysis of univariate extremes. Even though there is a rich applied literature on Bayesian inference for the POT, the asymptotic theory for such proposals…

Statistics Theory · Mathematics 2025-04-01 Clément Dombry , Simone A. Padoan , Stefano Rizzelli

Bayesian methods are actively used for parameter identification and uncertainty quantification when solving nonlinear inverse problems with random noise. However, there are only few theoretical results justifying the Bayesian approach.…

Statistics Theory · Mathematics 2020-02-04 Vladimir Spokoiny

This paper presents a general asymptotic theory of sequential Bayesian estimation giving results for the strongest, almost sure convergence. We show that under certain smoothness conditions on the probability model, the greedy information…

Statistics Theory · Mathematics 2016-01-11 Janne V. Kujala

We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originally in Carbonetto and…

Statistics Theory · Mathematics 2023-10-27 Sumit Mukherjee , Bodhisattva Sen , Subhabrata Sen

In this paper we construct optimal designs for frequentist model averaging estimation. We derive the asymptotic distribution of the model averaging estimate with fixed weights in the case where the competing models are non-nested and none…

Methodology · Statistics 2019-08-27 Kira Alhorn , Holger Dette , Kirsten Schorning

Frequentist-style large-sample properties of Bayesian posterior distributions, such as consistency and convergence rates, are important considerations in nonparametric problems. In this paper we give an analysis of Bayesian asymptotics…

Statistics Theory · Mathematics 2012-10-02 Ryan Martin , Liang Hong

This manuscript proposes a novel empirical Bayes technique for regularizing regression coefficients in predictive models. When predictions from a previously published model are available, this empirical Bayes method provides a natural…

Applications · Statistics 2017-10-12 Derek K Smith , Loren E Smith , Brett Kroncke , Frederic T Billings , Jens Meiler , Jeffrey Blume

Genetic risk prediction is an important component of individualized medicine, but prediction accuracies remain low for many complex diseases. A fundamental limitation is the sample sizes of the studies on which the prediction algorithms are…

Methodology · Statistics 2017-06-20 Sihai Dave Zhao

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

Bayesian nonparametric methods are a popular choice for analysing survival data due to their ability to flexibly model the distribution of survival times. These methods typically employ a nonparametric prior on the survival function that is…

Methodology · Statistics 2022-02-22 Edwin Fong , Brieuc Lehmann

In the present paper, we derive lower bounds for the risk of the nonparametric empirical Bayes estimators. In order to attain the optimal convergence rate, we propose generalization of the linear empirical Bayes estimation method which…

Statistics Theory · Mathematics 2013-06-12 Rida Benhaddou , Marianna Pensky

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

Within a Bayesian decision theoretic framework we investigate some asymptotic optimality properties of a large class of multiple testing rules. A parametric setup is considered, in which observations come from a normal scale mixture model…

Statistics Theory · Mathematics 2012-11-22 Małgorzata Bogdan , Arijit Chakrabarti , Florian Frommlet , Jayanta K. Ghosh

As for other latent-variable problems, exact Bayesian analysis is typically not practicable for mixture problems and approximate methods have been developed. Variational Bayes tends to produce approximate posterior distributions for…

Statistics Theory · Mathematics 2026-02-24 Nils Lid Hjort , Mike Titterington

Priors in Bayesian analyses often encode informative domain knowledge that can be useful in making the inference process more efficient. Occasionally, however, priors may be unrepresentative of the parameter values for a given dataset,…

Computation · Statistics 2022-07-05 Xi Chen , Farhan Feroz , Michael Hobson

It can be argued that optimal prediction should take into account all available data. Therefore, to evaluate a prediction interval's performance one should employ conditional coverage probability, conditioning on all available observations.…

Statistics Theory · Mathematics 2021-03-02 Yunyi Zhang , Dimitris N. Politis

Empirical Bayes inference is based on estimation of the parameters of an a priori distribution from the observed data. The estimation technique of the parameters of the prior, called hyperparameters, is based on the marginal distribution…

Systems and Control · Electrical Eng. & Systems 2025-11-06 Timofei Leahu , Giorgio Picci

The empirical Bayes $g$-modeling approach via the nonparametric maximum likelihood estimator (NPMLE) is widely used for large-scale estimation and inference in the normal means problem, yet theoretical guarantees for uncertainty…

Statistics Theory · Mathematics 2026-03-31 Taehyun Kim , Bodhisattva Sen