English
Related papers

Related papers: Asymptotically minimax Bayesian predictive densiti…

200 papers

We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function. Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the…

Statistics Theory · Mathematics 2007-06-13 Kei Kobayashi , Fumiyasu Komaki

There is a rich literature proposing methods and establishing asymptotic properties of Bayesian variable selection methods for parametric models, with a particular focus on the normal linear regression model and an increasing emphasis on…

Statistics Theory · Mathematics 2011-08-16 Suprateek Kundu , David B. Dunson

Consider semiparametric models that display local asymptotic exponentiality (Ibragimov and Has'minskii (1981)), an asymptotic property of the likelihood associated with discontinuities of densities. Our interest goes to estimation of the…

Statistics Theory · Mathematics 2013-12-19 Bas Kleijn , Bartek Knapik

In data science and machine learning, hierarchical parametric models, such as mixture models, are often used. They contain two kinds of variables: observable variables, which represent the parts of the data that can be directly measured,…

Machine Learning · Statistics 2015-04-20 Keisuke Yamazaki

Sample size criteria are often expressed in terms of the concentration of the posterior density, as controlled by some sort of error bound. Since this is done pre-experimentally, one can regard the posterior density as a function of the…

Statistics Theory · Mathematics 2007-06-13 B. Clarke , Ao Yuan

The application of Bayesian inference for the purpose of model selection is very popular nowadays. In this framework, models are compared through their marginal likelihoods, or their quotients, called Bayes factors. However, marginal…

Methodology · Statistics 2022-07-27 F. Llorente , L. Martino , E. Curbelo , J. Lopez-Santiago , D. Delgado

This invited paper proposes and discusses several Bayesian attempts at nonparametric and semiparametric density estimation. The main categories of these ideas are as follows: 1) Build a nonparametric prior around a given parametric model.…

Statistics Theory · Mathematics 2026-04-23 Nils Lid Hjort

We consider the problem of Bayesian density estimation on the positive semiline for possibly unbounded densities. We propose a hierarchical Bayesian estimator based on the gamma mixture prior which can be viewed as a location mixture. We…

Statistics Theory · Mathematics 2020-02-25 Natalia Bochkina , Judith Rousseau

The use of non parametric hidden Markov models with finite state space is flourishing in practice while few theoretical guarantees are known in this framework. Here, we study asymptotic guarantees for these models in the Bayesian framework.…

Statistics Theory · Mathematics 2015-11-30 Elodie Vernet

It is shown that the first-order term of the asymptotic bias of the posterior mean is removed by a suitable choice of a prior density. In regular statistical models including exponential families, and linear and logistic regression models,…

Methodology · Statistics 2024-10-22 Miyata Yoichi , Yanagimoto Takemi

A Bayesian nonparametric method for unimodal densities on the real line is provided by considering a class of species sampling mixture models containing random densities that are unimodal and not necessarily symmetric. This class of…

Statistics Theory · Mathematics 2007-06-13 Man-Wai Ho

The problem of predicting independent Poisson random variables is commonly encountered in real-life practice. Simultaneous predictive distributions for independent Poisson observables are investigated, and the performance of predictive…

Statistics Theory · Mathematics 2023-12-06 Xiao Li , Fumiyasu Komaki

Density estimation represents one of the most successful applications of Bayesian nonparametrics. In particular, Dirichlet process mixtures of normals are the gold standard for density estimation and their asymptotic properties have been…

Statistics Theory · Mathematics 2015-07-02 Antonio Canale , Pierpaolo De Blasi

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…

Statistics Theory · Mathematics 2010-10-05 Andriy Norets

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

The practice of employing empirical likelihood (EL) components in place of parametric likelihood functions in the construction of Bayesian-type procedures has been well-addressed in the modern statistical literature. We rigorously derive…

Methodology · Statistics 2018-08-21 Albert Vexler , Li Zou , Alan D. Hutson

For the important classical problem of inference on a sparse high-dimensional normal mean vector, we propose a novel empirical Bayes model that admits a posterior distribution with desirable properties under mild conditions. In particular,…

Statistics Theory · Mathematics 2014-10-31 Ryan Martin , Stephen G. Walker

In this short note, we prove an asymptotic expansion for the ratio of the Dirichlet density to the multivariate normal density with the same mean and covariance matrix. The expansion is then used to derive an upper bound on the total…

Statistics Theory · Mathematics 2022-05-25 Frédéric Ouimet

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in estimation, while being…

Methodology · Statistics 2024-04-10 Shounak Chattopadhyay , Antik Chakraborty , David B. Dunson

The autoregressive moving average (ARMA) model is one of the most important models in time series analysis.We consider the Bayesian estimation of an unknown spectral density in the ARMA model.In the i.i.d. cases, Komaki showed that Bayesian…

Statistics Theory · Mathematics 2021-05-27 Fuyuhiko Tanaka , Fumiyasu Komaki