English
Related papers

Related papers: Asymptotically minimax Bayesian predictive densiti…

200 papers

We propose a Bayesian test of normality for univariate or multivariate data against alternative nonparametric models characterized by Dirichlet process mixture distributions. The alternative models are based on the principles of embedding…

Statistics Theory · Mathematics 2023-04-12 Surya T. Tokdar , Ryan Martin

In a remarkable series of papers beginning in 1956, Charles Stein set the stage for the future development of minimax shrinkage estimators of a multivariate normal mean under quadratic loss. More recently, parallel developments have seen…

Methodology · Statistics 2012-03-27 Edward I. George , Feng Liang , Xinyi Xu

Within Bayesian nonparametrics, dependent Dirichlet process mixture models provide a highly flexible approach for conducting inference about the conditional density function. However, several formulations of this class make either rather…

Methodology · Statistics 2024-05-14 María Xosé Rodríguez-Álvarez , Vanda Inácio , Nadja Klein

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

We propose a novel Bayesian model selection technique on linear mixed-effects models to compare multiple treatments with a control. A fully Bayesian approach is implemented to estimate the marginal inclusion probabilities that provide a…

Applications · Statistics 2015-09-28 Lei Gong , James M. Flegal , Stephen R. Spindler , Patricia L. Mote

We consider the asymptotic behaviour of the marginal maximum likelihood empirical Bayes posterior distribution in general setting. First we characterize the set where the maximum marginal likelihood estimator is located with high…

Statistics Theory · Mathematics 2016-04-05 Judith Rousseau , Botond Szabo

We investigate Bayesian shrinkage methods for constructing predictive distributions. We consider the multivariate Normal model with a known covariance matrix and show that the Bayesian predictive density with respect to Stein's harmonic…

Statistics Theory · Mathematics 2017-07-31 Yuzo Maruyama , Toshio Ohnishi

We consider the problem of estimating probability density functions based on sample data, using a finite mixture of densities from some component class. To this end, we introduce the $h$-lifted Kullback--Leibler (KL) divergence as a…

Machine Learning · Statistics 2024-12-24 Mark Chiu Chong , Hien Duy Nguyen , TrungTin Nguyen

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

Statistics Theory · Mathematics 2024-06-03 Veronika Rockova

We present an alternative approach to the Bayesian nonparametric analysis of conditional species richness under two-parameter Poisson Dirichlet priors. We rely on a known characterization by deletion of classes property and on results for…

Probability · Mathematics 2010-02-03 Annalisa Cerquetti

We consider estimation of the common probability density $f$ of i.i.d. random variables $X_i$ that are observed with an additive i.i.d. noise. We assume that the unknown density $f$ belongs to a class $\mathcal{A}$ of densities whose…

Statistics Theory · Mathematics 2007-06-13 Cristina Butucea , Alexandre B. Tsybakov

Although continuous density estimation has received abundant attention in the Bayesian nonparametrics literature, there is limited theory on multivariate mixed scale density estimation. In this note, we consider a general framework to…

Statistics Theory · Mathematics 2014-05-26 Antonio Canale , David B. Dunson

We study high-dimensional asymptotic performance limits of binary supervised classification problems where the class conditional densities are Gaussian with unknown means and covariances and the number of signal dimensions scales faster…

Machine Learning · Statistics 2016-11-17 Mohammad Hossein Rohban , Prakash Ishwar , Birant Orten , William C. Karl , Venkatesh Saligrama

We extend the Bayesian Information Criterion (BIC), an asymptotic approximation for the marginal likelihood, to Bayesian networks with hidden variables. This approximation can be used to select models given large samples of data. The…

Machine Learning · Computer Science 2015-05-19 Dan Geiger , David Heckerman , Christopher Meek

The prior distribution on parameters of a sampling distribution is the usual starting point for Bayesian uncertainty quantification. In this paper, we present a different perspective which focuses on missing observations as the source of…

Methodology · Statistics 2021-11-23 Edwin Fong , Chris Holmes , Stephen G. Walker

The classical mixture of Gaussians model is related to K-means via small-variance asymptotics: as the covariances of the Gaussians tend to zero, the negative log-likelihood of the mixture of Gaussians model approaches the K-means objective,…

Machine Learning · Statistics 2013-02-19 Tamara Broderick , Brian Kulis , Michael I. Jordan

We propose information criteria that measure the prediction risk of a predictive density based on the Bayesian marginal likelihood from a frequentist point of view. We derive criteria for selecting variables in linear regression models,…

Methodology · Statistics 2017-10-20 Yuki Kawakubo , Tatsuya Kubokawa , Muni S. Srivastava

We consider predictive density estimation under logarithmic score for $d$-dimensional infinitely divisible location models. Taking the formal Bayes predictive density under the Lebesgue prior as a benchmark, we study the Kullback-Leibler…

Statistics Theory · Mathematics 2026-05-27 Kōsaku Takanashi , Kenichiro McAlinn

In causal inference, sensitivity analysis is important to assess the robustness of study conclusions to key assumptions. We perform sensitivity analysis of the assumption that missing outcomes are missing completely at random. We follow a…

Statistics Theory · Mathematics 2023-05-12 Bart Eggen , Stéphanie L. van der Pas , Aad W. van der Vaart