English
Related papers

Related papers: An Entropy-Energy Identity for Predictive Kullback…

200 papers

We consider the problem of predictive density estimation under Kullback-Leibler loss in a high-dimensional Gaussian model with exact sparsity constraints on the location parameters. We study the first order asymptotic minimax risk of Bayes…

Statistics Theory · Mathematics 2019-05-24 Ujan Gangopadhyay , Gourab Mukherjee

We study empirical Bayes (EB) predictive density estimation in linear mixed models (LMMs) with large number of units, which induce a high dimensional random effects space. Focusing on Kullback Leibler (KL) risk minimization, we develop a…

Methodology · Statistics 2026-03-31 Abir Sarkar , Gourab Mukherjee , Keisuke Yano

We consider the asymptotic behavior of posterior distributions if the model is misspecified. Given a prior distribution and a random sample from a distribution $P_0$, which may not be in the support of the prior, we show that the posterior…

Statistics Theory · Mathematics 2007-06-13 B. J. K. Kleijn , A. W. van der Vaart

We study predictive density estimation under Kullback-Leibler loss in $\ell_0$-sparse Gaussian sequence models. We propose proper Bayes predictive density estimates and establish asymptotic minimaxity in sparse models. A surprise is the…

Statistics Theory · Mathematics 2017-08-01 Gourab Mukherjee , Iain M. Johnstone

We consider estimating the predictive density under Kullback-Leibler loss in a high-dimensional Gaussian model. Decision theoretic properties of the within-family prediction error -- the minimal risk among estimates in the class…

Statistics Theory · Mathematics 2012-12-04 Gourab Mukherjee , Iain M. Johnstone

Based on independently distributed $X_1 \sim N_p(\theta_1, \sigma^2_1 I_p)$ and $X_2 \sim N_p(\theta_2, \sigma^2_2 I_p)$, we consider the efficiency of various predictive density estimators for $Y_1 \sim N_p(\theta_1, \sigma^2_Y I_p)$, with…

Statistics Theory · Mathematics 2017-09-25 Éric Marchand , Abdolnasser Sadeghkhani

Positivity of the prior probability of Kullback-Leibler neighborhood around the true density, commonly known as the Kullback-Leibler property, plays a fundamental role in posterior consistency. A popular prior for Bayesian estimation is…

Statistics Theory · Mathematics 2008-05-08 Yuefeng Wu , Subhashis Ghosal

We consider Bayesian linear inverse problems in infinite-dimensional separable Hilbert spaces, with a Gaussian prior measure and additive Gaussian noise model, and provide an extension of the concept of Bayesian D-optimality to the…

Statistics Theory · Mathematics 2014-09-04 Alen Alexanderian , Philip Gloor , Omar Ghattas

This paper deals with the problem of estimating predictive densities of a matrix-variate normal distribution with known covariance matrix. Our main aim is to establish some Bayesian predictive densities related to matricial shrinkage…

Statistics Theory · Mathematics 2017-04-03 Hisayuki Tsukuma , Tatsuya Kubokawa

We consider finite-dimensional linear Gaussian Bayesian inverse problems with uncorrelated sensor measurements. In this setting, it is known that the expected information gain, quantified by the expected Kullback-Leibler divergence from the…

Optimization and Control · Mathematics 2025-05-12 Steven Maio , Alen Alexanderian

Given a random sample from a distribution with density function that depends on an unknown parameter $\theta$, we are interested in accurately estimating the true parametric density function at a future observation from the same…

Statistics Theory · Mathematics 2009-09-29 Mihaela Aslan

We explore the construction of nonsubjective prior distributions in Bayesian statistics via a posterior predictive relative entropy regret criterion. We carry out a minimax analysis based on a derived asymptotic predictive loss function and…

Statistics Theory · Mathematics 2007-06-13 Trevor J. Sweeting , Gauri S. Datta , Malay Ghosh

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

Statistics Theory · Mathematics 2015-03-19 Suprateek Kundu , David B. Dunson

Let $X| \mu \sim N_p(\mu,v_xI)$ and $Y| \mu \sim N_p(\mu,v_yI)$ be independent p-dimensional multivariate normal vectors with common unknown mean $\mu$. Based on only observing $X=x$, we consider the problem of obtaining a predictive…

Statistics Theory · Mathematics 2007-06-13 Edward I. George , Feng Liang , Xinyi Xu

The Bayesian predictive density has complex representation and does not belong to any finite-dimensional statistical model except for in limited situations. In this paper, we introduce its simple approximate representation employing its…

Statistics Theory · Mathematics 2020-10-30 Michiko Okudo , Fumiyasu Komaki

We study frequentist risk properties of predictive density estimators for mean mixtures of multivariate normal distributions, involving an unknown location parameter $\theta \in \mathbb{R}^d$, and which include multivariate skew normal…

Statistics Theory · Mathematics 2022-02-02 Pankaj Bhagwat , Eric Marchand

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

Let $X,U,Y$ be spherically symmetric distributed having density $$\eta^{d +k/2} \, f\left(\eta(\|x-\theta|^2+ \|u\|^2 + \|y-c\theta\|^2 ) \right)\,,$$ with unknown parameters $\theta \in \mathbb{R}^d$ and $\eta>0$, and with known density…

Statistics Theory · Mathematics 2018-07-13 Dominique Fourdrinier , Éric Marchand , William E. Strawderman

We consider estimating the predictive density under Kullback-Leibler loss in an $\ell_0$ sparse Gaussian sequence model. Explicit expressions of the first order minimax risk along with its exact constant, asymptotically least favorable…

Statistics Theory · Mathematics 2015-06-04 Gourab Mukherjee , Iain M. Johnstone

A central problem in the theory of empirical Bayes is to control the regret (excess risk) of a learned Bayes rule by the Hellinger distance between the estimated and true marginal densities. In the normal means model, the classical result…

Statistics Theory · Mathematics 2026-05-05 Jiafeng Chen , Yihong Wu
‹ Prev 1 2 3 10 Next ›