中文
相关论文

相关论文: Improved minimax predictive densities under Kullba…

200 篇论文

We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function. Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the…

统计理论 · 数学 2007-06-13 Kei Kobayashi , Fumiyasu Komaki

We study minimax convergence rates of nonparametric density estimation in the Huber contamination model, in which a proportion of the data comes from an unknown outlier distribution. We provide the first results for this problem under a…

统计理论 · 数学 2021-09-08 Ananya Uppal , Shashank Singh , Barnabas Poczos

We consider estimating the predictive density under Kullback-Leibler loss in a high-dimensional Gaussian model. Decision theoretic properties of the within-family prediction error -- the minimal risk among estimates in the class…

统计理论 · 数学 2012-12-04 Gourab Mukherjee , Iain M. Johnstone

In a remarkable series of papers beginning in 1956, Charles Stein set the stage for the future development of minimax shrinkage estimators of a multivariate normal mean under quadratic loss. More recently, parallel developments have seen…

统计方法学 · 统计学 2012-03-27 Edward I. George , Feng Liang , Xinyi Xu

Positivity of the prior probability of Kullback-Leibler neighborhood around the true density, commonly known as the Kullback-Leibler property, plays a fundamental role in posterior consistency. A popular prior for Bayesian estimation is…

统计理论 · 数学 2008-05-08 Yuefeng Wu , Subhashis Ghosal

The problem is sequence prediction in the following setting. A sequence x1,..., xn,... of discrete-valued observations is generated according to some unknown probabilistic law (measure) mu. After observing each outcome, it is required to…

机器学习 · 计算机科学 2015-10-19 Daniil Ryabko

Simultaneous predictive densities for independent Poisson observables are investigated. The observed data and the target variables to be predicted are independently distributed according to different Poisson distributions parametrized by…

统计理论 · 数学 2021-05-27 Fumiyasu Komaki

Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate…

统计理论 · 数学 2014-08-25 Tatsuya Kubokawa , Éric Marchand , William E. Strawderman

Bayesian neural networks (BNNs) offer a natural probabilistic formulation for inference in deep learning models. Despite their popularity, their optimality has received limited attention through the lens of statistical decision theory. In…

统计理论 · 数学 2026-04-07 Daniel Andrew Coulson , Martin T. Wells

This paper describes a new Bayesian interpretation of a class of skew--Student $t$ distributions. We consider a hierarchical normal model with unknown covariance matrix and show that by imposing different restrictions on the parameter…

统计方法学 · 统计学 2018-05-25 Abdolnasser Sadeghkhani

In this paper, we consider the problem of estimating the density function of a Chi-squared variable on the basis of observations of another Chi-squared variable and a normal variable under the Kullback-Leibler divergence. We assume that…

统计理论 · 数学 2021-07-22 Yasuyuki Hamura , Tatsuya Kubokawa

In this paper we derive lower bounds in minimax sense for estimation of the instantaneous volatility if the diffusion type part cannot be observed directly but under some additional Gaussian noise. Three different models are considered. Our…

统计理论 · 数学 2010-02-17 Axel Munk , Johannes Schmidt-Hieber

Frequentist conditions for asymptotic suitability of Bayesian procedures focus on lower bounds for prior mass in Kullback-Leibler neighbourhoods of the data distribution. The goal of this paper is to investigate the flexibility in criteria…

统计理论 · 数学 2018-03-19 B. J. K. Kleijn , Y. Y. Zhao

Bayesian predictive densities when the observed data $x$ and the target variable $y$ to be predicted have different distributions are investigated by using the framework of information geometry. The performance of predictive densities is…

统计理论 · 数学 2015-03-27 Fumiyasu Komaki

We consider the task of estimating a conditional density using i.i.d. samples from a joint distribution, which is a fundamental problem with applications in both classification and uncertainty quantification for regression. For joint…

统计理论 · 数学 2023-06-16 Blair Bilodeau , Dylan J. Foster , Daniel M. Roy

In this paper, we propose a theoretical analysis of the algorithm ISDE, introduced in previous work. From a dataset, ISDE learns a density written as a product of marginal density estimators over a partition of the features. We show that…

统计理论 · 数学 2022-05-09 Louis Pujol

Simultaneous predictive distributions for independent Poisson observables are investigated. A class of improper prior distributions for Poisson means is introduced. The Bayesian predictive distributions based on priors from the introduced…

统计理论 · 数学 2007-06-13 Fumiyasu Komaki

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

机器学习 · 统计学 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

In this work, we are concerned with the estimation of the predictive density of a Gaussian random vector where both the mean and the variance are unknown. In such a context, we prove the inadmissibility of the best equivariant predictive…

统计理论 · 数学 2014-05-27 Aurélie Boisbunon , Yuzo Maruyama

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…

统计理论 · 数学 2010-10-05 Andriy Norets