English
Related papers

Related papers: Proper Bayes and Minimax Predictive Densities for …

200 papers

In this paper we derive lower bounds in minimax sense for estimation of the instantaneous volatility if the diffusion type part cannot be observed directly but under some additional Gaussian noise. Three different models are considered. Our…

Statistics Theory · Mathematics 2010-02-17 Axel Munk , Johannes Schmidt-Hieber

The negative multinomial distribution is a multivariate generalization of the negative binomial distribution. In this paper, we consider the problem of estimating an unknown matrix of probabilities on the basis of observations of negative…

Statistics Theory · Mathematics 2020-10-30 Yasuyuki Hamura , Tatsuya Kubokawa

Feed-forward neural networks can be understood as a combination of an intermediate representation and a linear hypothesis. While most previous works aim to diversify the representations, we explore the complementary direction by performing…

Machine Learning · Computer Science 2019-10-24 Han Zhao , Yao-Hung Hubert Tsai , Ruslan Salakhutdinov , Geoffrey J. Gordon

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

We obtain the optimal Bayesian minimax rate for the unconstrained large covariance matrix of multivariate normal sample with mean zero, when both the sample size, n, and the dimension, p, of the covariance matrix tend to infinity.…

Statistics Theory · Mathematics 2017-12-04 Kyoungjae Lee , Jaeyong Lee

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically…

Data Analysis, Statistics and Probability · Physics 2008-12-02 Michele Tumminello , Fabrizio Lillo , Rosario Nunzio Mantegna

Optimal dimensionality reduction methods are proposed for the Bayesian inference of a Gaussian linear model with additive noise in presence of overabundant data. Three different optimal projections of the observations are proposed based on…

Statistics Theory · Mathematics 2018-02-13 Loïc Giraldi , Olivier P. Le Maître , Ibrahim Hoteit , Omar M. Knio

In this paper, we propose a theoretical analysis of the algorithm ISDE, introduced in previous work. From a dataset, ISDE learns a density written as a product of marginal density estimators over a partition of the features. We show that…

Statistics Theory · Mathematics 2022-05-09 Louis Pujol

Bayesian networks are one of the most widely used classes of probabilistic models for risk management and decision support because of their interpretability and flexibility in including heterogeneous pieces of information. In any applied…

Methodology · Statistics 2024-07-08 Manuele Leonelli , Jim Q. Smith , Sophia K. Wright

The widely applicable information criterion (WAIC) has been used as a model selection criterion for Bayesian statistics in recent years. It is an asymptotically unbiased estimator of the Kullback-Leibler divergence between a Bayesian…

Methodology · Statistics 2022-08-09 Yoshiyuki Ninomiya

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

To the frequentist who computes posteriors, not all priors are useful asymptotically: in this paper Schwartz's 1965 Kullback-Leibler condition is generalised to enable frequentist interpretation of convergence of posterior distributions…

Statistics Theory · Mathematics 2017-11-28 B. J. K. Kleijn

We propose a robust and scalable variational Bayes (VB) framework designed to effectively handle contamination and outliers in dataset. Our approach partitions the data into $m$ disjoint subsets and formulates a joint optimization problem…

Methodology · Statistics 2025-12-16 Jiawei Yan , Ju Liu , Weidong Liu , Jiyuan Tu

In the sparse normal means model, coverage of adaptive Bayesian posterior credible sets associated to spike and slab prior distributions is considered. The key sparsity hyperparameter is calibrated via marginal maximum likelihood empirical…

Statistics Theory · Mathematics 2019-02-05 Ismael Castillo , Botond Szabo

We consider nonparametric Bayesian estimation and prediction for nonhomogeneous Poisson process models with unknown intensity functions. We propose a class of improper priors for intensity functions. Nonparametric Bayesian inference with…

Statistics Theory · Mathematics 2021-08-17 Fumiyasu Komaki

We consider predictive density estimation under logarithmic score for $d$-dimensional infinitely divisible location models. Taking the formal Bayes predictive density under the Lebesgue prior as a benchmark, we study the Kullback-Leibler…

Statistics Theory · Mathematics 2026-05-27 Kōsaku Takanashi , Kenichiro McAlinn

Many statistical studies are concerned with the analysis of observations organized in a matrix form whose elements are count data. When these observations are assumed to follow a Poisson or a multinomial distribution, it is of interest to…

Statistics Theory · Mathematics 2022-01-04 Jérémie Bigot , Charles Deledalle

The space of positive definite symmetric matrices has been studied extensively as a means of understanding dependence in multivariate data along with the accompanying problems in statistical inference. Many books and papers have been…

Statistics Theory · Mathematics 2012-03-16 L. R. Haff , P. T. Kim , J. -Y. Koo , D. St. P. Richards

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

Bayesian density deconvolution using nonparametric prior distributions is a useful alternative to the frequentist kernel based deconvolution estimators due to its potentially wide range of applicability, straightforward uncertainty…

Statistics Theory · Mathematics 2013-09-10 Abhra Sarkar , Debdeep Pati , Bani K. Mallick , Raymond J. Carroll