English
Related papers

Related papers: Bayesian Entropy Estimation for Countable Discrete…

200 papers

Dirichlet process mixture model (DPMM) is a popular Bayesian nonparametric model. In this paper, we apply this model to weighted data and then estimate the un-weighted distribution from the corresponding weighted distribution using the…

Computation · Statistics 2018-12-12 Soghra Bohlourihajjar , Soleiman Khazaei

This article provides a completion to theories of information based on entropy, resolving a longstanding question in its axiomatization as proposed by Shannon and pursued by Jaynes. We show that Shannon's entropy function has a…

Information Theory · Computer Science 2015-04-14 Frank Lad , Giuseppe Sanfilippo , Gianna Agrò

We present a Bayesian model for estimating the joint distribution of multivariate categorical data when units are nested within groups. Such data arise frequently in social science settings, for example, people living in households. The…

Methodology · Statistics 2016-10-31 Jingchen Hu , Jerome P. Reiter , Quanli Wang

This paper introduces a general class of hierarchical nonparametric prior distributions. The random probability measures are constructed by a hierarchy of generalized species sampling processes with possibly non-diffuse base measures. The…

Methodology · Statistics 2018-03-16 Federico Bassetti , Roberto Casarin , Luca Rossini

We consider nonparametric Bayesian estimation of a probability density $p$ based on a random sample of size $n$ from this density using a hierarchical prior. The prior consists, for instance, of prior weights on the regularity of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Jüri Lember , Aad van der Vaart

Many modern experiments, such as microarray gene expression and genome-wide association studies, present the problem of estimating a large number of parallel effects. Bayesian inference is a popular approach for analyzing such data by…

Methodology · Statistics 2018-10-26 J G Liao , Arthur Berg , Timothy L McMurry

The family of log-concave density functions contains various kinds of common probability distributions. Due to the shape restriction, it is possible to find the nonparametric estimate of the density, for example, the nonparametric maximum…

Methodology · Statistics 2024-01-29 Fuheng Cui , Stephen G. Walker

This paper develops nonparametric estimation for discrete choice models based on the mixed multinomial logit (MMNL) model. It has been shown that MMNL models encompass all discrete choice models derived under the assumption of random…

Statistics Theory · Mathematics 2011-02-25 Pierpaolo De Blasi , Lancelot F. James , John W. Lau

This paper reconsiders the problem of calculating the expected set of probabilities <p_i>, given the observed set of items {m_i}, that are distributed among n bins with an (unknown) set of probabilities {p_i} for being placed in the ith…

Statistics Theory · Mathematics 2013-05-06 Anthony J Webster

A Dirichlet polynomial $d$ in one variable ${\mathcal{y}}$ is a function of the form $d({\mathcal{y}})=a_n n^{\mathcal{y}}+\cdots+a_22^{\mathcal{y}}+a_11^{\mathcal{y}}+a_00^{\mathcal{y}}$ for some $n,a_0,\ldots,a_n\in\mathbb{N}$. We will…

Information Theory · Computer Science 2021-10-29 David I. Spivak , Timothy Hosgood

A compound Poisson process whose parameters are all unknown is observed at finitely many equispaced times. Nonparametric estimators of the jump and L\'evy distributions are proposed and functional central limit theorems using the uniform…

Statistics Theory · Mathematics 2017-02-06 Alberto J. Coca

The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is…

Machine Learning · Statistics 2012-01-10 Chong Wang , David M. Blei

The fidelity-based smooth min-relative entropy is a distinguishability measure that has appeared in a variety of contexts in prior work on quantum information, including resource theories like thermodynamics and coherence. Here we provide a…

Quantum Physics · Physics 2024-05-29 Theshani Nuradha , Mark M. Wilde

The paper develops new methods of non-parametric estimation a compound Poisson distribution. Such a problem arise, in particular, in the inference of a Levy process recorded at equidistant time intervals. Our key estimator is based on…

Statistics Theory · Mathematics 2015-10-19 Alexey Lindo , Sergei Zuyev , Serik Sagitov

We introduce a Bayesian approach to predictive density calibration and combination that accounts for parameter uncertainty and model set incompleteness through the use of random calibration functionals and random combination weights.…

Applications · Statistics 2016-10-26 Federico Bassetti , Roberto Casarin , Francesco Ravazzolo

Directional data require specialized probability models because of the non-Euclidean and periodic nature of their domain. When a directional variable is observed jointly with linear variables, modeling their dependence adds an additional…

Methodology · Statistics 2022-12-22 Tong Zou , Hal S. Stern

The entropy rates of the Wright-Fisher process, the Moran process, and generalizations are computed and used to compare these processes and their dependence on standard evolutionary parameters. Entropy rates are measures of the variation…

Dynamical Systems · Mathematics 2014-03-26 Marc Harper

Mixture models are commonly used in applications with heterogeneity and overdispersion in the population, as they allow the identification of subpopulations. In the Bayesian framework, this entails the specification of suitable prior…

Methodology · Statistics 2023-06-21 Andrea Cremaschi , Timothy M. Wertz , Maria De Iorio

The estimation of entropy rates for stationary discrete-valued stochastic processes is a well studied problem in information theory. However, estimating the entropy rate for stationary continuous-valued stochastic processes has not received…

Information Theory · Computer Science 2021-05-26 Andrew Feutrill , Matthew Roughan

In probabilistic (Bayesian) inferences, we typically want to compute properties of the posterior distribution, describing knowledge of unknown quantities in the context of a particular dataset and the assumed prior information. The marginal…

Computation · Statistics 2016-11-03 Brendon J. Brewer , Daniel Foreman-Mackey