English
Related papers

Related papers: Exact Good-Turing characterization of the two-para…

200 papers

The problem of estimating discovery probabilities originated in the context of statistical ecology, and in recent years it has become popular due to its frequent appearance in challenging applications arising in genetics, bioinformatics,…

Methodology · Statistics 2015-06-17 Stefano Favaro , Bernardo Nipoti , Yee Whye Teh

Given $n$ samples from a population of individuals belonging to different types with unknown proportions, how do we estimate the probability of discovering a new type at the $(n+1)$-th draw? This is a classical problem in statistics,…

Statistics Theory · Mathematics 2018-06-27 Fadhel Ayed , Marco Battiston , Federico Camerlenghi , Stefano Favaro

Favaro, Lijoi, and Pruenster (2012, Biometrics, 68, 1188--1196) derive a novel Bayesian nonparametric estimator of the probability of detecting at the $(n+m+1)$th observation a species already observed with any given frequency in an…

Statistics Theory · Mathematics 2013-04-04 Annalisa Cerquetti

When faced with a small sample from a large universe of possible outcomes, scientists often turn to the venerable Good--Turing estimator. Despite its pedigree, however, this estimator comes with considerable drawbacks, such as the need to…

Statistics Theory · Mathematics 2025-09-10 Yanjun Han , Jonathan Niles-Weed , Yandi Shen , Yihong Wu

Gibbs-type random probability measures, or Gibbs-type priors, are arguably the most "natural" generalization of the celebrated Dirichlet prior. Among them the two parameter Poisson-Dirichlet prior certainly stands out for the mathematical…

Methodology · Statistics 2020-03-25 Julyan Arbel , Stefano Favaro

In Bayesian nonparametric inference, random discrete probability measures are commonly used as priors within hierarchical mixture models for density estimation and for inference on the clustering of the data. Recently, it has been shown…

Statistics Theory · Mathematics 2012-11-26 Stefano Favaro , Antonio Lijoi , Igor Prünster

Estimating a large alphabet probability distribution from a limited number of samples is a fundamental problem in machine learning and statistics. A variety of estimation schemes have been proposed over the years, mostly inspired by the…

Machine Learning · Statistics 2018-08-20 Amichai Painsky , Meir Feder

Given a sample of size $n$ from a population of individuals belonging to different species with unknown proportions, a popular problem of practical interest consists in making inference on the probability $D_{n}(l)$ that the $(n+1)$-th draw…

Methodology · Statistics 2017-10-18 Julyan Arbel , Stefano Favaro , Bernardo Nipoti , Yee Whye Teh

We consider the problem of estimating the total probability of all symbols that appear with a given frequency in a string of i.i.d. random variables with unknown distribution. We focus on the regime in which the block length is large yet no…

Information Theory · Computer Science 2016-11-15 Aaron B. Wagner , Pramod Viswanath , Sanjeev R. Kulkarni

Feature allocation models generalize species sampling models by allowing every observation to belong to more than one species, now called features. Under the popular Bernoulli product model for feature allocation, given $n$ samples, we…

Statistics Theory · Mathematics 2020-09-22 Fadhel Ayed , Marco Battiston , Federico Camerlenghi , Stefano Favaro

We consider the problem of estimating the probability of an observed string drawn i.i.d. from an unknown distribution. The key feature of our study is that the length of the observed string is assumed to be of the same order as the size of…

Information Theory · Computer Science 2007-07-13 Aaron B. Wagner , Pramod Viswanath , Sanjeev R. Kulkarni

The brilliant method due to Good and Turing allows for estimating objects not occurring in a sample. The problem, known under names "sample coverage" or "missing mass" goes back to their cryptographic work during WWII, but over years has…

Machine Learning · Statistics 2021-04-16 Maciej Skorski

We present an alternative approach to the Bayesian nonparametric analysis of conditional species richness under two-parameter Poisson Dirichlet priors. We rely on a known characterization by deletion of classes property and on results for…

Probability · Mathematics 2010-02-03 Annalisa Cerquetti

Discrete random probability measures and the exchangeable random partitions they induce are key tools for addressing a variety of estimation and prediction problems in Bayesian inference. Indeed, many popular nonparametric priors, such as…

Statistics Theory · Mathematics 2015-03-03 P. De Blasi , S. Favaro , A. Lijoi , R. H. Mena , I. Pruenster , M. Ruggiero

This paper explores large sample properties of the two-parameter $(\alpha,\theta)$ Poisson--Dirichlet Process in two contexts. In a Bayesian context of estimating an unknown probability measure, viewing this process as a natural extension…

Probability · Mathematics 2008-05-21 Lancelot F. James

Consider the random Dirichlet partition of the interval into $n$ fragments with parameter $\theta >0$. We recall the unordered Ewens sampling formulae from finite Dirichlet partitions. As this is a key variable for estimation purposes,…

Methodology · Statistics 2008-09-25 Thierry Huillet , Christian Paroissin

In this paper, we develop simple, yet efficient, procedures for sampling approximations of the two-Parameter Poisson-Dirichlet Process and the normalized inverse-Gaussian process. We compare the efficiency of the new approximations to the…

Computation · Statistics 2012-09-25 Luai Al Labadi , Mahmoud Zarepour

Quantifying convergence and sufficient sampling of macromolecular molecular dynamics simulations is more often than not a source of controversy (and of various ad hoc solutions) in the field. Clearly, the only reasonable, consistent and…

Quantitative Methods · Quantitative Biology 2013-12-23 Panagiotis I. Koukos , Nicholas M. Glykos

Kingman's coalescent is one of the most popular models in population genetics. It describes the genealogy of a population whose genetic composition evolves in time according to the Wright-Fisher model, or suitable approximations of it…

Methodology · Statistics 2018-04-20 Stefano Favaro , Shui Feng , Paul A. Jenkins

Bayesian methods are a popular choice for statistical inference in small-data regimes due to the regularization effect induced by the prior. In the context of density estimation, the standard nonparametric Bayesian approach is to target the…

Machine Learning · Statistics 2023-02-21 Sahra Ghalebikesabi , Chris Holmes , Edwin Fong , Brieuc Lehmann
‹ Prev 1 2 3 10 Next ›