English

A characterization of product-form exchangeable feature probability functions

Probability 2016-07-08 v1 Statistics Theory Machine Learning Statistics Theory

Abstract

We characterize the class of exchangeable feature allocations assigning probability Vn,kl=1kWmlUnmlV_{n,k}\prod_{l=1}^{k}W_{m_{l}}U_{n-m_{l}} to a feature allocation of nn individuals, displaying kk features with counts (m1,,mk)(m_{1},\ldots,m_{k}) for these features. Each element of this class is parametrized by a countable matrix VV and two sequences UU and WW of non-negative weights. Moreover, a consistency condition is imposed to guarantee that the distribution for feature allocations of n1n-1 individuals is recovered from that of nn individuals, when the last individual is integrated out. In Theorem 1.1, we prove that the only members of this class satisfying the consistency condition are mixtures of the Indian Buffet Process over its mass parameter γ\gamma and mixtures of the Beta--Bernoulli model over its dimensionality parameter NN. Hence, we provide a characterization of these two models as the only, up to randomization of the parameters, consistent exchangeable feature allocations having the required product form.

Cite

@article{arxiv.1607.02066,
  title  = {A characterization of product-form exchangeable feature probability functions},
  author = {Marco Battiston and Stefano Favaro and Daniel M. Roy and Yee Whye Teh},
  journal= {arXiv preprint arXiv:1607.02066},
  year   = {2016}
}

Comments

21 pages

R2 v1 2026-06-22T14:48:23.982Z