English

Symbolic Density Estimation for Discrete Distributions

Machine Learning 2026-05-25 v1 Methodology Machine Learning

Abstract

Discrete probability laws underpin statistical modeling, yet the catalog of interpretable distributions has expanded only gradually through centuries of case-by-case mathematical derivations. We introduce symbolic density estimation (SDE), an unsupervised framework that automatically recovers closed-form probability mass functions by composing elementary analytic operations within a structured search space. Our method integrates domain-specific structural priors with evolutionary search and a validity-aware inference stage, and it extends to richer distribution families such as zero inflation and finite mixtures. To support systematic evaluation and future research, we contribute a benchmark dataset spanning a broad collection of commonly used discrete distributions. The proposed algorithm recovers all benchmark families with accurate parameter estimates. A real data application shows that it identifies concise and interpretable mixture models that improve goodness-of-fit over standard models.

Keywords

Cite

@article{arxiv.2605.21813,
  title  = {Symbolic Density Estimation for Discrete Distributions},
  author = {Ziwen Liu and Meng Li},
  journal= {arXiv preprint arXiv:2605.21813},
  year   = {2026}
}

Comments

28 pages, 5 figures, 22 tables