English

Quasi-Bayesian sequential deconvolution

Methodology 2024-12-16 v2 Machine Learning

Abstract

Density deconvolution deals with the estimation of the probability density function ff of a random signal from n1n\geq1 data observed with independent and known additive random noise. This is a classical problem in statistics, for which frequentist and Bayesian nonparametric approaches are available to estimate ff in static or batch domains. In this paper, we consider the problem of density deconvolution in a streaming or online domain, and develop a principled sequential approach to estimate ff. By relying on a quasi-Bayesian sequential (learning) model for the data, often referred to as Newton's algorithm, we obtain a sequential deconvolution estimate fnf_{n} of ff that is of easy evaluation, computationally efficient, and with constant computational cost as data increase, which is desirable for streaming data. In particular, local and uniform Gaussian central limit theorems for fnf_{n} are established, leading to asymptotic credible intervals and bands for ff, respectively. We provide the sequential deconvolution estimate fnf_{n} with large sample asymptotic guarantees under the quasi-Bayesian sequential model for the data, proving a merging with respect to the direct density estimation problem, and also under a ``true" frequentist model for the data, proving consistency. An empirical validation of our methods is presented on synthetic and real data, also comparing with respect to a kernel approach and a Bayesian nonparametric approach with a Dirichlet process mixture prior.

Keywords

Cite

@article{arxiv.2408.14402,
  title  = {Quasi-Bayesian sequential deconvolution},
  author = {Stefano Favaro and Sandra Fortini},
  journal= {arXiv preprint arXiv:2408.14402},
  year   = {2024}
}

Comments

71 pages