English

Shannon entropy estimation for linear processes

Statistics Theory 2020-09-10 v2 Methodology Statistics Theory

Abstract

In this paper, we estimate the Shannon entropy S(f)=\E[log(f(x))]S(f) = -\E[ \log (f(x))] of a one-sided linear process with probability density function f(x)f(x). We employ the integral estimator Sn(f)S_n(f), which utilizes the standard kernel density estimator fn(x)f_n(x) of f(x)f(x). We show that Sn(f)S_n (f) converges to S(f)S(f) almost surely and in \L2\L^2 under reasonable conditions.

Cite

@article{arxiv.2009.03472,
  title  = {Shannon entropy estimation for linear processes},
  author = {Timothy Fortune and Hailin Sang},
  journal= {arXiv preprint arXiv:2009.03472},
  year   = {2020}
}

Comments

14 pages, accepted by Journal of Risk and Financial Management

R2 v1 2026-06-23T18:22:45.744Z