English

Second-Order Asymptotics of Sequential Hypothesis Testing

Information Theory 2020-07-01 v3 math.IT Statistics Theory Statistics Theory

Abstract

We consider the classical sequential binary hypothesis testing problem in which there are two hypotheses governed respectively by distributions P0P_0 and P1P_1 and we would like to decide which hypothesis is true using a sequential test. It is known from the work of Wald and Wolfowitz that as the expectation of the length of the test grows, the optimal type-I and type-II error exponents approach the relative entropies D(P1P0)D(P_1\|P_0) and D(P0P1)D(P_0\|P_1). We refine this result by considering the optimal backoff---or second-order asymptotics---from the corner point of the achievable exponent region (D(P1P0),D(P0P1))(D(P_1\|P_0),D(P_0\|P_1)) under two different constraints on the length of the test (or the sample size). First, we consider a probabilistic constraint in which the probability that the length of test exceeds a prescribed integer nn is less than a certain threshold 0<ε<10<\varepsilon <1. Second, the expectation of the sample size is bounded by nn. In both cases, and under mild conditions, the second-order asymptotics is characterized exactly. Numerical examples are provided to illustrate our results.

Keywords

Cite

@article{arxiv.2001.04598,
  title  = {Second-Order Asymptotics of Sequential Hypothesis Testing},
  author = {Yonglong Li and Vincent Y. F. Tan},
  journal= {arXiv preprint arXiv:2001.04598},
  year   = {2020}
}

Comments

Accepted by the IEEE Transactions on Information Theory

R2 v1 2026-06-23T13:10:24.865Z