English

Bits per Spike as a Betting Game: An Interpretable Unit for Held-Out Log-Likelihood in Neural Data Analysis

Methodology 2026-07-30 v1 Neurons and Cognition

Abstract

Held-out log-likelihood is the standard currency for comparing statistical models of neural spike trains, and is often reported as bits per spike relative to a homogeneous Poisson baseline. The units of this metric are difficult to reason about: it is rarely obvious whether an improvement of, say, 0.340.34 bits per spike is a large effect or a negligible one. This note develops an interpretation of held-out log-likelihood borrowed from game-theoretic statistics. A fitted model QQ is treated as a player who bets on each upcoming observation at prices set by a baseline model BB. Under the optimal (Kelly) betting strategy the player's contract function is exactly the likelihood ratio q/bq/b, and the expected log-likelihood ratio LL is the exponential growth rate of the player's wealth. Because the wealth process is a nonnegative martingale under the null hypothesis that BB generated the data, Ville's inequality turns it into an anytime-valid test: the baseline may be rejected at level α\alpha as soon as wealth exceeds 1/α1/\alpha. This yields a simple summary statistic, the time to significance τΔ=Δlog(α)/L\tau \Delta = -\Delta \log(\alpha) / L, which is the amount of held-out recording needed on average to reject the baseline at level α\alpha. Since τ\tau is a strictly decreasing function of LL, it ranks models identically to bits per spike; it is not a new statistic but a more interpretable unit for an existing one, expressed in seconds of recording rather than in bits. We illustrate the construction on head-direction cells recorded in mouse anterior thalamus, where a generalized linear model reaches significance against a homogeneous Poisson baseline in roughly 120120 ms of held-out data for a strongly tuned cell and roughly 1111 s for a moderately tuned cell.

Keywords

Cite

@article{arxiv.2607.28779,
  title  = {Bits per Spike as a Betting Game: An Interpretable Unit for Held-Out Log-Likelihood in Neural Data Analysis},
  author = {Alex H. Williams},
  journal= {arXiv preprint arXiv:2607.28779},
  year   = {2026}
}

Comments

13 pages, 4 figures. Companion blog post: https://neurostatsblog.github.io/2026/05/27/model-comparison-by-betting/