Bits per Spike as a Betting Game: An Interpretable Unit for Held-Out Log-Likelihood in Neural Data Analysis
Abstract
Held-out log-likelihood is the standard currency for comparing statistical models of neural spike trains, and is often reported as bits per spike relative to a homogeneous Poisson baseline. The units of this metric are difficult to reason about: it is rarely obvious whether an improvement of, say, bits per spike is a large effect or a negligible one. This note develops an interpretation of held-out log-likelihood borrowed from game-theoretic statistics. A fitted model is treated as a player who bets on each upcoming observation at prices set by a baseline model . Under the optimal (Kelly) betting strategy the player's contract function is exactly the likelihood ratio , and the expected log-likelihood ratio is the exponential growth rate of the player's wealth. Because the wealth process is a nonnegative martingale under the null hypothesis that generated the data, Ville's inequality turns it into an anytime-valid test: the baseline may be rejected at level as soon as wealth exceeds . This yields a simple summary statistic, the time to significance , which is the amount of held-out recording needed on average to reject the baseline at level . Since is a strictly decreasing function of , it ranks models identically to bits per spike; it is not a new statistic but a more interpretable unit for an existing one, expressed in seconds of recording rather than in bits. We illustrate the construction on head-direction cells recorded in mouse anterior thalamus, where a generalized linear model reaches significance against a homogeneous Poisson baseline in roughly ms of held-out data for a strongly tuned cell and roughly s for a moderately tuned cell.
Keywords
Cite
@article{arxiv.2607.28779,
title = {Bits per Spike as a Betting Game: An Interpretable Unit for Held-Out Log-Likelihood in Neural Data Analysis},
author = {Alex H. Williams},
journal= {arXiv preprint arXiv:2607.28779},
year = {2026}
}
Comments
13 pages, 4 figures. Companion blog post: https://neurostatsblog.github.io/2026/05/27/model-comparison-by-betting/