Possible, Yes; Ignorant, Perhaps: A Scorecard for Possibilistic Forecasts
Abstract
Probabilistic forecasts must sum to unity and cannot express ``I don't know.'' Possibility theory relaxes this constraint: a subnormal distribution explicitly measures how much of the plausibility budget remains unassigned, ignorance signal that probability cannot represent. This paper develops a verification framework for such forecasts, centred on a five-number scorecard that separately diagnoses whether the forecast pointed at the right outcome (depth-of-truth), how sharply (diffuseness, support margin), how confidently (ignorance), and how dominantly (conditional necessity). A possibility-to-probability conversion preserves ignorance for familiar frequency-based scoring; categorical threshold scores (POD, FAR, CSI, etc.) connect to operational practice. Together, these three complementary facets -- possibilistic, probabilistic, and categorical -- expose failure modes invisible to any single metric. Storm Prediction Center convective outlook categories serve as the running example throughout; a synthetic reforecast demonstrates diagnostic visualisations and scorecard interpretation. Ignorance is better expressed than repressed.
Keywords
Cite
@article{arxiv.2604.02187,
title = {Possible, Yes; Ignorant, Perhaps: A Scorecard for Possibilistic Forecasts},
author = {John R. Lawson},
journal= {arXiv preprint arXiv:2604.02187},
year = {2026}
}
Comments
11 figures; 7 sections;19 pages on PDF as-is