Confirming the Null: Remarks on Equivalence Testing and the Topology of Confirmation
Abstract
Null Hypothesis Statistical Testing is a dominant framework for conducting statistical analysis across the sciences. There remains considerable debate as to whether, and under what circumstances, evidence can be said to be confirmatory of a null hypothesis. This paper presents a modal logic of short-run frequentist confirmation developed by leveraging the duality between hypothesis testing and statistical estimation. It is shown that a hypothesis is confirmable if and only if it satisfies the topological condition of having nonempty interior. Consequently, two-sided hypotheses are not statistically confirmable owing to defects in their topological structure. Equivalence hypotheses are, by contrast, confirmable.
Keywords
Cite
@article{arxiv.2405.16331,
title = {Confirming the Null: Remarks on Equivalence Testing and the Topology of Confirmation},
author = {Reid Dale},
journal= {arXiv preprint arXiv:2405.16331},
year = {2024}
}
Comments
These are old notes on a three-valued logic relating to equivalence/inequivalence. Comments and feedback welcome. Further revisions are expected over time