We propose a rigorous decomposition of predictive error, highlighting that not all 'irreducible' error is genuinely immutable. Many domains stand to benefit from iterative enhancements in measurement, construct validity, and modeling. Our approach demonstrates how apparently 'unpredictable' outcomes can become more tractable with improved data (across both target and features) and refined algorithms. By distinguishing aleatoric from epistemic error, we delineate how accuracy may asymptotically improve--though inherent stochasticity may remain--and offer a robust framework for advancing computational research.
@article{arxiv.2411.19223,
title = {On the Unknowable Limits to Prediction},
author = {Jiani Yan and Charles Rahal},
journal= {arXiv preprint arXiv:2411.19223},
year = {2025}
}