English

Quantifying Information Loss under Coarse-Grained Partitions: A Discrete Framework for Explainable Artificial Intelligence

Artificial Intelligence 2026-03-10 v7 Information Theory math.IT Logic Probability

Abstract

As artificial intelligence (AI) systems are increasingly used in ethically sensitive domains such as education, healthcare, and transportation, balancing accuracy and interpretability has become a central concern. Coarse ethics (CE) motivates coarse-grained evaluations under cognitive, institutional, and contextual constraints, but it still lacks a simple mathematical formalization of admissible coarse-graining and its informational consequences. This paper introduces coarse-grained partitions (CGPs) as a discrete framework for modeling coarse evaluation on a finite totally ordered score scale. A CGP represents coarse evaluation as a partition into grains with an index assignment, and induces a coarse-grained distribution by pushforward. To compare admissible coarse-grainings, we introduce categorical unification (CU), which constructs a canonical fine-scale reconstruction from the coarse representation under minimal assumptions. On this basis, we define a KL-based measure of information loss, DKL-CUD_{\mathrm{KL\text{-}CU}}, as the divergence between the original fine-grained distribution and its CU-based reconstruction. We prove that DKL-CU=0D_{\mathrm{KL\text{-}CU}}=0 if and only if the original distribution is already uniform within each grain. This shows that zero loss, in the sense of the proposed measure, is a highly exceptional limiting case rather than a realistic benchmark for ordinary evaluative practice. We also show that the framework leads naturally to an optimization problem for comparing alternative admissible CGPs. Applications to educational grading and explainable AI (XAI) illustrate how the framework clarifies trade-offs among informational fidelity, interpretability, and coarsening cost.

Keywords

Cite

@article{arxiv.2502.07347,
  title  = {Quantifying Information Loss under Coarse-Grained Partitions: A Discrete Framework for Explainable Artificial Intelligence},
  author = {Takashi Izumo},
  journal= {arXiv preprint arXiv:2502.07347},
  year   = {2026}
}

Comments

22 pages, 2 figures

R2 v1 2026-06-28T21:39:52.975Z