English

CHAD for Expressive Total Languages

Programming Languages 2023-11-13 v2 Logic in Computer Science Category Theory

Abstract

We show how to apply forward and reverse mode Combinatory Homomorphic Automatic Differentiation (CHAD) to total functional programming languages with expressive type systems featuring the combination of - tuple types; - sum types; - inductive types; - coinductive types; - function types. We achieve this by analysing the categorical semantics of such types in Σ\Sigma-types (Grothendieck constructions) of suitable categories. Using a novel categorical logical relations technique for such expressive type systems, we give a correctness proof of CHAD in this setting by showing that it computes the usual mathematical derivative of the function that the original program implements. The result is a principled, purely functional and provably correct method for performing forward and reverse mode automatic differentiation (AD) on total functional programming languages with expressive type systems.

Keywords

Cite

@article{arxiv.2110.00446,
  title  = {CHAD for Expressive Total Languages},
  author = {Fernando Lucatelli Nunes and Matthijs Vákár},
  journal= {arXiv preprint arXiv:2110.00446},
  year   = {2023}
}

Comments

Under review at MSCS

R2 v1 2026-06-24T06:33:26.240Z