English

A Common Interface for Automatic Differentiation

Mathematical Software 2025-05-19 v1 Machine Learning Numerical Analysis Numerical Analysis

Abstract

For scientific machine learning tasks with a lot of custom code, picking the right Automatic Differentiation (AD) system matters. Our Julia package DifferentiationInterface..jl provides a common frontend to a dozen AD backends, unlocking easy comparison and modular development. In particular, its built-in preparation mechanism leverages the strengths of each backend by amortizing one-time computations. This is key to enabling sophisticated features like sparsity handling without putting additional burdens on the user.

Keywords

Cite

@article{arxiv.2505.05542,
  title  = {A Common Interface for Automatic Differentiation},
  author = {Guillaume Dalle and Adrian Hill},
  journal= {arXiv preprint arXiv:2505.05542},
  year   = {2025}
}

Comments

11 pages, 2 figures, 3 listings, 1 table