English

Matrix-Free Jacobian Chaining

Machine Learning 2024-06-19 v1 Computational Engineering, Finance, and Science

Abstract

The efficient computation of Jacobians represents a fundamental challenge in computational science and engineering. Large-scale modular numerical simulation programs can be regarded as sequences of evaluations of in our case differentiable subprograms with corresponding elemental Jacobians. The latter are typically not available. Tangent and adjoint versions of the individual subprograms are assumed to be given as results of algorithmic differentiation instead. The classical (Jacobian) Matrix Chain Product problem is reformulated in terms of matrix-free Jacobian-matrix (tangents) and matrix-Jacobian products (adjoints), subject to limited memory for storing information required by latter. All numerical results can be reproduced using an open-source reference implementation.

Keywords

Cite

@article{arxiv.2406.11862,
  title  = {Matrix-Free Jacobian Chaining},
  author = {Uwe Naumann},
  journal= {arXiv preprint arXiv:2406.11862},
  year   = {2024}
}

Comments

arXiv admin note: substantial text overlap with arXiv:2003.05755

R2 v1 2026-06-28T17:09:09.422Z