Related papers: Reverse Tangent Categories
Tangent categories are categories equipped with a tangent functor: an endofunctor with certain natural transformations which make it behave like the tangent bundle functor on the category of smooth manifolds. They provide an abstract…
In differential geometry, the existence of pullbacks is a delicate matter, since the category of smooth manifolds does not admit all of them. When pullbacks are required, often submersions are employed as an ideal class of maps which…
In this paper, we explain how the abstract notion of a differential bundle in a tangent category provides a new way of thinking about the category of modules over a commutative ring and its opposite category. MacAdam previously showed that…
A tangent category is a category equipped with an endofunctor that satisfies certain axioms which capture the abstract properties of the tangent bundle functor from classical differential geometry. Cockett and Cruttwell introduced…
Tangent categories provide a categorical axiomatization of the tangent bundle. There are many interesting examples and applications of tangent categories in a variety of areas such as differential geometry, algebraic geometry, algebra, and…
We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it…
Tangent categories provide an axiomatic framework for understanding various tangent bundles and differential operations that occur in differential geometry, algebraic geometry, abstract homotopy theory, and computer science. Previous work…
The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian…
Tangent categories offer a categorical context for differential geometry, by categorifying geometric notions like the tangent bundle functor, vector fields, Euclidean spaces, vector bundles, connections, etc. In the last decade, the theory…
A tangent category is a categorical abstraction of the tangent bundle construction for smooth manifolds. In that context, Cockett and Cruttwell develop the notion of differential bundle which, by work of MacAdam, generalizes the notion of…
Differential lambda-categories were introduced by Bucciarelli et al. as models for the simply typed version of the differential lambda-calculus of Ehrhard and Regnier. A differential lambda-category is a cartesian closed differential…
We introduce Reverse Derivative Ascent: a categorical analogue of gradient based methods for machine learning. Our algorithm is defined at the level of so-called reverse differential categories. It can be used to learn the parameters of…
Tangent category theory is a well-established categorical framework for differential geometry. A long list of fundamental geometric constructions, such as the tangent bundle functor, vector fields, Euclidean spaces, and vector bundles have…
A tangent category is a category with an endofunctor, called the tangent bundle functor, which is equipped with various natural transformations that capture essential properties of the classical tangent bundle of smooth manifolds. In this…
In this work we introduce a convolution operation over the tangent bundle of Riemann manifolds in terms of exponentials of the Connection Laplacian operator. We define tangent bundle filters and tangent bundle neural networks (TNNs) based…
We define a subcategory of the category of diffeological spaces, which contains smooth manifolds, the diffeomorphism subgroups and its coadjoint orbits. In these spaces we construct a tangent bundle, vector fields and a de Rham cohomology.
The unprecedented pace of machine learning research has lead to incredible advances, but also poses hard challenges. At present, the field lacks strong theoretical underpinnings, and many important achievements stem from ad hoc design…
Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth…
We show that differential calculus (in its usual form, or in the general form of topological differential calculus) can be fully imdedded into a functor category (functors from a small category of anchord tangent algebras to anchored sets).…
Reverse derivative categories (RDCs) have recently been shown to be a suitable semantic framework for studying machine learning algorithms. Whereas emphasis has been put on training methodologies, less attention has been devoted to…