Related papers: How to Define Automatic Differentiation

The problem of exactly differentiating a signal with bounded second derivative is considered. A class of differentiators is proposed, which converge to the derivative of such a signal within a fixed, i.e., a finite and uniformly bounded…

Let F be an infinite field. We prove that the right zero divisors of a three-dimensional associative F-algebra A must form the union of at most finitely many linear subspaces of A. The proof is elementary and written with students as the…

Automatic differentiation (AD) aims to compute derivatives of user-defined functions, but in Turing-complete languages, this simple specification does not fully capture AD's behavior: AD sometimes disagrees with the true derivative of a…

As it is known, the defining identities of a free Novikov algebra can be obtained from a commutative algebra with a derivation. In this paper, we consider a class of algebras obtained from the class of associative algebras with a derivation…

First order formulas in a relational signature can be considered as operations on the relations of an underlying set, giving rise to multisorted algebras we call first order algebras. We present universal axioms so that an algebra satisfies…

We implement two algorithms in MATHEMATICA for classifying automorphisms of lower-dimensional non-commutative Lie algebras. The first algorithm is a brute-force approach whereas the second is an evolutionary strategy. These algorithms are…

Let $A$ be an associative algebra over a field $F$ of characteristic zero and let $L$ be a Lie algebra over $F$. If $L$ acts on $A$ by derivations, then such an action determines an action of its universal enveloping algebra $U(L)$ and in…

If the bimodule of 1-forms of a differential calculus over an associative algebra is the direct sum of 1-dimensional bimodules, a relation with automorphisms of the algebra shows up. This happens for some familiar quantum space calculi.

We present semantic correctness proofs of Automatic Differentiation (AD). We consider a forward-mode AD method on a higher order language with algebraic data types, and we characterise it as the unique structure preserving macro given a…

In the paper we describe derivations of some classes of Leibniz algebras. It is shown that any derivation of a simple Leibniz algebra can be written as a combination of three derivations. Two of these ingredients are a Lie algebra…

Differentiation along algorithms, i.e., piggyback propagation of derivatives, is now routinely used to differentiate iterative solvers in differentiable programming. Asymptotics is well understood for many smooth problems but the…

We introduce "synchronous algebras", an algebraic structure tailored to recognize automatic relations (aka. synchronous relations, or regular relations). They are the equivalent of monoids for regular languages, however they conceptually…

Recently developed applications in the field of machine learning and computational physics rely on automatic differentiation techniques, that require stable and efficient linear algebra gradient computations. This technical note provides a…

The fair division of indivisible goods is not only a subject of theoretical research, but also an important problem in practice, with solutions being offered on several online platforms. Little is known, however, about the characteristics…

We discuss the calculation of the derivatives of ODE systems with the automatic differentiation tool ADiMat. Using the well-known Lotka-Volterra equations and the ode23 ODE solver as examples we show the analytic derivatives and detail how…

Using adjoint representation of Lie superalgebras, we obtain the matrix form of super-Jacobi and mixed super-Jacobi identities of Lie superbialgebras. By direct calculations of these identities, and use of automorphism supergroups of two…

Profinite semigroups are a generalization of finite semigroups that come about naturally when one is interested in considering free structures with respect to classes of finite semigroups. They also appear naturally through dualization of…

Here we define a Caputo like discrete fractional difference and we compare it to the earlier defined Riemann-Liouville fractional discrete analog. Then we produce discrete fractional Taylor formulae for the first time, and we estimate their…

We classify (possibly non commutative) algebras of low rank over a domain R. We first review results for algebras of rank 2 and for finite-dimensional division algebras over the real numbers. These results motivate us to consider which…

We give an explicit description of the Lie algebra of derivations for a class of infinite dimensional algebras which are given by \'etale descent. The algebras under consideration are twisted forms of central algebras over rings, and…