Related papers: Almost Equivariance via Lie Algebra Convolutions
This work is about understanding the impact of invariance and equivariance on generalisation in supervised learning. We use the perspective afforded by an averaging operator to show that for any predictor that is not equivariant, there is…
In this paper, we propose a generalization for the class of laura algebras, which we call almost laura. We show that this new class of algebras retains most of the essential features of laura algebras, especially concerning the important…
Our goal is to find classes of convolution semigroups on Lie groups $G$ that give rise to interesting processes in symmetric spaces $G/K$. The $K$-bi-invariant convolution semigroups are a well-studied example. An appealing direction for…
Deep convolutional networks (convnets) show a remarkable ability to learn disentangled representations. In recent years, the generalization of deep learning to Lie groups beyond rigid motion in $\mathbb{R}^n$ has allowed to build convnets…
Given a Lie algebra \s, we call Lie \s-algebra a Lie algebra endowed with a reductive action of \s. We characterize the minimal \s-Lie algebras with a nontrivial action of \s, in terms of irreducible representations of \s and invariant…
Let G be a reductive algebraic group over a field of prime characteristic. One can associate to G (or subgroups thereof) its Lie algebra, its Frobenius kernels, and the finite Chevalley group of points over a finite field. The…
Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…
Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…
Left-invariant Hermitian and Gauduchon connections are studied on an arbitrary Lie group $G$ equipped with an arbitrary left-invariant almost Hermitian structure $(\langle\cdot,\cdot\rangle,J)$. The space of left-invariant Hermitian…
We investigate the relation between end-to-end equivariance and layerwise equivariance in deep neural networks. We prove the following: For a network whose end-to-end function is equivariant with respect to group actions on the input and…
In this paper, first using the higher derived brackets, we give the controlling algebra of relative difference Lie algebras, which are also called crossed homomorphisms or differential Lie algebras of weight 1 when the action is the adjoint…
A near permutation of a set is a bijection between two cofinite subsets, modulo coincidence on smaller cofinite subsets. Near permutations of a set form its near symmetric group. In this monograph, we define near actions as homomorphisms…
Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing…
The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…
The space of realizations of a finite-dimensional Lie algebra by first order differential operators is naturally isomorphic to H^1 with coefficients in the module of functions. The condition that a realization admits a finite-dimensional…
Building upon work of Y. Shalom we give a homological-algebra flavored definition of an induction map in group homology associated to a topological coupling. As an application we obtain estimates of the (co)homological dimension of groups G…
Let $G$ be an additive group of order $v$. A $k$-element subset $D$ of $G$ is called a $(v, k, \lambda, t)$-almost difference set if the expressions $gh^{-1}$, for $g$ and $h$ in $D$, represent $t$ of the non-identity elements in $G$…
A wide range of system models in modern robotics and avionics applications admit natural symmetries. Such systems are termed equivariant and the structure provided by the symmetry is a powerful tool in the design of observers. Significant…
Using the symplectic geometry of certain manifolds which appear naturally in Lie theory, we define an invariant which assigns a graded abelian group to an oriented link. The relevant manifolds are transverse slices to certain nilpotent…
Categorical deep learning (CDL) has recently emerged as a framework that leverages category theory to unify diverse neural architectures. While geometric deep learning (GDL) is grounded in the specific context of invariants of group…