English
Related papers

Related papers: Lie Group Decompositions for Equivariant Neural Ne…

200 papers

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

Suppose a finite group acts on a scheme $X$ and a finite-dimensional Lie algebra $\mathfrak{g}$. The associated equivariant map algebra is the Lie algebra of equivariant regular maps from $X$ to $\mathfrak{g}$. The irreducible…

Representation Theory · Mathematics 2015-03-10 Erhard Neher , Alistair Savage

This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant $G$-CNNs on homogeneous spaces characterized the representation theory of such…

Machine Learning · Computer Science 2025-04-30 Elias Nyholm , Oscar Carlsson , Maurice Weiler , Daniel Persson

Deep convolutional networks (convnets) show a remarkable ability to learn disentangled representations. In recent years, the generalization of deep learning to Lie groups beyond rigid motion in $\mathbb{R}^n$ has allowed to build convnets…

Machine Learning · Computer Science 2020-11-13 Christopher Ick , Vincent Lostanlen

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations. They rely on…

Machine Learning · Computer Science 2023-10-30 Maksim Zhdanov , Nico Hoffmann , Gabriele Cesa

Recent works show that group equivariance as an inductive bias improves neural network performance for both classification and generation. However, designing group-equivariant neural networks is challenging when the group of interest is…

Machine Learning · Computer Science 2021-06-09 Sourya Basu , Akshayaa Magesh , Harshit Yadav , Lav R. Varshney

The set of functions parameterized by a linear fully-connected neural network is a determinantal variety. We investigate the subvariety of functions that are equivariant or invariant under the action of a permutation group. Examples of such…

Machine Learning · Computer Science 2025-01-13 Kathlén Kohn , Anna-Laura Sattelberger , Vahid Shahverdi

Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and…

Machine Learning · Computer Science 2022-09-14 Hannah Lawrence , Kristian Georgiev , Andrew Dienes , Bobak T. Kiani

Geometric and Topological Deep Learning are rapidly growing research areas that enhance machine learning through the use of geometric and topological structures. Within this framework, Group Equivariant Non-Expansive Operators (GENEOs) have…

Representation Theory · Mathematics 2026-01-14 Francesco Conti , Patrizio Frosini , Nicola Quercioli

We consider the 2-generated free metabelian associative and Lie algebras over the complex field and the invariants of the dihedral groups of finite order acting on these algebras. In the associative case we find a finite set of generators…

Rings and Algebras · Mathematics 2023-11-17 Vesselin Drensky , Boyan Kostadinov

Endowing differentiable functions from a compact manifold to a Lie group with the pointwise group operations one obtains the so-called current groups and, as a special case, loop groups. These are prime examples of infinite-dimensional Lie…

Differential Geometry · Mathematics 2020-11-24 Habib Amiri , Helge Glockner , Alexander Schmeding

We give a characterization of flat affine connections on manifolds by means of a natural affine representation of the universal covering of the Lie group of diffeomorphisms preserving the connection. From the infinitesimal point of view,…

Differential Geometry · Mathematics 2020-11-16 A. Medina , O. Saldarriaga , A. Villabon

Inspired by constraints from physical law, equivariant machine learning restricts the learning to a hypothesis class where all the functions are equivariant with respect to some group action. Irreducible representations or invariant theory…

Machine Learning · Statistics 2024-11-11 Ben Blum-Smith , Soledad Villar

We give a new characterization of flat affine manifolds in terms of an action of the Lie algebra of classical infinitesimal affine transformations on the bundle of linear frames. We characterize flat affine symplectic Lie groups using…

Differential Geometry · Mathematics 2020-08-05 Fabricio Valencia

Lie groups of automorphisms of cotangent bundles of Lie groups are completely characterized and interesting results are obtained. We give prominence to the fact that the Lie groups of automorphisms of cotangent bundles of Lie groups are…

Differential Geometry · Mathematics 2015-05-14 Bakary Manga

Inspired by the work of Chevalley and Eilenberg on the de Rham cohomology on compact Lie groups, we prove that, under certain algebraic and topological conditions, the cohomology associated to left-invariant elliptic, and even hypocomplex,…

Differential Geometry · Mathematics 2022-03-29 Max Reinhold Jahnke

Suppose a group $\Gamma$ acts on a scheme $X$ and a Lie superalgebra $\mathfrak{g}$. The corresponding equivariant map superalgebra is the Lie superalgebra of equivariant regular maps from $X$ to $\mathfrak{g}$. We classify the irreducible…

Representation Theory · Mathematics 2015-05-15 Alistair Savage

Let N be a nilpotent Lie group and let S be an invariant geometric structure on N (cf. symplectic, complex or hypercomplex). We define a left invariant Riemannian metric on N compatible with S to be "minimal", if it minimizes the norm of…

Differential Geometry · Mathematics 2007-05-23 Jorge Lauret

Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions, to reduce the spatial dimensions of feature maps and to allow the receptive fields to grow exponentially with depth. However, it is…

Machine Learning · Computer Science 2021-06-11 Jin Xu , Hyunjik Kim , Tom Rainforth , Yee Whye Teh

In this paper we show how Group Equivariant Convolutional Neural Networks use subsampling to learn to break equivariance to their symmetries. We focus on 2D rotations and reflections and investigate the impact of broken equivariance on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Tom Edixhoven , Attila Lengyel , Jan van Gemert