中文
相关论文

相关论文: Lie Group Decompositions for Equivariant Neural Ne…

200 篇论文

The aim of this paper is to provide a general mathematical framework for group equivariance in the machine learning context. The framework builds on a synergy between persistent homology and the theory of group actions. We define…

机器学习 · 计算机科学 2019-03-05 Mattia G. Bergomi , Patrizio Frosini , Daniela Giorgi , Nicola Quercioli

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

机器学习 · 计算机科学 2016-06-06 Taco S. Cohen , Max Welling

Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is…

机器学习 · 计算机科学 2023-02-01 Artem Moskalev , Anna Sepliarskaia , Ivan Sosnovik , Arnold Smeulders

We study the space of Lie algebras equipped with left-invariant complex structures, $\mathcal{L}_{ J_{\tiny{\mbox{cn}}} }(\mathbb{R}^{2n}) $, with particular attention to their degenerations and deformations. To this end, we identify…

表示论 · 数学 2025-02-19 Edison Alberto Fernández-Culma , Nadina Rojas

The Linearization Theorem for proper Lie groupoids organizes and generalizes several results for classic geometries. Despite the various approaches and recent works on the subject, the problem of understanding invariant linearization…

微分几何 · 数学 2021-08-20 Matias del Hoyo , Mateus de Melo

Convolution of valuations was introduced by the first named author and Fu for linear spaces, and later by Alesker and the first named author for compact Lie groups. In this paper we study the convolution of invariant valuations on Lie…

微分几何 · 数学 2025-12-02 Andreas Bernig , Dmitry Faifman , Jan Kotrbatý

Group Equivariant Convolutions (GConvs) enable convolutional neural networks to be equivariant to various transformation groups, but at an additional parameter and compute cost. We investigate the filter parameters learned by GConvs and…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Attila Lengyel , Jan C. van Gemert

In this work we obtain the general form of polynomial mappings that commute with a linear action of a relative symmetry group. The aim is to give results for relative equivariant polynomials that correspond to the results for relative…

动力系统 · 数学 2014-11-25 Patricia Hernandes Baptistelli , Miriam Manoel

The main result of this article is an application of the theory of invariant convex cones of Lie algebras to the study of unitary representations of Lie supergroups. It also includes an exposition of recent results of the second author on…

表示论 · 数学 2010-12-14 Karl-Hermann Neeb , Hadi Salmasian

We propose Lie group embedded dynamical neural networks (LieEDNN) and the corresponding learning algorithms based on gradient descent and metric projection on smooth manifold, where we treat Lie group as an intrinsic representation for…

机器学习 · 计算机科学 2026-05-27 Tianwei Wang , Bryan Chen , Qian Zuo , Qiyue Xia , Xin Li , Wei Pang

Equivariance guarantees that a model's predictions capture key symmetries in data. When an image is translated or rotated, an equivariant model's representation of that image will translate or rotate accordingly. The success of…

机器学习 · 计算机科学 2024-06-19 Nate Gruver , Marc Finzi , Micah Goldblum , Andrew Gordon Wilson

In this survey, we report on the state of the art of some of the fundamental problems in the Lie theory of Lie groups modeled on locally convex spaces, such as integrability of Lie algebras, integrability of Lie subalgebras to Lie…

表示论 · 数学 2015-01-27 Karl-Hermann Neeb

In this paper, we develop a manifestly geometric framework for equivariant manifold neural ordinary differential equations (NODEs) and use it to analyse their modelling capabilities for symmetric data. First, we consider the action of a Lie…

机器学习 · 计算机科学 2024-10-11 Emma Andersdotter , Daniel Persson , Fredrik Ohlsson

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

信号处理 · 电气工程与系统科学 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

We present a simple non-generative approach to deep representation learning that seeks equivariant deep embedding through simple objectives. In contrast to existing equivariant networks, our transformation coding approach does not constrain…

机器学习 · 计算机科学 2022-02-23 Mehran Shakerinava , Arnab Kumar Mondal , Siamak Ravanbakhsh

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

数值分析 · 数学 2024-03-18 Matthias Beckmann , Nick Heilenkötter

An algebraic algorithm is developed for computation of invariants ('generalized Casimir operators') of general Lie algebras over the real or complex number field. Its main tools are the Cartan's method of moving frames and the knowledge of…

数学物理 · 物理学 2007-05-23 Vyacheslav Boyko , Jiri Patera , Roman Popovych

Equivariant neural networks incorporate symmetries through group actions, embedding them as an inductive bias to improve performance. Existing methods learn an equivariant action on the latent space, or design architectures that are…

机器学习 · 计算机科学 2026-05-19 Riccardo Ali , Pietro Liò , Jamie Vicary

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

In this paper, we develop a theory about the relationship between invariant and equivariant maps with regard to a group $G$. We then leverage this theory in the context of deep neural networks with group symmetries in order to obtain novel…

机器学习 · 计算机科学 2024-09-27 Akiyoshi Sannai , Yuuki Takai , Matthieu Cordonnier