English
Related papers

Related papers: Equivariant Manifold Neural ODEs and Differential …

200 papers

We study the problem of learning equivariant neural networks via gradient descent. The incorporation of known symmetries ("equivariance") into neural nets has empirically improved the performance of learning pipelines, in domains ranging…

Machine Learning · Computer Science 2024-01-04 Bobak T. Kiani , Thien Le , Hannah Lawrence , Stefanie Jegelka , Melanie Weber

The rising adoption of machine learning in high energy physics and lattice field theory necessitates the re-evaluation of common methods that are widely used in computer vision, which, when applied to problems in physics, can lead to…

High Energy Physics - Lattice · Physics 2021-10-12 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Equivariant network architectures are a well-established tool for predicting invariant or equivariant quantities. However, almost all learning problems considered in this context feature a global symmetry, i.e. each point of the underlying…

Machine Learning · Computer Science 2025-02-24 Longde Huang , Oleksandr Balabanov , Hampus Linander , Mats Granath , Daniel Persson , Jan E. Gerken

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

Machine Learning · Computer Science 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

We propose a hybrid physics-informed machine learning framework to approximate invariant manifolds (IMs) of discrete-time dynamical systems driven by exogenous autonomous dynamics (exosystems). Such systems appear in applications ranging…

Gauge symmetries play a key role in physics appearing in areas such as quantum field theories of the fundamental particles and emergent degrees of freedom in quantum materials. Motivated by the desire to efficiently simulate many-body…

Strongly Correlated Electrons · Physics 2022-05-13 Di Luo , Giuseppe Carleo , Bryan K. Clark , James Stokes

Geometric and Topological Deep Learning are rapidly growing research areas that enhance machine learning through the use of geometric and topological structures. Within this framework, Group Equivariant Non-Expansive Operators (GENEOs) have…

Representation Theory · Mathematics 2026-01-14 Francesco Conti , Patrizio Frosini , Nicola Quercioli

Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Georg Bökman , Axel Flinth , Fredrik Kahl

Equivariance guarantees that a model's predictions capture key symmetries in data. When an image is translated or rotated, an equivariant model's representation of that image will translate or rotate accordingly. The success of…

Machine Learning · Computer Science 2024-06-19 Nate Gruver , Marc Finzi , Micah Goldblum , Andrew Gordon Wilson

Symmetry-aware architectures are central to geometric deep learning. We present a systematic approach for constructing continuous rotationally invariant and equivariant functions using symmetric tensor networks. The proposed framework…

Machine Learning · Computer Science 2026-02-03 Meng Zhang , Chao Wang , Hao Zhang , Shaojun Dong , Lixin He

We develop an elementary method to compute spaces of equivariant maps from a homogeneous space $G/H$ of a Lie group $G$ to a module of this group. The Lie group is not required to be compact. More generally, we study spaces of invariant…

Representation Theory · Mathematics 2024-04-16 Vincent Knibbeler

It is shown that the correct mathematical implementation of symmetry in the geometric formulation of classical field theory leads naturally beyond the concept of Lie groups and their actions on manifolds, out into the realm of Lie group…

Mathematical Physics · Physics 2014-12-12 Michael Forger , Bruno L. Soares

Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digital images and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Zhengyang Shen , Lingshen He , Zhouchen Lin , Jinwen Ma

Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is…

Machine Learning · Computer Science 2023-02-01 Artem Moskalev , Anna Sepliarskaia , Ivan Sosnovik , Arnold Smeulders

Non-Euclidean constraints are inherent in many kinds of data in computer vision and machine learning, typically as a result of specific invariance requirements that need to be respected during high-level inference. Often, these geometric…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Suhas Lohit , Pavan Turaga

Incorporating equivariance to symmetry groups as a constraint during neural network training can improve performance and generalization for tasks exhibiting those symmetries, but such symmetries are often not perfectly nor explicitly…

Machine Learning · Computer Science 2023-02-09 Kaitlin Maile , Dennis G. Wilson , Patrick Forré

Equivariance w.r.t. geometric transformations in neural networks improves data efficiency, parameter efficiency and robustness to out-of-domain perspective shifts. When equivariance is not designed into a neural network, the network can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Robert-Jan Bruintjes , Tomasz Motyka , Jan van Gemert

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

Fix a finite group $G$. We seek to classify varieties with $G$-action equivariantly birational to a representation of $G$ on affine or projective space. Our focus is odd-dimensional smooth complete intersections of two quadrics, relating…

Algebraic Geometry · Mathematics 2022-02-02 Brendan Hassett , Yuri Tschinkel