English
Related papers

Related papers: The Lie Derivative for Measuring Learned Equivaria…

200 papers

Equivariant neural networks provide a principled framework for incorporating symmetry into learning architectures and have been extensively analyzed through the lens of their separation power, that is, the ability to distinguish inputs…

Machine Learning · Computer Science 2026-02-04 Marco Pacini , Gabriele Santin , Bruno Lepri , Shubhendu Trivedi

The widespread success of convolutional neural networks may largely be attributed to their intrinsic property of translation equivariance. However, convolutions are not equivariant to variations in scale and fail to generalize to objects of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Thomas Altstidl , An Nguyen , Leo Schwinn , Franz Köferl , Christopher Mutschler , Björn Eskofier , Dario Zanca

Self-supervised learning is a powerful paradigm for representation learning on unlabelled images. A wealth of effective new methods based on instance matching rely on data-augmentation to drive learning, and these have reached a rough…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

We investigate the optimization of neural networks on symmetric data, and compare the strategy of constraining the architecture to be equivariant to that of using data augmentation. Our analysis reveals that that the relative geometry of…

Machine Learning · Computer Science 2024-10-21 Oskar Nordenfors , Fredrik Ohlsson , Axel Flinth

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

While end-to-end approaches have achieved state-of-the-art performance in many perception tasks, they are not yet able to compete with 3D geometry-based methods in pose estimation. Moreover, absolute pose regression has been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mohamed Adel Musallam , Vincent Gaudilliere , Miguel Ortiz del Castillo , Kassem Al Ismaeil , Djamila Aouada

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

Machine Learning · Statistics 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

A fundamental problem in object recognition is the development of image representations that are invariant to common transformations such as translation, rotation, and small deformations. There are multiple hypotheses regarding the source…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Eric Kauderer-Abrams

Traditional supervised learning aims to learn an unknown mapping by fitting a function to a set of input-output pairs with a fixed dimension. The fitted function is then defined on inputs of the same dimension. However, in many settings,…

Machine Learning · Computer Science 2024-05-01 Eitan Levin , Mateo Díaz

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift equivariant due to weight sharing. However, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nick McGreivy , Ammar Hakim

Equivariance to random image transformations is an effective method to learn landmarks of object categories, such as the eyes and the nose in faces, without manual supervision. However, this method does not explicitly guarantee that the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 James Thewlis , Samuel Albanie , Hakan Bilen , Andrea Vedaldi

In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations in the same image.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Diego Marcos , Michele Volpi , Benjamin Kellenberger , Devis Tuia

Equivariant neural networks (ENNs) are graph neural networks embedded in $\mathbb{R}^3$ and are well suited for predicting molecular properties. The ENN library e3nn has customizable convolutions, which can be designed to depend only on…

Machine Learning · Computer Science 2020-11-25 Benjamin Kurt Miller , Mario Geiger , Tess E. Smidt , Frank Noé

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

Deep networks provide state-of-the-art performance in multiple imaging inverse problems ranging from medical imaging to computational photography. However, most existing networks are trained with clean signals which are often hard or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dongdong Chen , Julián Tachella , Mike E. Davies

Equivariant neural networks encode the intrinsic symmetry of data as an inductive bias, which has achieved impressive performance in wide domains. However, the understanding to their expressive power remains premature. Focusing on 2-layer…

Machine Learning · Computer Science 2026-05-18 Yuzhu Chen , Tian Qin , Xinmei Tian , Fengxiang He , Dacheng Tao

In this work, we focus on using convolution neural networks (CNN) to perform object recognition on the event data. In object recognition, it is important for a neural network to be robust to the variations of the data during testing. For…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Ziyun Wang

Robustness to small image translations is a highly desirable property for object detectors. However, recent works have shown that CNN-based classifiers are not shift invariant. It is unclear to what extent this could impact object…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Marco Manfredi , Yu Wang