English
Related papers

Related papers: Equivariant Filters are Equivariant

200 papers

Geometric quantum machine learning uses the symmetries inherent in data to design tailored machine learning tasks with reduced search space dimension. The field has been well-studied recently in an effort to avoid barren plateau issues…

Quantum Physics · Physics 2025-07-14 Zachary P. Bradshaw , Ethan N. Evans , Matthew Cook , Margarite L. LaBorde

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

Equivariant neural networks incorporate symmetries into their architecture, achieving higher generalization performance. However, constructing equivariant neural networks typically requires prior knowledge of data types and symmetries,…

Machine Learning · Computer Science 2024-10-15 Lexiang Hu , Yikang Li , Zhouchen Lin

Equivariance is a powerful inductive bias in neural networks, improving generalisation and physical consistency. Recently, however, non-equivariant models have regained attention, due to their better runtime performance and imperfect…

Machine Learning · Computer Science 2026-05-27 Torben Berndt , Jan Stühmer

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

Incorporating geometric invariance into neural networks enhances parameter efficiency but typically increases computational costs. This paper introduces new equivariant neural networks that preserve symmetry while maintaining a comparable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Georg Bökman , David Nordström , Fredrik Kahl

Visual Inertial Odometry (VIO) is of great interest due the ubiquity of devices equipped with both a monocular camera and Inertial Measurement Unit (IMU). Methods based on the extended Kalman Filter remain popular in VIO due to their low…

Robotics · Computer Science 2021-04-09 Pieter van Goor , Robert Mahony

In this paper we present a framework for the design and implementation of offset equivariant networks, that is, neural networks that preserve in their output uniform increments in the input. In a suitable color space this kind of networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Marco Cotogni , Claudio Cusano

While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and flexibility that make Transformers so effective through…

We investigate the optimization of neural networks on symmetric data, and compare the strategy of constraining the architecture to be equivariant to that of using data augmentation. Our analysis reveals that that the relative geometry of…

Machine Learning · Computer Science 2024-10-21 Oskar Nordenfors , Fredrik Ohlsson , Axel Flinth

We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Daniel Moyer , Esra Abaci Turk , P Ellen Grant , William M. Wells , Polina Golland

Localization in indoor environments is a technique which estimates the robot's pose by fusing data from onboard motion sensors with readings of the environment, in our case obtained by scan matching point clouds captured by a low-cost…

Systems and Control · Computer Science 2015-03-05 Martin Barczyk , Silvère Bonnabel , Jean-Emmanuel Deschaud , François Goulette

Recent advances in deep learning and Transformers have driven major breakthroughs in robotics by employing techniques such as imitation learning, reinforcement learning, and LLM-based multimodal perception and decision-making. However,…

Despite the successes of deep learning in computer vision, difficulties persist in recognizing objects that have undergone group-symmetric transformations rarely seen during training$\unicode{x2013}$for example objects seen in unusual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Minh Dinh , Stéphane Deny

Atmospheric wavefront prediction based on previous wavefront sensor measurements can greatly enhance the performance of adaptive optics systems. We propose an optimal linear approach based on the Empirical Orthogonal Functions (EOF)…

Instrumentation and Methods for Astrophysics · Physics 2017-07-04 Olivier Guyon , Jared Males

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a differential…

Machine Learning · Computer Science 2022-01-17 Victor Garcia Satorras , Emiel Hoogeboom , Fabian B. Fuchs , Ingmar Posner , Max Welling

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric…

Machine Learning · Computer Science 2023-07-18 Linfeng Zhao , Owen Howell , Jung Yeon Park , Xupeng Zhu , Robin Walters , Lawson L. S. Wong

In this paper, we first review the theory of symmetry-preserving observers and we mention some recent results. Then, we apply the theory to Extended Kalman Filter-based Simultaneous Localization and Mapping (EKF SLAM). It allows to derive a…

Optimization and Control · Mathematics 2011-05-12 Silvere Bonnabel

The rising adoption of machine learning in high energy physics and lattice field theory necessitates the re-evaluation of common methods that are widely used in computer vision, which, when applied to problems in physics, can lead to…

High Energy Physics - Lattice · Physics 2021-10-12 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh