English
Related papers

Related papers: Symmetry From Scratch: Group Equivariance as a Sup…

200 papers

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

The requirement of generating predictions that exactly fulfill the fundamental symmetry of the corresponding physical quantities has profoundly shaped the development of machine-learning models for physical simulations. In many cases,…

Machine Learning · Computer Science 2026-03-27 Michelangelo Domina , Joseph William Abbott , Paolo Pegolo , Filippo Bigi , Michele Ceriotti

Equivariant deep learning architectures exploit symmetries in learning problems to improve the sample efficiency of neural-network-based models and their ability to generalise. However, when modelling real-world data, learning problems are…

Machine Learning · Statistics 2024-11-12 Matthew Ashman , Cristiana Diaconu , Adrian Weller , Wessel Bruinsma , Richard E. Turner

Group equivariance has emerged as a valuable inductive bias in deep learning, enhancing generalization, data efficiency, and robustness. Classically, group equivariant methods require the groups of interest to be known beforehand, which may…

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is…

Machine Learning · Computer Science 2023-02-01 Artem Moskalev , Anna Sepliarskaia , Ivan Sosnovik , Arnold Smeulders

Incorporating geometric invariance into neural networks enhances parameter efficiency but typically increases computational costs. This paper introduces new equivariant neural networks that preserve symmetry while maintaining a comparable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Georg Bökman , David Nordström , Fredrik Kahl

Symmetry is a fundamental aspect of many real-world robotic tasks. However, current deep reinforcement learning (DRL) approaches can seldom harness and exploit symmetry effectively. Often, the learned behaviors fail to achieve the desired…

Robotics · Computer Science 2024-03-08 Mayank Mittal , Nikita Rudin , Victor Klemm , Arthur Allshire , Marco Hutter

Machine learning, deep learning, has been accelerating computational physics, which has been used to simulate systems on a lattice. Equivariance is essential to simulate a physical system because it imposes a strong induction bias for the…

High Energy Physics - Lattice · Physics 2023-10-23 Akio Tomiya , Yuki Nagai

The dictionary learning problem concerns the task of representing data as sparse linear sums drawn from a smaller collection of basic building blocks. In application domains where such techniques are deployed, we frequently encounter…

Signal Processing · Electrical Eng. & Systems 2021-07-21 Yong Sheng Soh

Reinforcement learning (RL) algorithms for continuous control tasks require accurate sampling-based action selection. Many tasks, such as robotic manipulation, contain inherent problem symmetries. However, correctly incorporating symmetry…

Robotics · Computer Science 2024-12-18 Linfeng Zhao , Owen Howell , Xupeng Zhu , Jung Yeon Park , Zhewen Zhang , Robin Walters , Lawson L. S. Wong

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

Statistics Theory · Mathematics 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path…

Machine Learning · Computer Science 2023-05-02 Linfeng Zhao , Xupeng Zhu , Lingzhi Kong , Robin Walters , Lawson L. S. Wong

We approach the well-studied problem of supervised group invariant and equivariant machine learning from the point of view of geometric topology. We propose a novel approach using a pre-processing step, which involves projecting the input…

Machine Learning · Computer Science 2022-02-07 Benjamin Aslan , Daniel Platt , David Sheard

Correctly capturing the symmetry transformations of data can lead to efficient models with strong generalization capabilities, though methods incorporating symmetries often require prior knowledge. While recent advancements have been made…

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric…

Machine Learning · Computer Science 2023-07-18 Linfeng Zhao , Owen Howell , Jung Yeon Park , Xupeng Zhu , Robin Walters , Lawson L. S. Wong

Quantum Machine Learning (QML) models are aimed at learning from data encoded in quantum states. Recently, it has been shown that models with little to no inductive biases (i.e., with no assumptions about the problem embedded in the model)…

Symmetry is a fundamental tool in the exploration of a broad range of complex systems. In machine learning symmetry has been explored in both models and data. In this paper we seek to connect the symmetries arising from the architecture of…

Machine Learning · Computer Science 2023-03-27 Charles Godfrey , Davis Brown , Tegan Emerson , Henry Kvinge

Incorporating equivariance as an inductive bias into deep learning architectures to take advantage of the data symmetry has been successful in multiple applications, such as chemistry and dynamical systems. In particular, roto-translations…

Machine Learning · Computer Science 2026-01-06 Ahmed A. Elhag , T. Konstantin Rusch , Francesco Di Giovanni , Michael Bronstein