English
Related papers

Related papers: SE(3)-Equivariant Robot Learning and Control: A Tu…

200 papers

Spherical equivariant graph neural networks (EGNNs) provide a principled framework for learning on three-dimensional molecular and biomolecular systems, where predictions must respect the rotational symmetries inherent in physics. These…

Machine Learning · Computer Science 2025-12-17 Sophia Tang

This paper proposes a method to construct pretext tasks for self-supervised learning on group equivariant neural networks. Group equivariant neural networks are the models whose structure is restricted to commute with the transformations on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Yusuke Mukuta , Tatsuya Harada

Transformer architectures can effectively learn language-conditioned, multi-task 3D open-loop manipulation policies from demonstrations by jointly processing natural language instructions and 3D observations. However, although both the…

Robotics · Computer Science 2025-05-28 Xupeng Zhu , Yu Qi , Yizhe Zhu , Robin Walters , Robert Platt

Visual imitation learning with 3D point clouds has advanced robotic manipulation by providing geometry-aware, appearance-invariant observations. However, point cloud-based policies remain highly sensitive to sensor noise, pose…

Robotics · Computer Science 2026-01-27 Zhiyuan Zhang , Yu She

Recent work has shown deep learning can accelerate the prediction of physical dynamics relative to numerical solvers. However, limited physical accuracy and an inability to generalize under distributional shift limit its applicability to…

Machine Learning · Computer Science 2021-03-17 Rui Wang , Robin Walters , Rose Yu

Equivariant neural networks provide a principled framework for incorporating symmetry into learning architectures and have been extensively analyzed through the lens of their separation power, that is, the ability to distinguish inputs…

Machine Learning · Computer Science 2026-02-04 Marco Pacini , Gabriele Santin , Bruno Lepri , Shubhendu Trivedi

Equivariant neural networks, whose hidden features transform according to representations of a group G acting on the data, exhibit training efficiency and an improved generalisation performance. In this work, we extend group invariant and…

Machine Learning · Computer Science 2024-04-15 Robin Winter , Marco Bertolini , Tuan Le , Frank Noé , Djork-Arné Clevert

Using symmetry as an inductive bias in deep learning has been proven to be a principled approach for sample-efficient model design. However, the relationship between symmetry and the imperative for equivariance in neural networks is not…

Machine Learning · Computer Science 2024-03-25 Sékou-Oumar Kaba , Siamak Ravanbakhsh

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Equivariant neural networks incorporate symmetries into their architecture, achieving higher generalization performance. However, constructing equivariant neural networks typically requires prior knowledge of data types and symmetries,…

Machine Learning · Computer Science 2024-10-15 Lexiang Hu , Yikang Li , Zhouchen Lin

Incorporating equivariance as an inductive bias into deep learning architectures to take advantage of the data symmetry has been successful in multiple applications, such as chemistry and dynamical systems. In particular, roto-translations…

Machine Learning · Computer Science 2026-01-06 Ahmed A. Elhag , T. Konstantin Rusch , Francesco Di Giovanni , Michael Bronstein

Despite the successes of deep learning in computer vision, difficulties persist in recognizing objects that have undergone group-symmetric transformations rarely seen during training$\unicode{x2013}$for example objects seen in unusual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Minh Dinh , Stéphane Deny

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Thijs P. Kuipers , Erik J. Bekkers

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Kai Sheng Tai , Peter Bailis , Gregory Valiant

We survey the mathematical foundations of geometric deep learning, focusing on group equivariant and gauge equivariant neural networks. We develop gauge equivariant convolutional neural networks on arbitrary manifolds $\mathcal{M}$ using…

Representation learning has become increasingly important, especially as powerful models have shifted towards learning latent representations before fine-tuning for downstream tasks. This approach is particularly valuable in leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shizhe He , Magdalini Paschali , Jiahong Ouyang , Adnan Masood , Akshay Chaudhari , Ehsan Adeli

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Maxime W. Lafarge , Erik J. Bekkers , Josien P. W. Pluim , Remco Duits , Mitko Veta

Recently, equivariant neural network models have been shown to improve sample efficiency for tasks in computer vision and reinforcement learning. This paper explores this idea in the context of on-robot policy learning in which a policy…

Robotics · Computer Science 2022-10-19 Dian Wang , Mingxi Jia , Xupeng Zhu , Robin Walters , Robert Platt

Equivariant deep learning architectures exploit symmetries in learning problems to improve the sample efficiency of neural-network-based models and their ability to generalise. However, when modelling real-world data, learning problems are…

Machine Learning · Statistics 2024-11-12 Matthew Ashman , Cristiana Diaconu , Adrian Weller , Wessel Bruinsma , Richard E. Turner

Invariance and equivariance to the rotation group have been widely discussed in the 3D deep learning community for pointclouds. Yet most proposed methods either use complex mathematical tools that may limit their accessibility, or are tied…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Congyue Deng , Or Litany , Yueqi Duan , Adrien Poulenard , Andrea Tagliasacchi , Leonidas Guibas