English
Related papers

Related papers: SE(3)-Equivariant Robot Learning and Control: A Tu…

200 papers

Over the past few years, deep learning has risen to the foreground as a topic of massive interest, mainly as a result of successes obtained in solving large-scale image processing tasks. There are multiple challenging mathematical problems…

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

Leveraging the symmetries inherent to specific data domains for the construction of equivariant neural networks has lead to remarkable improvements in terms of data efficiency and generalization. However, most existing research focuses on…

Machine Learning · Computer Science 2024-01-23 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training. Learning only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Dongdong Chen , Julián Tachella , Mike E. Davies

Equivariance encodes known symmetries into neural networks, often enhancing generalization. However, equivariant networks cannot break symmetries: the output of an equivariant network must, by definition, have at least the same…

Machine Learning · Computer Science 2025-03-31 Hannah Lawrence , Vasco Portilheiro , Yan Zhang , Sékou-Oumar Kaba

We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of…

Machine Learning · Computer Science 2022-11-18 Lek-Heng Lim , Bradley J. Nelson

In Reinforcement Learning (RL), Convolutional Neural Networks(CNNs) have been successfully applied as function approximators in Deep Q-Learning algorithms, which seek to learn action-value functions and policies in various environments.…

Machine Learning · Computer Science 2020-07-08 Arnab Kumar Mondal , Pratheeksha Nair , Kaleem Siddiqi

Incorporating permutation equivariance into neural networks has proven to be useful in ensuring that models respect symmetries that exist in data. Symmetric tensors, which naturally appear in statistics, machine learning, and graph theory,…

Machine Learning · Computer Science 2025-05-26 Edward Pearce-Crump

Symmetries and equivariance are fundamental to the generalization of neural networks on domains such as images, graphs, and point clouds. Existing work has primarily focused on a small number of groups, such as the translation, rotation,…

Machine Learning · Computer Science 2021-04-20 Marc Finzi , Max Welling , Andrew Gordon Wilson

Embodied systems experience the world as 'a symphony of flows': a combination of many continuous streams of sensory input coupled to self-motion, interwoven with the dynamics of external objects. These streams obey smooth,…

Machine Learning · Computer Science 2026-01-06 Hansen Jin Lillemark , Benhao Huang , Fangneng Zhan , Yilun Du , Thomas Anderson Keller

Popular representation learning methods encourage feature invariance under transformations applied at the input. However, in 3D perception tasks like object localization and segmentation, outputs are naturally equivariant to some…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

Geometric regularity, which leverages data symmetry, has been successfully incorporated into deep learning architectures such as CNNs, RNNs, GNNs, and Transformers. While this concept has been widely applied in robotics to address the curse…

Robotics · Computer Science 2024-03-19 Shengchao Yan , Baohe Zhang , Yuan Zhang , Joschka Boedecker , Wolfram Burgard

Representations learnt through deep neural networks tend to be highly informative, but opaque in terms of what information they learn to encode. We introduce an approach to probabilistic modelling that learns to represent data with two…

Machine Learning · Statistics 2019-05-21 Ilya Feige

Self-supervised visual representation methods are closing the gap with supervised learning performance. These methods rely on maximizing the similarity between embeddings of related synthetic inputs created through data augmentations. This…

Machine Learning · Computer Science 2023-06-09 Alexandre Devillers , Mathieu Lefort

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

The last decade witnessed increasingly rapid progress in self-driving vehicle technology, mainly backed up by advances in the area of deep learning and artificial intelligence. The objective of this paper is to survey the current…

Machine Learning · Computer Science 2020-03-26 Sorin Grigorescu , Bogdan Trasnea , Tiberiu Cocias , Gigel Macesanu

Equivariant networks have been adopted in many 3-D learning areas. Here we identify a fundamental limitation of these networks: their ambiguity to symmetries. Equivariant networks cannot complete symmetry-dependent tasks like segmenting a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Sidhika Balachandar , Adrien Poulenard , Congyue Deng , Leonidas Guibas

Deep learning has allowed a paradigm shift in pattern recognition, from using hand-crafted features together with statistical classifiers to using general-purpose learning procedures for learning data-driven representations, features, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Javier Ruiz-del-Solar , Patricio Loncomilla , Naiomi Soto

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

Robotic manipulation in unstructured environments requires the generation of robust and long-horizon trajectory-level policy with conditions of perceptual observations and benefits from the advantages of SE(3)-equivariant diffusion models…

Robotics · Computer Science 2025-09-30 Zhitao Wang , Yanke Wang , Jiangtao Wen , Roberto Horowitz , Yuxing Han