English
Related papers

Related papers: SE(3)-Equivariant Robot Learning and Control: A Tu…

200 papers

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

Transformation Equivariant Representations (TERs) aim to capture the intrinsic visual structures that equivary to various transformations by expanding the notion of {\em translation} equivariance underlying the success of Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Guo-Jun Qi , Liheng Zhang , Xiao Wang

Recent work has proven that training large language models with self-supervised tasks and fine-tuning these models to complete new tasks in a transfer learning setting is a powerful idea, enabling the creation of models with many…

Machine Learning · Computer Science 2024-11-25 Matthew Spellings , Maya Martirossyan , Julia Dshemuchadse

This paper proposes a convolution structure for learning SE(3)-equivariant features from 3D point clouds. It can be viewed as an equivariant version of kernel point convolutions (KPConv), a widely used convolution form to process point…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Minghan Zhu , Maani Ghaffari , William A. Clark , Huei Peng

We present a SE(3)-equivariant graph neural network (GNN) approach that directly predicting the formation factor and effective permeability from micro-CT images. FFT solvers are established to compute both the formation factor and effective…

We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such representations.…

Machine Learning · Computer Science 2018-10-30 Maurice Weiler , Mario Geiger , Max Welling , Wouter Boomsma , Taco Cohen

Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The…

Correspondence matching is a fundamental problem in computer vision and robotics applications. Solving correspondence matching problems using neural networks has been on the rise recently. Rotation-equivariance and scale-equivariance are…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Shuai Su , Zhongkai Zhao , Yixin Fei , Shuda Li , Qijun Chen , Rui Fan

Accurate rotation estimation is at the heart of robot perception tasks such as visual odometry and object pose estimation. Deep neural networks have provided a new way to perform these tasks, and the choice of rotation representation is an…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Valentin Peretroukhin , Matthew Giamou , David M. Rosen , W. Nicholas Greene , Nicholas Roy , Jonathan Kelly

Incorporating symmetry as an inductive bias into neural network architecture has led to improvements in generalization, data efficiency, and physical consistency in dynamics modeling. Methods such as CNNs or equivariant neural networks use…

Machine Learning · Computer Science 2022-06-17 Rui Wang , Robin Walters , Rose Yu

In recent years, neural implicit representations have made remarkable progress in modeling of 3D shapes with arbitrary topology. In this work, we address two key limitations of such representations, in failing to capture local 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yunlu Chen , Basura Fernando , Hakan Bilen , Matthias Nießner , Efstratios Gavves

Equivariant machine learning methods have shown wide success at 3D learning applications in recent years. These models explicitly build in the reflection, translation and rotation symmetries of Euclidean space and have facilitated large…

Machine Learning · Computer Science 2022-10-11 Joshua A. Rackers , Pranav Rao

Conventional machine learning algorithms have traditionally been designed under the assumption that input data follows a vector-based format, with an emphasis on vector-centric paradigms. However, as the demand for tasks involving set-based…

Machine Learning · Computer Science 2024-04-01 Masanari Kimura , Ryotaro Shimizu , Yuki Hirakawa , Ryosuke Goto , Yuki Saito

Equivariant neural networks have been widely used in a variety of applications due to their ability to generalize well in tasks where the underlying data symmetries are known. Despite their successes, such networks can be difficult to…

Machine Learning · Computer Science 2025-01-06 Stefanos Pertigkiozoglou , Evangelos Chatzipantazis , Shubhendu Trivedi , Kostas Daniilidis

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this…

Machine Learning · Computer Science 2025-07-28 Mohd Halim Mohd Noor , Ayokunle Olalekan Ige

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases…

Machine Learning · Computer Science 2021-11-23 Luca Della Libera , Vladimir Golkov , Yue Zhu , Arman Mielke , Daniel Cremers

Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing…

Machine Learning · Computer Science 2022-11-15 Tycho F. A. van der Ouderaa , David W. Romero , Mark van der Wilk

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric…

Machine Learning · Computer Science 2023-07-18 Linfeng Zhao , Owen Howell , Jung Yeon Park , Xupeng Zhu , Robin Walters , Lawson L. S. Wong

Convolutional Neural Networks(CNN) are inherently equivariant under translations, however, they do not have an equivalent embedded mechanism to handle other transformations such as rotations and change in scale. Several approaches exist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Naman Khetan , Tushar Arora , Samee Ur Rehman , Deepak K. Gupta

Graph Neural Networks (GNNs) have become a prevailing tool for learning physical dynamics. However, they still encounter several challenges: 1) Physical laws abide by symmetry, which is a vital inductive bias accounting for model…

Machine Learning · Computer Science 2022-10-14 Jiaqi Han , Wenbing Huang , Hengbo Ma , Jiachen Li , Joshua B. Tenenbaum , Chuang Gan