English
Related papers

Related papers: Equivariant Deep Dynamical Model for Motion Predic…

200 papers

This work introduces a diffusion model for molecule generation in 3D that is equivariant to Euclidean transformations. Our E(3) Equivariant Diffusion Model (EDM) learns to denoise a diffusion process with an equivariant network that jointly…

Machine Learning · Computer Science 2022-06-17 Emiel Hoogeboom , Victor Garcia Satorras , Clément Vignac , Max Welling

Object recognition and motion understanding are key components of perception that complement each other. While self-supervised learning methods have shown promise in their ability to learn from unlabeled data, they have primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Christopher Hoang , Mengye Ren

Establishing correspondences between 3D shapes is a fundamental task in 3D Computer Vision, typically addressed by matching local descriptors. Recently, a few attempts at applying the deep learning paradigm to the task have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Riccardo Spezialetti , Samuele Salti , Luigi Di Stefano

We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such representations.…

Machine Learning · Computer Science 2018-10-30 Maurice Weiler , Mario Geiger , Max Welling , Wouter Boomsma , Taco Cohen

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by…

Dynamical Systems · Mathematics 2025-05-27 Hans Harder , Feliks Nüske , Friedrich M. Philipp , Manuel Schaller , Karl Worthmann , Sebastian Peitz

Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only…

Machine Learning · Computer Science 2021-03-31 Allan Zhou , Tom Knowles , Chelsea Finn

Generative models capture the true distribution of data, yielding semantically rich representations. Denoising diffusion models (DDMs) exhibit superior generative capabilities, though efficient representation learning for them are lacking.…

Machine Learning · Computer Science 2025-05-12 Limai Jiang , Yunpeng Cai

Non-Euclidean data is frequently encountered across different fields, yet there is limited literature that addresses the fundamental challenge of training neural networks with manifold representations as outputs. We introduce the trick…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tongtong Zhang , Xian Wei , Yuanxiang Li

When interacting in a three dimensional world, humans must estimate 3D structure from visual inputs projected down to two dimensional retinal images. It has been shown that humans use the persistence of object shape over motion-induced…

Neurons and Cognition · Quantitative Biology 2023-04-03 Marissa Connor , Bruno Olshausen , Christopher Rozell

Predicting quantum operator matrices such as Hamiltonian, overlap, and density matrices in the density functional theory (DFT) framework is crucial for material science. Current methods often focus on individual operators and struggle with…

Materials Science · Physics 2025-03-12 Zhanghao Zhouyin , Zixi Gan , MingKang Liu , Shishir Kumar Pandey , Linfeng Zhang , Qiangqiang Gu

3D Human Motion Indexing and Retrieval is an interesting problem due to the rise of several data-driven applications aimed at analyzing and/or re-utilizing 3D human skeletal data, such as data-driven animation, analysis of sports…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Neeraj Battan , Abbhinav Venkat , Avinash Sharma

Symmetry-aware architectures are central to geometric deep learning. We present a systematic approach for constructing continuous rotationally invariant and equivariant functions using symmetric tensor networks. The proposed framework…

Machine Learning · Computer Science 2026-02-03 Meng Zhang , Chao Wang , Hao Zhang , Shaojun Dong , Lixin He

With deep learning gaining attention from the research community for prediction and control of real physical systems, learning important representations is becoming now more than ever mandatory. It is of extreme importance that deep…

Machine Learning · Computer Science 2022-04-13 Saul Santos , Monica Ekal , Rodrigo Ventura

Popular representation learning methods encourage feature invariance under transformations applied at the input. However, in 3D perception tasks like object localization and segmentation, outputs are naturally equivariant to some…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

In recent years, neural implicit representations have made remarkable progress in modeling of 3D shapes with arbitrary topology. In this work, we address two key limitations of such representations, in failing to capture local 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yunlu Chen , Basura Fernando , Hakan Bilen , Matthias Nießner , Efstratios Gavves

Embedding of large but redundant data, such as images or text, in a hierarchy of lower-dimensional spaces is one of the key features of representation learning approaches, which nowadays provide state-of-the-art solutions to problems once…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Gianluca Berardi , Luca De Luigi , Samuele Salti , Luigi Di Stefano

Geometric deep learning refers to the scenario in which the symmetries of a dataset are used to constrain the parameter space of a neural network and thus, improve their trainability and generalization. Recently this idea has been…

Quantum Physics · Physics 2024-11-19 Sreetama Das , Stefano Martina , Filippo Caruso

Categorical deep learning (CDL) has recently emerged as a framework that leverages category theory to unify diverse neural architectures. While geometric deep learning (GDL) is grounded in the specific context of invariants of group…

Machine Learning · Computer Science 2026-03-04 Dragan Mašulović

Multi-objective optimization problems are ubiquitous in robotics, e.g., the optimization of a robot manipulation task requires a joint consideration of grasp pose configurations, collisions and joint limits. While some demands can be easily…

Robotics · Computer Science 2023-06-21 Julen Urain , Niklas Funk , Jan Peters , Georgia Chalvatzaki