English
Related papers

Related papers: Equivariant Spherical Transformer for Efficient Mo…

200 papers

Jet tagging techniques that make use of deep learning show great potential for improving physics analyses at colliders. One such method is the Energy Flow Network (EFN) - a recently introduced neural network architecture that represents…

High Energy Physics - Phenomenology · Physics 2021-04-29 Matthew J. Dolan , Ayodele Ore

Geometric deep learning enables the encoding of physical symmetries in modeling 3D objects. Despite rapid progress in encoding 3D symmetries into Graph Neural Networks (GNNs), a comprehensive evaluation of the expressiveness of these…

Machine Learning · Computer Science 2023-04-12 Weitao Du , Yuanqi Du , Limei Wang , Dieqiao Feng , Guifeng Wang , Shuiwang Ji , Carla Gomes , Zhi-Ming Ma

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations. They rely on…

Machine Learning · Computer Science 2023-10-30 Maksim Zhdanov , Nico Hoffmann , Gabriele Cesa

This paper presents $\mathrm{E}(n)$ Equivariant Message Passing Simplicial Networks (EMPSNs), a novel approach to learning on geometric graphs and point clouds that is equivariant to rotations, translations, and reflections. EMPSNs can…

Machine Learning · Computer Science 2023-10-24 Floor Eijkelboom , Rob Hesselink , Erik Bekkers

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equivariant CNNs for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Maurice Weiler , Gabriele Cesa

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

Graph neural networks (GNNs) have shown considerable promise in computational chemistry. However, the limited availability of molecular data raises concerns regarding GNNs' ability to effectively capture the fundamental principles of…

Machine Learning · Computer Science 2025-03-12 Junyi An , Chao Qu , Yun-Fei Shi , XinHao Liu , Qianwei Tang , Fenglei Cao , Yuan Qi

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

This paper proposes a convolution structure for learning SE(3)-equivariant features from 3D point clouds. It can be viewed as an equivariant version of kernel point convolutions (KPConv), a widely used convolution form to process point…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Minghan Zhu , Maani Ghaffari , William A. Clark , Huei Peng

Supervised learning with deep models has tremendous potential for applications in materials science. Recently, graph neural networks have been used in this context, drawing direct inspiration from models for molecules. However, materials…

Materials Science · Physics 2023-01-18 Sékou-Oumar Kaba , Siamak Ravanbakhsh

Quantum neural network architectures that have little-to-no inductive biases are known to face trainability and generalization issues. Inspired by a similar problem, recent breakthroughs in machine learning address this challenge by…

Graph neural networks excel at modeling pairwise interactions, but they cannot flexibly accommodate higher-order interactions and features. Topological deep learning (TDL) has emerged recently as a promising tool for addressing this issue.…

Machine Learning · Computer Science 2025-02-07 Claudio Battiloro , Ege Karaismailoğlu , Mauricio Tec , George Dasoulas , Michelle Audirac , Francesca Dominici

Effectively predicting molecular interactions has the potential to accelerate molecular dynamics by multiple orders of magnitude and thus revolutionize chemical simulations. Graph neural networks (GNNs) have recently shown great successes…

Computational Physics · Physics 2024-06-25 Johannes Gasteiger , Florian Becker , Stephan Günnemann

Constructing model-agnostic group equivariant networks, such as equitune (Basu et al., 2023b) and its generalizations (Kim et al., 2023), can be computationally expensive for large product groups. We address this problem by providing…

Machine Learning · Computer Science 2024-10-08 Razan Baltaji , Sourya Basu , Lav R. Varshney

We introduce an $E(n)$-equivariant Transformer architecture for spatio-temporal graph data. By imposing rotation, translation, and permutation equivariance inductive biases in both space and time, we show that the Spacetime…

Machine Learning · Computer Science 2024-08-13 Sergio G. Charles

As $SE(3)$-equivariant graph neural networks mature as a core tool for 3D atomistic modeling, improving their efficiency, expressivity, and physical consistency has become a central challenge for large-scale applications. In this work, we…

Machine Learning · Computer Science 2026-04-13 Yi-Lun Liao , Alexander J. Hoffman , Sabrina C. Shen , Alexandre Duval , Sam Walton Norwood , Tess Smidt

A wide range of techniques have been proposed in recent years for designing neural networks for 3D data that are equivariant under rotation and translation of the input. Most approaches for equivariance under the Euclidean group…

Computational Geometry · Computer Science 2022-11-30 Adrien Poulenard , Maks Ovsjanikov , Leonidas J. Guibas

No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. Continuous approaches capture rotational equivariance but are often prohibitively computationally demanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Jeremy Ocampo , Matthew A. Price , Jason D. McEwen

The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Ivan Sosnovik , Michał Szmaja , Arnold Smeulders

Equivariant quantum neural networks (QNNs) are promising variational models that exploit symmetries to improve machine learning capabilities. Despite theoretical developments in equivariant QNNs, their implementation on near-term quantum…

Quantum Physics · Physics 2026-04-20 Koki Chinzei , Quoc Hoan Tran , Yasuhiro Endo , Hirotaka Oshima