English
Related papers

Related papers: Vector Neurons: A General Framework for SO(3)-Equi…

200 papers

Digital neuron reconstruction from 3D microscopy images is an essential technique for investigating brain connectomics and neuron morphology. Existing reconstruction frameworks use convolution-based segmentation networks to partition the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Runkai Zhao , Heng Wang , Chaoyi Zhang , Weidong Cai

The principle of translation equivariance (if an input image is translated an output image should be translated by the same amount), led to the development of convolutional neural networks that revolutionized machine vision. Other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zachary Schlamowitz , Andrew Bennecke , Daniel J. Tward

Quantum neural network architectures that have little-to-no inductive biases are known to face trainability and generalization issues. Inspired by a similar problem, recent breakthroughs in machine learning address this challenge by…

Recent progresses in 3D deep learning has shown that it is possible to design special convolution operators to consume point cloud data. However, a typical drawback is that rotation invariance is often not guaranteed, resulting in networks…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Zhiyuan Zhang , Binh-Son Hua , David W. Rosen , Sai-Kit Yeung

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Representation learning has become increasingly important, especially as powerful models have shifted towards learning latent representations before fine-tuning for downstream tasks. This approach is particularly valuable in leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shizhe He , Magdalini Paschali , Jiahong Ouyang , Adnan Masood , Akshay Chaudhari , Ehsan Adeli

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such representations.…

Machine Learning · Computer Science 2018-10-30 Maurice Weiler , Mario Geiger , Max Welling , Wouter Boomsma , Taco Cohen

We propose a method for 3D shape reconstruction from unoriented point clouds. Our method consists of a novel SE(3)-equivariant coordinate-based network (TF-ONet), that parametrizes the occupancy field of the shape and respects the inherent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Evangelos Chatzipantazis , Stefanos Pertigkiozoglou , Edgar Dobriban , Kostas Daniilidis

Equivariant networks have been adopted in many 3-D learning areas. Here we identify a fundamental limitation of these networks: their ambiguity to symmetries. Equivariant networks cannot complete symmetry-dependent tasks like segmenting a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Sidhika Balachandar , Adrien Poulenard , Congyue Deng , Leonidas Guibas

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

This paper develops a rotation-invariant needlet convolution for rotation group SO(3) to distill multiscale information of spherical signals. The spherical needlet transform is generalized from $\mathbb{S}^2$ onto the SO(3) group, which…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Kai Yi , Jialin Chen , Yu Guang Wang , Bingxin Zhou , Pietro Liò , Yanan Fan , Jan Hamann

This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant $G$-CNNs on homogeneous spaces characterized the representation theory of such…

Machine Learning · Computer Science 2025-04-30 Elias Nyholm , Oscar Carlsson , Maurice Weiler , Daniel Persson

Convolutional neural networks have been highly successful in image-based learning tasks due to their translation equivariance property. Recent work has generalized the traditional convolutional layer of a convolutional neural network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Monami Banerjee , Rudrasis Chakraborty , Jose Bouza , Baba C. Vemuri

In this paper, we utilize hyperspheres and regular $n$-simplexes and propose an approach to learning deep features equivariant under the transformations of $n$D reflections and rotations, encompassed by the powerful group of O$(n)$. Namely,…

Machine Learning · Computer Science 2024-05-31 Pavlo Melnyk , Michael Felsberg , Mårten Wadenbäck , Andreas Robinson , Cuong Le

Equivariance to permutations and rigid motions is an important inductive bias for various 3D learning problems. Recently it has been shown that the equivariant Tensor Field Network architecture is universal -- it can approximate any…

Machine Learning · Computer Science 2022-05-30 Ben Finkelshtein , Chaim Baskin , Haggai Maron , Nadav Dym

Recent attempts at introducing rotation invariance or equivariance in 3D deep learning approaches have shown promising results, but these methods still struggle to reach the performances of standard 3D neural networks. In this work we study…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hugues Thomas

Convolutional networks are successful, but they have recently been outperformed by new neural networks that are equivariant under rotations and translations. These new networks work better because they do not struggle with learning each…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Philip Müller , Vladimir Golkov , Valentina Tomassini , Daniel Cremers

We propose a neural network for 3D point cloud processing that exploits `spherical' convolution kernels and octree partitioning of space. The proposed metric-based spherical kernels systematically quantize point neighborhoods to identify…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Huan Lei , Naveed Akhtar , Ajmal Mian

Point cloud registration is a foundational task for 3D alignment and reconstruction applications. While both traditional and learning-based registration approaches have succeeded, leveraging the intrinsic symmetry of point cloud data,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xueyang Kang , Zhaoliang Luan , Kourosh Khoshelham , Bing Wang