English
Related papers

Related papers: Group Equivariant Capsule Networks

200 papers

'Capsule' models try to explicitly represent the poses of objects, enforcing a linear relationship between an object's pose and that of its constituent parts. This modelling assumption should lead to robustness to viewpoint changes since…

Machine Learning · Computer Science 2021-01-07 Lewis Smith , Lisa Schut , Yarin Gal , Mark van der Wilk

In this paper we present a framework for the design and implementation of offset equivariant networks, that is, neural networks that preserve in their output uniform increments in the input. In a suitable color space this kind of networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Marco Cotogni , Claudio Cusano

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

We introduce the usage of equivariant neural networks in the search for violations of the charge-parity ($\textit{CP}$) symmetry in particle interactions at the CERN Large Hadron Collider. We design neural networks that take as inputs…

High Energy Physics - Phenomenology · Physics 2024-11-27 Sergio Sánchez Cruz , Marina Kolosova , Clara Ramón Álvarez , Giovanni Petrucciani , Pietro Vischia

Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Prem Nair , Rohan Doshi , Stefan Keselj

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ancheng Lin , Jun Li , Zhenyuan Ma

Invariance has recently proven to be a powerful inductive bias in machine learning models. One such class of predictive or generative models are tensor networks. We introduce a new numerical algorithm to construct a basis of tensors that…

Machine Learning · Computer Science 2024-07-02 Brent Sprangers , Nick Vannieuwenhoven

Capsule networks (CapsNets) were introduced to address convolutional neural networks limitations, learning object-centric representations that are more robust, pose-aware, and interpretable. They organize neurons into groups called…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Riccardo Renzulli

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant $G$-CNNs on homogeneous spaces characterized the representation theory of such…

Machine Learning · Computer Science 2025-04-30 Elias Nyholm , Oscar Carlsson , Maurice Weiler , Daniel Persson

In capsule networks, the routing algorithm connects capsules in consecutive layers, enabling the upper-level capsules to learn higher-level concepts by combining the concepts of the lower-level capsules. Capsule networks are known to have a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Inyoung Paik , Taeyeong Kwak , Injung Kim

We present a neural network architecture that is fully equivariant with respect to transformations under the Lorentz group, a fundamental symmetry of space and time in physics. The architecture is based on the theory of the…

High Energy Physics - Phenomenology · Physics 2020-06-09 Alexander Bogatskiy , Brandon Anderson , Jan T. Offermann , Marwah Roussi , David W. Miller , Risi Kondor

We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of…

Machine Learning · Computer Science 2022-11-18 Lek-Heng Lim , Bradley J. Nelson

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

Machine Learning · Statistics 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

The crucial role played by the underlying symmetries of high energy physics and lattice field theories calls for the implementation of such symmetries in the neural network architectures that are applied to the physical system under…

High Energy Physics - Lattice · Physics 2022-02-16 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Based on the theory of homogeneous spaces we derive geometrically optimal edge attributes to be used within the flexible message-passing framework. We formalize the notion of weight sharing in convolutional networks as the sharing of…

Machine Learning · Computer Science 2024-03-18 Erik J Bekkers , Sharvaree Vadgama , Rob D Hesselink , Putri A van der Linden , David W Romero

Despite the successes of deep learning in computer vision, difficulties persist in recognizing objects that have undergone group-symmetric transformations rarely seen during training$\unicode{x2013}$for example objects seen in unusual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Minh Dinh , Stéphane Deny