English
Related papers

Related papers: Building Deep, Equivariant Capsule Networks

200 papers

A recently proposed method in deep learning groups multiple neurons to capsules such that each capsule represents an object or part of an object. Routing algorithms route the output of capsules from lower-level layers to upper-level layers.…

Machine Learning · Computer Science 2021-01-20 David Peer , Sebastian Stabinger , Antonio Rodriguez-Sanchez

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo

Capsule networks are a recently developed class of neural networks that potentially address some of the deficiencies with traditional convolutional neural networks. By replacing the standard scalar activations with vectors, and by…

Machine Learning · Computer Science 2020-01-30 Arjun Punjabi , Jonas Schmid , Aggelos K. Katsaggelos

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Liheng Zhang , Marzieh Edraki , Guo-Jun Qi

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Georg Bökman , Axel Flinth , Fredrik Kahl

Capsules as well as dynamic routing between them are most recently proposed structures for deep neural networks. A capsule groups data into vectors or matrices as poses rather than conventional scalars to represent specific properties of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Suofei Zhang , Wei Zhao , Xiaofu Wu , Quan Zhou

We address the problem of improving the performance and in particular the sample complexity of deep neural networks by enforcing and guaranteeing invariances to symmetry transformations rather than learning them from data. Group-equivariant…

Machine Learning · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

Geometric transformations of the training data as well as the test data present challenges to the use of deep neural networks to vision-based learning tasks. In order to address this issue, we present a deep neural network model that…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Sai Raam Venkataraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule networks are recently proposed as an alternative to modern neural network architectures. Neurons are replaced with capsule units that represent specific features or entities with normalized vectors or matrices. The activation of…

Machine Learning · Computer Science 2021-03-09 Haoyu Yang , Shuhe Li , Bei Yu

Capsule networks, which incorporate the paradigms of connectionism and symbolism, have brought fresh insights into artificial intelligence. The capsule, as the building block of capsule networks, is a group of neurons represented by a…

Quantum Physics · Physics 2022-12-19 Zidu Liu , Pei-Xin Shen , Weikang Li , L. -M. Duan , Dong-Ling Deng

Capsule Networks face a critical problem in computer vision in the sense that the image background can challenge its performance, although they learn very well on training data. In this work, we propose to improve Capsule Networks'…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Nguyen Huu Phong , Bernardete Ribeiro

Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Rodney Lalonde , Naji Khosravan , Ulas Bagci

Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in…

Instrumentation and Methods for Astrophysics · Physics 2019-05-29 V. Lukic , M. Brüggen , B. Mingo , J. H. Croston , G. Kasieczka , P. N. Best

This project considers Capsule Networks, a recently introduced machine learning model that has shown promising results regarding generalization and preservation of spatial information with few parameters. The Capsule Network's inner routing…

Machine Learning · Computer Science 2020-01-10 Gonçalo Faria

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhen Zhao , Ashley Kleinhans , Gursharan Sandhu , Ishan Patel , K. P. Unnikrishnan

In this work we seek to bridge the concepts of topographic organization and equivariance in neural networks. To accomplish this, we introduce the Topographic VAE: a novel method for efficiently training deep generative models with…

Machine Learning · Computer Science 2022-01-11 T. Anderson Keller , Max Welling

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter