English
Related papers

Related papers: Dynamic Routing Between Capsules

200 papers

Capsule networks are a neural network architecture specialized for visual scene recognition. Features and pose information are extracted from a scene and then dynamically routed through a hierarchy of vector-valued nodes called 'capsules'…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alex B. Kiefer , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynamic routing algorithm comes with a steep computational…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Bodhisatwa Mandal , Swarnendu Ghosh , Ritesh Sarkhel , Nibaran Das , Mita Nasipuri

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ancheng Lin , Jun Li , Zhenyuan Ma

Capsule networks(CapsNet) are recently proposed neural network models with new processing layers, specifically for entity representation and discovery of images. It is well known that CapsNet have some advantages over traditional neural…

Machine Learning · Computer Science 2025-01-14 Daoyuan Ye , Juntao Li , Yiting Shen

We present group equivariant capsule networks, a framework to introduce guaranteed equivariance and invariance properties to the capsule network idea. Our work can be divided into two contributions. First, we present a generic routing by…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Jan Eric Lenssen , Matthias Fey , Pascal Libuschewski

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

'Capsule' models try to explicitly represent the poses of objects, enforcing a linear relationship between an object's pose and that of its constituent parts. This modelling assumption should lead to robustness to viewpoint changes since…

Machine Learning · Computer Science 2021-01-07 Lewis Smith , Lisa Schut , Yarin Gal , Mark van der Wilk

Human Activity Recognition (HAR) is a challenging problem that needs advanced solutions than using handcrafted features to achieve a desirable performance. Deep learning has been proposed as a solution to obtain more accurate HAR systems…

Machine Learning · Computer Science 2020-07-08 Hamed Damirchi , Rooholla Khorrambakht , Hamid Taghirad

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

This study develops an unsupervised learning algorithm for products of expert capsules with dynamic routing. Analogous to binary-valued neurons in Restricted Boltzmann Machines, the magnitude of a squashed capsule firing takes values…

Machine Learning · Computer Science 2019-07-29 Michael Hauser

Artificial Neural Networks (ANNs) are computational models inspired by the central nervous system (especially the brain) of animals and are used to estimate or generate unknown approximation functions relied on large amounts of inputs.…

Artificial Intelligence · Computer Science 2018-09-21 Huayu Li

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo

A recently proposed method in deep learning groups multiple neurons to capsules such that each capsule represents an object or part of an object. Routing algorithms route the output of capsules from lower-level layers to upper-level layers.…

Machine Learning · Computer Science 2021-01-20 David Peer , Sebastian Stabinger , Antonio Rodriguez-Sanchez

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

Capsules are grouping of neurons that allow to represent sophisticated information of a visual entity such as pose and features. In the view of this property, Capsule Networks outperform CNNs in challenging tasks like object recognition in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Barış Özcan , Furkan Kınlı , Furkan Kıraç

Capsule networks (CapsNets) were introduced to address convolutional neural networks limitations, learning object-centric representations that are more robust, pose-aware, and interpretable. They organize neurons into groups called…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Riccardo Renzulli

The basic computational unit in Capsule Network (CapsNet) is a capsule (vs. neurons in Convolutional Neural Networks (CNNs)). A capsule is a set of neurons, which form a vector. CapsNet is used for supervised classification of data and has…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Pouya Shiri , Ramin Sharifi , Amirali Baniasadi

Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Prem Nair , Rohan Doshi , Stefan Keselj