English
Related papers

Related papers: An Algorithm for Routing Capsules in All Domains

200 papers

Capsule networks are biologically inspired neural networks that group neurons into vectors called capsules, each explicitly representing an object or one of its parts. The routing mechanism connects capsules in consecutive layers, forming a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Riccardo Renzulli , Enzo Tartaglione , Marco Grangetto

Capsule networks are a neural network architecture specialized for visual scene recognition. Features and pose information are extracted from a scene and then dynamically routed through a hierarchy of vector-valued nodes called 'capsules'…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alex B. Kiefer , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

Capsule networks (CapsNets) have recently gotten attention as a novel neural architecture. This paper presents the sequential routing framework which we believe is the first method to adapt a CapsNet-only structure to sequence-to-sequence…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-02 Kyungmin Lee , Hyunwhan Joe , Hyeontaek Lim , Kwangyoun Kim , Sungsoo Kim , Chang Woo Han , Hong-Gee Kim

In this paper, we focus on learning low-dimensional embeddings for nodes in graph-structured data. To achieve this, we propose Caps2NE -- a new unsupervised embedding model leveraging a network of two capsule layers. Caps2NE induces a…

Machine Learning · Computer Science 2020-08-19 Dai Quoc Nguyen , Tu Dinh Nguyen , Dat Quoc Nguyen , Dinh Phung

Capsule networks offer interesting properties and provide an alternative to today's deep neural network architectures. However, recent approaches have failed to consistently achieve competitive results across different image datasets. We…

Machine Learning · Computer Science 2020-07-23 Alexander Fuchs , Franz Pernkopf

Classification of audio samples is an important part of many auditory systems. Deep learning models based on the Convolutional and the Recurrent layers are state-of-the-art in many such tasks. In this paper, we approach audio classification…

Sound · Computer Science 2019-02-15 Royal Jain

This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of text has not been…

Computation and Language · Computer Science 2018-08-15 Jaeyoung Kim , Sion Jang , Sungchul Choi , Eunjeong Park

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

Capsule networks are a type of neural network that identify image parts and form the instantiation parameters of a whole hierarchically. The goal behind the network is to perform an inverse computer graphics task, and the network parameters…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Saeid Abbassi , Kamaledin Ghiasi-Shirazi , Ahad Harati

In this paper, we propose a capsule-based neural network model to solve the semantic segmentation problem. By taking advantage of the extractable part-whole dependencies available in capsule layers, we derive the probabilities of the class…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Tao Sun , Zhewei Wang , C. D. Smith , Jundong Liu

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

Capsule Networks (CapsNets) are brand-new architectures that have shown ground-breaking results in certain areas of Computer Vision (CV). In 2017, Hinton and his team introduced CapsNets with routing-by-agreement in "Sabour et al" and in a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Moein Hasani , Amin Nasim Saravi , Hassan Khotanlou

Capsule networks are a type of neural network that have recently gained increased popularity. They consist of groups of neurons, called capsules, which encode properties of objects or object parts. The connections between capsules encrypt…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Josef Gugglberger , David Peer , Antonio Rodriguez-Sanchez

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

The detection of acoustic scenes is a challenging problem in which environmental sound events must be detected from a given audio signal. This includes classifying the events as well as estimating their onset and offset times. We approach…

Sound · Computer Science 2018-06-14 Turab Iqbal , Yong Xu , Qiuqiang Kong , Wenwu Wang

Capsules as well as dynamic routing between them are most recently proposed structures for deep neural networks. A capsule groups data into vectors or matrices as poses rather than conventional scalars to represent specific properties of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Suofei Zhang , Wei Zhao , Xiaofu Wu , Quan Zhou

Designing a spoken language understanding system for command-and-control applications can be challenging because of a wide variety of domains and users or because of a lack of training data. In this paper we discuss a system that learns…

Audio and Speech Processing · Electrical Eng. & Systems 2018-05-09 Vincent Renkens , Hugo Van hamme

To effectively classify graph instances, graph neural networks need to have the capability to capture the part-whole relationship existing in a graph. A capsule is a group of neurons representing complicated properties of entities, which…

Machine Learning · Computer Science 2022-04-26 Yu Lei , Jing Zhang

This study develops an unsupervised learning algorithm for products of expert capsules with dynamic routing. Analogous to binary-valued neurons in Restricted Boltzmann Machines, the magnitude of a squashed capsule firing takes values…

Machine Learning · Computer Science 2019-07-29 Michael Hauser

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhen Zhao , Ashley Kleinhans , Gursharan Sandhu , Ishan Patel , K. P. Unnikrishnan