English
Related papers

Related papers: Grouping Capsules Based Different Types

200 papers

In this paper, we propose a new capsule network architecture called Attention Routing CapsuleNet (AR CapsNet). We replace the dynamic routing and squash activation function of the capsule network with dynamic routing (CapsuleNet) with the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Jaewoong Choi , Hyun Seo , Suii Im , Myungjoo Kang

Capsule Networks, an extension to Neural Networks utilizing vector or matrix representations instead of scalars, were initially developed to create a dynamic parse tree where visual concepts evolve from parts to complete objects. Early…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Miles Everett , Mingjun Zhong , Georgios Leontidis

Capsule networks (CapsNets) have recently gotten attention as a novel neural architecture. This paper presents the sequential routing framework which we believe is the first method to adapt a CapsNet-only structure to sequence-to-sequence…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-02 Kyungmin Lee , Hyunwhan Joe , Hyeontaek Lim , Kwangyoun Kim , Sungsoo Kim , Chang Woo Han , Hong-Gee Kim

Machine learning has become a powerful tool for solving problems in various engineering and science areas, including the area of communication systems. This paper presents the use of capsule networks for classification of digitally…

Signal Processing · Electrical Eng. & Systems 2023-07-07 James A. Latshaw , Dimitrie C. Popescu , John A. Snoap , Chad M. Spooner

This study develops an unsupervised learning algorithm for products of expert capsules with dynamic routing. Analogous to binary-valued neurons in Restricted Boltzmann Machines, the magnitude of a squashed capsule firing takes values…

Machine Learning · Computer Science 2019-07-29 Michael Hauser

With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem…

Machine Learning · Computer Science 2018-05-11 Yujian Li , Chuanhui Shan

Capsule network is a recent new deep network architecture that has been applied successfully for medical image segmentation tasks. This work extends capsule networks for volumetric medical image segmentation with self-supervised learning.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Minh Tran , Loi Ly , Binh-Son Hua , Ngan Le

Capsule Networks (CapsNets) are a generation of image classifiers with proven advantages over Convolutional Neural Networks (CNNs). Better robustness to affine transformation and overlapping image detection are some of the benefits…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ramin Sharifi , Pouya Shiri , Amirali Baniasadi

Recently, the growth of deep learning has produced a large number of deep neural networks. How to describe these networks unifiedly is becoming an important issue. We first formalize neural networks in a mathematical definition, give their…

Machine Learning · Computer Science 2019-03-14 Yujian Li , Chuanhui Shan

Recently, Capsule Networks (CapsNets) have shown improved performance compared to the traditional Convolutional Neural Networks (CNNs), by encoding and preserving spatial relationships between the detected features in a better way. This is…

This paper proposes a deep learning approach for traffic flow prediction in complex road networks. Traffic flow data from induction loop sensors are essentially a time series, which is also spatially related to traffic in different road…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Youngjoo Kim , Peng Wang , Yifei Zhu , Lyudmila Mihaylova

Capsule Networks (CN) offer new architectures for Deep Learning (DL) community. Though its effectiveness has been demonstrated in MNIST and smallNORB datasets, the networks still face challenges in other datasets for images with distinct…

Machine Learning · Computer Science 2023-09-19 Nguyen Huu Phong , Bernardete Ribeiro

Capsule Networks outperform Convolutional Neural Networks in learning the part-whole relationships with viewpoint invariance, and the credit goes to their multidimensional capsules. It was assumed that increasing the number of capsule…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Siddharth Sahu , Abdulrahman Altahhan

Artificial Neural Networks (ANNs) are computational models inspired by the central nervous system (especially the brain) of animals and are used to estimate or generate unknown approximation functions relied on large amounts of inputs.…

Artificial Intelligence · Computer Science 2018-09-21 Huayu Li

A recently proposed method in deep learning groups multiple neurons to capsules such that each capsule represents an object or part of an object. Routing algorithms route the output of capsules from lower-level layers to upper-level layers.…

Machine Learning · Computer Science 2021-01-20 David Peer , Sebastian Stabinger , Antonio Rodriguez-Sanchez

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Liheng Zhang , Marzieh Edraki , Guo-Jun Qi

In this paper, we focus on learning low-dimensional embeddings for nodes in graph-structured data. To achieve this, we propose Caps2NE -- a new unsupervised embedding model leveraging a network of two capsule layers. Caps2NE induces a…

Machine Learning · Computer Science 2020-08-19 Dai Quoc Nguyen , Tu Dinh Nguyen , Dat Quoc Nguyen , Dinh Phung

Capsule neural networks replace simple, scalar-valued neurons with vector-valued capsules. They are motivated by the pattern recognition system in the human brain, where complex objects are decomposed into a hierarchy of simpler object…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Matthias Mitterreiter , Marcel Koch , Joachim Giesen , Sören Laue

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge and reason about the relationship between an object and its parts. In this paper we specify a \emph{generative} model for such data, and derive a variational algorithm…

Machine Learning · Computer Science 2022-03-16 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

Learning invariant representations has been the long-standing approach to self-supervised learning. However, recently progress has been made in preserving equivariant properties in representations, yet do so with highly prescribed…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Miles Everett , Aiden Durrant , Mingjun Zhong , Georgios Leontidis