English
Related papers

Related papers: Dynamic Routing Between Capsules

200 papers

This project considers Capsule Networks, a recently introduced machine learning model that has shown promising results regarding generalization and preservation of spatial information with few parameters. The Capsule Network's inner routing…

Machine Learning · Computer Science 2020-01-10 Gonçalo Faria

We propose a capsule network-based architecture for generalizing learning to new data with few examples. Using both generative and non-generative capsule networks with intermediate routing, we are able to generalize to new information over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Andrew Gritsevskiy , Maksym Korablyov

In recent years, convolutional neural networks (CNN) have played an important role in the field of deep learning. Variants of CNN's have proven to be very successful in classification tasks across different domains. However, there are two…

Machine Learning · Statistics 2017-12-12 Edgar Xi , Selina Bing , Yang Jin

A formal description of the compositionality of neural networks is associated directly with the formal grammar-structure of the objects it seeks to represent. This formal grammar-structure specifies the kind of components that make up an…

Machine Learning · Computer Science 2020-10-07 Sai Raam Venkatraman , Ankit Anand , S. Balasubramanian , R. Raghunatha Sarma

Capsule Networks, an extension to Neural Networks utilizing vector or matrix representations instead of scalars, were initially developed to create a dynamic parse tree where visual concepts evolve from parts to complete objects. Early…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Miles Everett , Mingjun Zhong , Georgios Leontidis

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Capsule networks are a class of neural networks that achieved promising results on many computer vision tasks. However, baseline capsule networks have failed to reach state-of-the-art results on more complex datasets due to the high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Josef Gugglberger , David Peer , Antonio Rodríguez-Sánchez

Most capsule network designs rely on traditional matrix multiplication between capsule layers and computationally expensive routing mechanisms to deal with the capsule dimensional entanglement that the matrix multiplication introduces. By…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Adam Byerly , Tatiana Kalganova , Ian Dear

We introduce a new routing algorithm for capsule networks, in which a child capsule is routed to a parent based only on agreement between the parent's state and the child's vote. The new mechanism 1) designs routing via inverted dot-product…

Machine Learning · Computer Science 2020-02-27 Yao-Hung Hubert Tsai , Nitish Srivastava , Hanlin Goh , Ruslan Salakhutdinov

This paper reveal the selective rotation in the CNNs' forward processing. It elucidates the activation function as a discerning mechanism that unifies and quantizes the rotational aspects of the input data. Experiments show how this defined…

Machine Learning · Computer Science 2023-12-04 Peixin Tian

Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra-relation between capsules in the same layer is less studied, while this intra-relation is a key factor for the…

Machine Learning · Computer Science 2021-06-23 Yang Li , Wei Zhao , Erik Cambria , Suhang Wang , Steffen Eger

This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of text has not been…

Computation and Language · Computer Science 2018-08-15 Jaeyoung Kim , Sion Jang , Sungchul Choi , Eunjeong Park

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Marzieh Edraki , Nazanin Rahnavard , Mubarak Shah

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge and reason about the relationship between an object and its parts. In this paper we specify a \emph{generative} model for such data, and derive a variational algorithm…

Machine Learning · Computer Science 2022-03-16 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

CapsNet (Capsule Network) was first proposed by~\citet{capsule} and later another version of CapsNet was proposed by~\citet{emrouting}. CapsNet has been proved effective in modeling spatial features with much fewer parameters. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Zhenhua Chen , David Crandall

Spiking neural network (SNN) has attracted much attention due to their powerful spatio-temporal information representation ability. Capsule Neural Network (CapsNet) does well in assembling and coupling features at different levels. Here, we…

Neural and Evolutionary Computing · Computer Science 2021-11-16 Dongcheng Zhao , Yang Li , Yi Zeng , Jihang Wang , Qian Zhang

Building on recent work on capsule networks, we propose a new, general-purpose form of "routing by agreement" that activates output capsules in a layer as a function of their net benefit to use and net cost to ignore input capsules from…

Machine Learning · Computer Science 2020-03-02 Franz A. Heinsen

A key component to the success of deep learning is the availability of massive amounts of training data. Building and annotating large datasets for solving medical image classification problems is today a bottleneck for many applications.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Amelia Jiménez-Sánchez , Shadi Albarqouni , Diana Mateus

Capsule neural networks replace simple, scalar-valued neurons with vector-valued capsules. They are motivated by the pattern recognition system in the human brain, where complex objects are decomposed into a hierarchy of simpler object…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Matthias Mitterreiter , Marcel Koch , Joachim Giesen , Sören Laue