English
Related papers

Related papers: Capsule Networks Need an Improved Routing Algorith…

200 papers

This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of text has not been…

Computation and Language · Computer Science 2018-08-15 Jaeyoung Kim , Sion Jang , Sungchul Choi , Eunjeong Park

This project considers Capsule Networks, a recently introduced machine learning model that has shown promising results regarding generalization and preservation of spatial information with few parameters. The Capsule Network's inner routing…

Machine Learning · Computer Science 2020-01-10 Gonçalo Faria

Obstacles hindering the development of capsule networks for challenging NLP applications include poor scalability to large output spaces and less reliable routing processes. In this paper, we introduce: 1) an agreement score to evaluate the…

Computation and Language · Computer Science 2019-06-10 Wei Zhao , Haiyun Peng , Steffen Eger , Erik Cambria , Min Yang

CapsNet (Capsule Network) was first proposed by~\citet{capsule} and later another version of CapsNet was proposed by~\citet{emrouting}. CapsNet has been proved effective in modeling spatial features with much fewer parameters. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Zhenhua Chen , David Crandall

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

Convolutional neural networks (CNNs) have revolutionized the field of deep neural networks. However, recent research has shown that CNNs fail to generalize under various conditions and hence the idea of capsules was introduced in 2011,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Nidhin Harilal , Rohan Patil

Building on recent work on capsule networks, we propose a new, general-purpose form of "routing by agreement" that activates output capsules in a layer as a function of their net benefit to use and net cost to ignore input capsules from…

Machine Learning · Computer Science 2020-03-02 Franz A. Heinsen

Compositionality is a key strategy for addressing combinatorial complexity and the curse of dimensionality. Recent work has shown that compositional solutions can be learned and offer substantial gains across a variety of domains, including…

Machine Learning · Computer Science 2019-04-30 Clemens Rosenbaum , Ignacio Cases , Matthew Riemer , Tim Klinger

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

The Capsule Network is widely believed to be more robust than Convolutional Networks. However, there are no comprehensive comparisons between these two networks, and it is also unknown which components in the CapsNet affect its robustness.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Jindong Gu , Volker Tresp , Han Hu

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule networks are a recently proposed type of neural network shown to outperform alternatives in challenging shape recognition tasks. In capsule networks, scalar neurons are replaced with capsule vectors or matrices, whose entries…

Machine Learning · Computer Science 2019-12-04 Fabio De Sousa Ribeiro , Georgios Leontidis , Stefanos Kollias

Capsule networks are a type of neural network that identify image parts and form the instantiation parameters of a whole hierarchically. The goal behind the network is to perform an inverse computer graphics task, and the network parameters…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Saeid Abbassi , Kamaledin Ghiasi-Shirazi , Ahad Harati

Capsule network has shown various advantages over convolutional neural network (CNN). It keeps more precise spatial information than CNN and uses equivariance instead of invariance during inference and highly potential to be a new effective…

Machine Learning · Computer Science 2019-05-06 Zonglin Yang , Xinggang Wang

Capsule networks are a neural network architecture specialized for visual scene recognition. Features and pose information are extracted from a scene and then dynamically routed through a hierarchy of vector-valued nodes called 'capsules'…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alex B. Kiefer , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

To effectively classify graph instances, graph neural networks need to have the capability to capture the part-whole relationship existing in a graph. A capsule is a group of neurons representing complicated properties of entities, which…

Machine Learning · Computer Science 2022-04-26 Yu Lei , Jing Zhang

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

Development of routing algorithms is of clear importance as the volume of Internet traffic continues to increase. In this survey, there is much research into how Machine Learning techniques can be employed to improve the performance and…

Networking and Internet Architecture · Computer Science 2021-12-28 Ke Liang , Mitchel Myers

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

Capsule networks (CapsNets) are capable of modeling visual hierarchical relationships, which is achieved by the "routing-by-agreement" mechanism. This paper proposes a pairwise agreement mechanism to build capsules, inspired by the feature…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lei Zhao , Xiaohui Wang , Lei Huang