English
Related papers

Related papers: Learning to compute inner consensus: A novel appro…

200 papers

A capsule is a collection of neurons which represents different variants of a pattern in the network. The routing scheme ensures only certain capsules which resemble lower counterparts in the higher layer should be activated. However, the…

Machine Learning · Computer Science 2018-08-15 Hongyang Li , Xiaoyang Guo , Bo Dai , Wanli Ouyang , Xiaogang Wang

Capsule network is the most recent exciting advancement in the deep learning field and represents positional information by stacking features into vectors. The dynamic routing algorithm is used in the capsule network, however, there are…

Machine Learning · Computer Science 2019-11-20 Qiang Ren , Shaohua Shang , Lianghua He

Capsules are the multidimensional analogue to scalar neurons in neural networks, and because they are multidimensional, much more complex routing schemes can be used to pass information forward through the network than what can be used in…

Neural and Evolutionary Computing · Computer Science 2019-07-29 Michael Hauser

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhen Zhao , Ashley Kleinhans , Gursharan Sandhu , Ishan Patel , K. P. Unnikrishnan

Capsule network was introduced as a new architecture of neural networks, it encoding features as capsules to overcome the lacking of equivariant in the convolutional neural networks. It uses dynamic routing algorithm to train parameters in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Qiang Ren

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

In this paper, we propose 3D point-capsule networks, an auto-encoder designed to process sparse 3D point clouds while preserving spatial arrangements of the input data. 3D capsule networks arise as a direct consequence of our novel unified…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Yongheng Zhao , Tolga Birdal , Haowen Deng , Federico Tombari

In this study, we explore capsule networks with dynamic routing for text classification. We propose three strategies to stabilize the dynamic routing process to alleviate the disturbance of some noise capsules which may contain "background"…

Computation and Language · Computer Science 2018-09-05 Wei Zhao , Jianbo Ye , Min Yang , Zeyang Lei , Suofei Zhang , Zhou Zhao

This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of text has not been…

Computation and Language · Computer Science 2018-08-15 Jaeyoung Kim , Sion Jang , Sungchul Choi , Eunjeong Park

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

Capsule networks use routing algorithms to flow information between consecutive layers. In the existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In a nutshell, the next-layer capsule's…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zhihao Zhao , Samuel Cheng

Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynamic routing algorithm comes with a steep computational…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Bodhisatwa Mandal , Swarnendu Ghosh , Ritesh Sarkhel , Nibaran Das , Mita Nasipuri

Capsules as well as dynamic routing between them are most recently proposed structures for deep neural networks. A capsule groups data into vectors or matrices as poses rather than conventional scalars to represent specific properties of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Suofei Zhang , Wei Zhao , Xiaofu Wu , Quan Zhou

Capsule networks, which incorporate the paradigms of connectionism and symbolism, have brought fresh insights into artificial intelligence. The capsule, as the building block of capsule networks, is a group of neurons represented by a…

Quantum Physics · Physics 2022-12-19 Zidu Liu , Pei-Xin Shen , Weikang Li , L. -M. Duan , Dong-Ling Deng

Capsule Networks (CapsNets) are brand-new architectures that have shown ground-breaking results in certain areas of Computer Vision (CV). In 2017, Hinton and his team introduced CapsNets with routing-by-agreement in "Sabour et al" and in a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Moein Hasani , Amin Nasim Saravi , Hassan Khotanlou

Classification of audio samples is an important part of many auditory systems. Deep learning models based on the Convolutional and the Recurrent layers are state-of-the-art in many such tasks. In this paper, we approach audio classification…

Sound · Computer Science 2019-02-15 Royal Jain

Capsule networks are a recently developed class of neural networks that potentially address some of the deficiencies with traditional convolutional neural networks. By replacing the standard scalar activations with vectors, and by…

Machine Learning · Computer Science 2020-01-30 Arjun Punjabi , Jonas Schmid , Aggelos K. Katsaggelos