English
Related papers

Related papers: Capsule Networks Do Not Need to Model Everything

200 papers

A capsule is a group of neurons whose activity vector represents the instantiation parameters of a specific type of entity such as an object or an object part. We use the length of the activity vector to represent the probability that the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Sara Sabour , Nicholas Frosst , Geoffrey E Hinton

Capsule Networks have emerged as a powerful class of deep learning architectures, known for robust performance with relatively few parameters compared to Convolutional Neural Networks (CNNs). However, their inherent efficiency is often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Miles Everett , Mingjun Zhong , Georgios Leontidis

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge and reason about the relationship between an object and its parts. In this paper we specify a \emph{generative} model for such data, and derive a variational algorithm…

Machine Learning · Computer Science 2022-03-16 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

Capsule Networks (CapsNets) are brand-new architectures that have shown ground-breaking results in certain areas of Computer Vision (CV). In 2017, Hinton and his team introduced CapsNets with routing-by-agreement in "Sabour et al" and in a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Moein Hasani , Amin Nasim Saravi , Hassan Khotanlou

Artificial Neural Networks (ANNs) are computational models inspired by the central nervous system (especially the brain) of animals and are used to estimate or generate unknown approximation functions relied on large amounts of inputs.…

Artificial Intelligence · Computer Science 2018-09-21 Huayu Li

Capsule networks use routing algorithms to flow information between consecutive layers. In the existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In a nutshell, the next-layer capsule's…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zhihao Zhao , Samuel Cheng

A capsule is a group of neurons, whose activity vector represents the instantiation parameters of a specific type of entity. In this paper, we explore the capsule networks used for relation extraction in a multi-instance multi-label…

Information Retrieval · Computer Science 2022-11-02 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Xi Chen , Wei Zhang , Huajun Chen

A formal description of the compositionality of neural networks is associated directly with the formal grammar-structure of the objects it seeks to represent. This formal grammar-structure specifies the kind of components that make up an…

Machine Learning · Computer Science 2020-10-07 Sai Raam Venkatraman , Ankit Anand , S. Balasubramanian , R. Raghunatha Sarma

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ancheng Lin , Jun Li , Zhenyuan Ma

This paper proposes a user semantic intent modeling algorithm based on Capsule Networks to address the problem of insufficient accuracy in intent recognition for human-computer interaction. The method represents semantic features in input…

Computation and Language · Computer Science 2025-07-02 Shixiao Wang , Yifan Zhuang , Runsheng Zhang , Zhijun Song

Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Prem Nair , Rohan Doshi , Stefan Keselj

'Capsule' models try to explicitly represent the poses of objects, enforcing a linear relationship between an object's pose and that of its constituent parts. This modelling assumption should lead to robustness to viewpoint changes since…

Machine Learning · Computer Science 2021-01-07 Lewis Smith , Lisa Schut , Yarin Gal , Mark van der Wilk

Capsule networks (CapsNets) are capable of modeling visual hierarchical relationships, which is achieved by the "routing-by-agreement" mechanism. This paper proposes a pairwise agreement mechanism to build capsules, inspired by the feature…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lei Zhao , Xiaohui Wang , Lei Huang

With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem…

Machine Learning · Computer Science 2018-05-11 Yujian Li , Chuanhui Shan

Capsules as well as dynamic routing between them are most recently proposed structures for deep neural networks. A capsule groups data into vectors or matrices as poses rather than conventional scalars to represent specific properties of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Suofei Zhang , Wei Zhao , Xiaofu Wu , Quan Zhou

Capsule networks are a class of neural networks that achieved promising results on many computer vision tasks. However, baseline capsule networks have failed to reach state-of-the-art results on more complex datasets due to the high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Josef Gugglberger , David Peer , Antonio Rodríguez-Sánchez

Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Marzieh Edraki , Nazanin Rahnavard , Mubarak Shah