English
Related papers

Related papers: Capsule Networks Do Not Need to Model Everything

200 papers

In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classification is found to be easily misled by increasingly complex image…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-12 Xingyao Zhang , Shuaiwen Leon Song , Chenhao Xie , Jing Wang , Weigong Zhang , Xin Fu

In this paper, we introduce an embedding model, named CapsE, exploring a capsule network to model relationship triples (subject, relation, object). Our CapsE represents each triple as a 3-column matrix where each column vector represents…

Computation and Language · Computer Science 2019-03-07 Dai Quoc Nguyen , Thanh Vu , Tu Dinh Nguyen , Dat Quoc Nguyen , Dinh Phung

Deep learning has excelled in medical image classification, but its clinical application is limited by poor interpretability. Capsule networks, known for encoding hierarchical relationships and spatial features, show potential in addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xinyu Geng , Jiaming Wang , Jun Xu

Capsule network (CapsNet) was introduced as an enhancement over convolutional neural networks, supplementing the latter's invariance properties with equivariance through pose estimation. CapsNet achieved a very decent performance with a…

Machine Learning · Computer Science 2019-10-29 Mohammed Amer , Tomás Maul

Recently, the growth of deep learning has produced a large number of deep neural networks. How to describe these networks unifiedly is becoming an important issue. We first formalize neural networks in a mathematical definition, give their…

Machine Learning · Computer Science 2019-03-14 Yujian Li , Chuanhui Shan

Building on recent work on capsule networks, we propose a new, general-purpose form of "routing by agreement" that activates output capsules in a layer as a function of their net benefit to use and net cost to ignore input capsules from…

Machine Learning · Computer Science 2020-03-02 Franz A. Heinsen

Capsule Networks (CapsNets) have been re-introduced as a more compact and interpretable alternative to standard deep neural networks. While recent efforts have proved their compression capabilities, to date, their interpretability…

Machine Learning · Computer Science 2024-12-16 Saja Tawalbeh , José Oramas

Capsule networks(CapsNet) are recently proposed neural network models with new processing layers, specifically for entity representation and discovery of images. It is well known that CapsNet have some advantages over traditional neural…

Machine Learning · Computer Science 2025-01-14 Daoyuan Ye , Juntao Li , Yiting Shen

Capsule networks aim to parse images into a hierarchy of objects, parts and relations. While promising, they remain limited by an inability to learn effective low level part descriptions. To address this issue we propose a way to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Sara Sabour , Andrea Tagliasacchi , Soroosh Yazdani , Geoffrey E. Hinton , David J. Fleet

CapsNet (Capsule Network) was first proposed by~\citet{capsule} and later another version of CapsNet was proposed by~\citet{emrouting}. CapsNet has been proved effective in modeling spatial features with much fewer parameters. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Zhenhua Chen , David Crandall

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhen Zhao , Ashley Kleinhans , Gursharan Sandhu , Ishan Patel , K. P. Unnikrishnan

Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra-relation between capsules in the same layer is less studied, while this intra-relation is a key factor for the…

Machine Learning · Computer Science 2021-06-23 Yang Li , Wei Zhao , Erik Cambria , Suhang Wang , Steffen Eger

Capsule network is the most recent exciting advancement in the deep learning field and represents positional information by stacking features into vectors. The dynamic routing algorithm is used in the capsule network, however, there are…

Machine Learning · Computer Science 2019-11-20 Qiang Ren , Shaohua Shang , Lianghua He

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Machine learning based methods achieves impressive results in object classification and detection. Utilizing representative data of the visual world during the training phase is crucial to achieve good performance with such data driven…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Bruno Ferrarini , Shoaib Ehsan , Adrien Bartoli , Aleš Leonardis , Klaus D. McDonald-Maier

In this paper, we focus on learning low-dimensional embeddings for nodes in graph-structured data. To achieve this, we propose Caps2NE -- a new unsupervised embedding model leveraging a network of two capsule layers. Caps2NE induces a…

Machine Learning · Computer Science 2020-08-19 Dai Quoc Nguyen , Tu Dinh Nguyen , Dat Quoc Nguyen , Dinh Phung

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge of and reason about the relationship between an object and its parts. In this paper we specify a generative model for such data, and derive a variational algorithm for…

Machine Learning · Computer Science 2023-03-29 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

Neural networks are typically represented as data structures that are traversed either through iteration or by manual chaining of method calls. However, a deeper analysis reveals that structured recursion can be used instead, so that…

Programming Languages · Computer Science 2022-09-30 Minh Nguyen , Nicolas Wu

We present a framework to use recently introduced Capsule Networks for solving the problem of Optical Flow, one of the fundamental computer vision tasks. Most of the existing state of the art deep architectures either uses a correlation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Rahul Chand , Rajat Arora , K Ram Prabhakar , R Venkatesh Babu