English
Related papers

Related papers: Learning with Capsules: A Survey

200 papers

Convolutional neural networks (CNNs) have shown remarkable results over the last several years for a wide range of computer vision tasks. A new architecture recently introduced by Sabour et al., referred to as a capsule networks with…

Machine Learning · Statistics 2018-10-15 Rodney LaLonde , Ulas Bagci

Capsule Networks (CapsNets) have been re-introduced as a more compact and interpretable alternative to standard deep neural networks. While recent efforts have proved their compression capabilities, to date, their interpretability…

Machine Learning · Computer Science 2024-12-16 Saja Tawalbeh , José Oramas

Convolutional Neural Networks (CNNs) have been successful in solving tasks in computer vision including medical image segmentation due to their ability to automatically extract features from unstructured data. However, CNNs are sensitive to…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Minh Tran , Viet-Khoa Vo-Ho , Kyle Quinn , Hien Nguyen , Khoa Luu , Ngan Le

Capsule Networks face a critical problem in computer vision in the sense that the image background can challenge its performance, although they learn very well on training data. In this work, we propose to improve Capsule Networks'…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Nguyen Huu Phong , Bernardete Ribeiro

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule network has shown various advantages over convolutional neural network (CNN). It keeps more precise spatial information than CNN and uses equivariance instead of invariance during inference and highly potential to be a new effective…

Machine Learning · Computer Science 2019-05-06 Zonglin Yang , Xinggang Wang

Capsule Networks (CN) offer new architectures for Deep Learning (DL) community. Though its effectiveness has been demonstrated in MNIST and smallNORB datasets, the networks still face challenges in other datasets for images with distinct…

Machine Learning · Computer Science 2023-09-19 Nguyen Huu Phong , Bernardete Ribeiro

To effectively classify graph instances, graph neural networks need to have the capability to capture the part-whole relationship existing in a graph. A capsule is a group of neurons representing complicated properties of entities, which…

Machine Learning · Computer Science 2022-04-26 Yu Lei , Jing Zhang

Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Prem Nair , Rohan Doshi , Stefan Keselj

A key component to the success of deep learning is the availability of massive amounts of training data. Building and annotating large datasets for solving medical image classification problems is today a bottleneck for many applications.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Amelia Jiménez-Sánchez , Shadi Albarqouni , Diana Mateus

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ancheng Lin , Jun Li , Zhenyuan Ma

Capsule networks (CapsNets) aim to parse images into a hierarchy of objects, parts, and their relations using a two-step process involving part-whole transformation and hierarchical component routing. However, this hierarchical relationship…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Pourya Shamsolmoali , Masoumeh Zareapoor , Swagatam Das , Eric Granger , Salvador Garcia

From the moment Neural Networks dominated the scene for image processing, the computational complexity needed to solve the targeted tasks skyrocketed: against such an unsustainable trend, many strategies have been developed, ambitiously…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Riccardo Renzulli , Marco Grangetto

With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem…

Machine Learning · Computer Science 2018-05-11 Yujian Li , Chuanhui Shan

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Capsule networks are a neural network architecture specialized for visual scene recognition. Features and pose information are extracted from a scene and then dynamically routed through a hierarchy of vector-valued nodes called 'capsules'…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alex B. Kiefer , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

In the computer vision community, Convolutional Neural Networks (CNNs), first proposed in the 1980's, have become the standard visual classification model. Recently, as alternatives to CNNs, Capsule Networks (CapsNets) and Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Jindong Gu

Capsule neural networks replace simple, scalar-valued neurons with vector-valued capsules. They are motivated by the pattern recognition system in the human brain, where complex objects are decomposed into a hierarchy of simpler object…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Matthias Mitterreiter , Marcel Koch , Joachim Giesen , Sören Laue

A Capsule Network (CapsNet) is a relatively new classifier and one of the possible successors of Convolutional Neural Networks (CNNs). CapsNet maintains the spatial hierarchies between the features and outperforms CNNs at classifying images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Pouya Shiri , Amirali Baniasadi

Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jerrin Bright , Suryaprakash Rajkumar , Arockia Selvakumar Arockia Doss