English
Related papers

Related papers: Attention routing between capsules

200 papers

Attention mechanism of late has been quite popular in the computer vision community. A lot of work has been done to improve the performance of the network, although almost always it results in increased computational complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Abhinav Sagar

Capsule networks are a type of neural network that identify image parts and form the instantiation parameters of a whole hierarchically. The goal behind the network is to perform an inverse computer graphics task, and the network parameters…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Saeid Abbassi , Kamaledin Ghiasi-Shirazi , Ahad Harati

Capsule Network is a promising concept in deep learning, yet its true potential is not fully realized thus far, providing sub-par performance on several key benchmark datasets with complex data. Drawing intuition from the success achieved…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jathushan Rajasegaran , Vinoj Jayasundara , Sandaru Jayasekara , Hirunima Jayasekara , Suranga Seneviratne , Ranga Rodrigo

A capsule is a collection of neurons which represents different variants of a pattern in the network. The routing scheme ensures only certain capsules which resemble lower counterparts in the higher layer should be activated. However, the…

Machine Learning · Computer Science 2018-08-15 Hongyang Li , Xiaoyang Guo , Bo Dai , Wanli Ouyang , Xiaogang Wang

Learning to capture long-range relations is fundamental to image/video recognition. Existing CNN models generally rely on increasing depth to model such relations which is highly inefficient. In this work, we propose the "double attention…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Yunpeng Chen , Yannis Kalantidis , Jianshu Li , Shuicheng Yan , Jiashi Feng

Network pruning is aimed at imposing sparsity in a neural network architecture by increasing the portion of zero-valued weights for reducing its size regarding energy-efficiency consideration and increasing evaluation speed. In most of the…

Machine Learning · Computer Science 2018-07-17 Amirsina Torfi , Rouzbeh A. Shirvani , Sobhan Soleymani , Nasser M. Nasrabadi

Recently, deep convolutional neural network (CNN) have been widely used in image restoration and obtained great success. However, most of existing methods are limited to local receptive field and equal treatment of different types of…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Yucheng Hang , Qingmin Liao , Wenming Yang , Yupeng Chen , Jie Zhou

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identify that learning all…

Machine Learning · Computer Science 2019-09-27 Sairaam Venkatraman , S. Balasubramanian , R. Raghunatha Sarma

Capsule networks are a type of neural network that have recently gained increased popularity. They consist of groups of neurons, called capsules, which encode properties of objects or object parts. The connections between capsules encrypt…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Josef Gugglberger , David Peer , Antonio Rodriguez-Sanchez

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ancheng Lin , Jun Li , Zhenyuan Ma

Geometric transformations of the training data as well as the test data present challenges to the use of deep neural networks to vision-based learning tasks. In order to address this issue, we present a deep neural network model that…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Sai Raam Venkataraman , S. Balasubramanian , R. Raghunatha Sarma

Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra-relation between capsules in the same layer is less studied, while this intra-relation is a key factor for the…

Machine Learning · Computer Science 2021-06-23 Yang Li , Wei Zhao , Erik Cambria , Suhang Wang , Steffen Eger

Building on recent work on capsule networks, we propose a new, general-purpose form of "routing by agreement" that activates output capsules in a layer as a function of their net benefit to use and net cost to ignore input capsules from…

Machine Learning · Computer Science 2020-03-02 Franz A. Heinsen

A Capsule Network (CapsNet) is a relatively new classifier and one of the possible successors of Convolutional Neural Networks (CNNs). CapsNet maintains the spatial hierarchies between the features and outperforms CNNs at classifying images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Pouya Shiri , Amirali Baniasadi

In recent years, Transformer architectures have revolutionized most fields of artificial intelligence, relying on an attentional mechanism based on the agreement between keys and queries to select and route information in the network. In…

Machine Learning · Computer Science 2025-07-29 Andrea Alamia , Sabine Muzellec , Thomas Serre , Rufin VanRullen

We propose a capsule network-based architecture for generalizing learning to new data with few examples. Using both generative and non-generative capsule networks with intermediate routing, we are able to generalize to new information over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Andrew Gritsevskiy , Maksym Korablyov

Segmentation of macro and microvascular structures in fundoscopic retinal images plays a crucial role in the detection of multiple retinal and systemic diseases, yet it is a difficult problem to solve. Most neural network approaches face…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Shikhar Mohan , Saumik Bhattacharya , Sayantari Ghosh

Capsule network was introduced as a new architecture of neural networks, it encoding features as capsules to overcome the lacking of equivariant in the convolutional neural networks. It uses dynamic routing algorithm to train parameters in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Qiang Ren

Capsule networks use routing algorithms to flow information between consecutive layers. In the existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In a nutshell, the next-layer capsule's…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zhihao Zhao , Samuel Cheng

Transformation-robustness is an important feature for machine learning models that perform image classification. Many methods aim to bestow this property to models by the use of data augmentation strategies, while more formal guarantees are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Sai Raam Venkataraman , S. Balasubramanian , R. Raghunatha Sarma