English
Related papers

Related papers: Adaptive Routing Between Capsules

200 papers

We present an approach to adaptively utilize deep neural networks in order to reduce the evaluation time on new examples without loss of accuracy. Rather than attempting to redesign or approximate existing networks, we propose two schemes…

Machine Learning · Computer Science 2017-09-20 Tolga Bolukbasi , Joseph Wang , Ofer Dekel , Venkatesh Saligrama

Raw point cloud processing using capsule networks is widely adopted in classification, reconstruction, and segmentation due to its ability to preserve spatial agreement of the input data. However, most of the existing capsule based network…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Dishanika Denipitiyage , Vinoj Jayasundara , Ranga Rodrigo , Chamira U. S. Edussooriya

Capsule Networks (CapsNets) have been re-introduced as a more compact and interpretable alternative to standard deep neural networks. While recent efforts have proved their compression capabilities, to date, their interpretability…

Machine Learning · Computer Science 2024-12-16 Saja Tawalbeh , José Oramas

We propose a capsule network-based architecture for generalizing learning to new data with few examples. Using both generative and non-generative capsule networks with intermediate routing, we are able to generalize to new information over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Andrew Gritsevskiy , Maksym Korablyov

Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Prem Nair , Rohan Doshi , Stefan Keselj

Dynamic routing networks, aimed at finding the best routing paths in the networks, have achieved significant improvements to neural networks in terms of accuracy and efficiency. In this paper, we see dynamic routing networks in a fresh…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Huanyu Wang , Zequn Qin , Songyuan Li , Xi Li

Capsule Network is powerful at defining the positional relationship between features in deep neural networks for visual recognition tasks, but it is computationally expensive and not suitable for running on mobile devices. The bottleneck is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Jian Sun , Ali Pourramezan Fard , Mohammad H. Mahoor

The part-whole relational property endowed by Capsule Networks (CapsNets) has been known successful for camouflaged object detection due to its segmentation integrity. However, the previous Expectation Maximization (EM) capsule routing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Dingwen Zhang , Liangbo Cheng , Yi Liu , Xinggang Wang , Junwei Han

Reinforcement Learning (RL) is a research area that has blossomed tremendously in recent years and has shown remarkable potential for artificial intelligence based opponents in computer games. This success is primarily due to vast…

Artificial Intelligence · Computer Science 2018-01-30 Per-Arne Andersen

Modern communication networks are increasingly equipped with in-network computational capabilities and services. Routing in such networks is significantly more complicated than the traditional routing. A legitimate route for a flow not only…

Networking and Internet Architecture · Computer Science 2023-06-07 Lifan Mei , Jinrui Gou , Jingrui Yang , Yujin Cai , Yong Liu

Deep learning models for vision tasks are trained on large datasets under the assumption that there exists a universal representation that can be used to make predictions for all samples. Whereas high complexity models are proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Botos Csaba , Adel Bibi , Yanwei Li , Philip Torr , Ser-Nam Lim

Recent researches show that machine learning has the potential to learn better heuristics than the one designed by human for solving combinatorial optimization problems. The deep neural network is used to characterize the input instance for…

Machine Learning · Computer Science 2020-02-11 Bo Peng , Jiahai Wang , Zizhen Zhang

Adaptive networks are a novel class of dynamical networks whose topologies and states coevolve. Many real-world complex systems can be modeled as adaptive networks, including social networks, transportation networks, neural networks and…

Social and Information Networks · Computer Science 2017-05-29 Hiroki Sayama , Irene Pestov , Jeffrey Schmidt , Benjamin James Bush , Chun Wong , Junichi Yamanoi , Thilo Gross

In this work we propose a framework for improving the performance of any deep neural network that may suffer from vanishing gradients. To address the vanishing gradient issue, we study a framework, where we insert an intermediate output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Yi Zhou , Yue Bai , Shuvra S. Bhattacharyya , Heikki Huttunen

This article presents the first results from using a learning classifier system capable of performing adaptive computation with deep neural networks. Individual classifiers within the population are composed of two neural networks. The…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Richard J. Preen , Larry Bull

Routing algorithms play a crucial role in the efficient transmission of data within computer networks by determining the optimal paths for packet forwarding. This paper presents a comprehensive exploration of routing algorithms, focusing on…

Networking and Internet Architecture · Computer Science 2024-03-19 Ujjwal Sinha , Vikas Kumar , Shubham Kumar Singh

Even though convolutional neural networks have become the method of choice in many fields of computer vision, they still lack interpretability and are usually designed manually in a cumbersome trial-and-error process. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Maria Ximena Bastidas Rodriguez , Adrien Gruson , Luisa F. Polania , Shin Fujieda , Flavio Prieto Ortiz , Kohei Takayama , Toshiya Hachisuka

Effective routing in satellite mega-constellations has become crucial to facilitate the handling of increasing traffic loads, more complex network architectures, as well as the integration into 6G networks. To enhance adaptability as well…

Networking and Internet Architecture · Computer Science 2024-08-06 Manuel M. H. Roth , Anupama Hegde , Thomas Delamotte , Andreas Knopp

We propose an interpretable Capsule Network, iCaps, for image classification. A capsule is a group of neurons nested inside each layer, and the one in the last layer is called a class capsule, which is a vector whose norm indicates a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Dahuin Jung , Jonghyun Lee , Jihun Yi , Sungroh Yoon

Deep Neural Networks (DNNs) have been widely deployed for many Machine Learning applications. Recently, CapsuleNets have overtaken traditional DNNs, because of their improved generalization ability due to the multi-dimensional capsules, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Alberto Marchisio , Muhammad Abdullah Hanif , Muhammad Shafique