中文
相关论文

相关论文: Investigating Capsule Networks with Dynamic Routin…

200 篇论文

Capsule networks (CapsNets) have recently gotten attention as a novel neural architecture. This paper presents the sequential routing framework which we believe is the first method to adapt a CapsNet-only structure to sequence-to-sequence…

音频与语音处理 · 电气工程与系统科学 2021-04-02 Kyungmin Lee , Hyunwhan Joe , Hyeontaek Lim , Kwangyoun Kim , Sungsoo Kim , Chang Woo Han , Hong-Gee Kim

Capsule Networks have emerged as a powerful class of deep learning architectures, known for robust performance with relatively few parameters compared to Convolutional Neural Networks (CNNs). However, their inherent efficiency is often…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Miles Everett , Mingjun Zhong , Georgios Leontidis

This project considers Capsule Networks, a recently introduced machine learning model that has shown promising results regarding generalization and preservation of spatial information with few parameters. The Capsule Network's inner routing…

机器学习 · 计算机科学 2020-01-10 Gonçalo Faria

Capsule networks are a type of neural network that have recently gained increased popularity. They consist of groups of neurons, called capsules, which encode properties of objects or object parts. The connections between capsules encrypt…

计算机视觉与模式识别 · 计算机科学 2021-04-16 Josef Gugglberger , David Peer , Antonio Rodriguez-Sanchez

Capsule networks were proposed as an alternative approach to Convolutional Neural Networks (CNNs) for learning object-centric representations, which can be leveraged for improved generalization and sample complexity. Unlike CNNs, capsule…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Fabio De Sousa Ribeiro , Kevin Duarte , Miles Everett , Georgios Leontidis , Mubarak Shah

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Machine learning has become a powerful tool for solving problems in various engineering and science areas, including the area of communication systems. This paper presents the use of capsule networks for classification of digitally…

信号处理 · 电气工程与系统科学 2023-07-07 James A. Latshaw , Dimitrie C. Popescu , John A. Snoap , Chad M. Spooner

Multi-head attention advances neural machine translation by working out multiple versions of attention in different subspaces, but the neglect of semantic overlapping between subspaces increases the difficulty of translation and…

计算与语言 · 计算机科学 2019-09-04 Shuhao Gu , Yang Feng

Capsule networks (CapsNets) were introduced to address convolutional neural networks limitations, learning object-centric representations that are more robust, pose-aware, and interpretable. They organize neurons into groups called…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Riccardo Renzulli

We propose a capsule network-based architecture for generalizing learning to new data with few examples. Using both generative and non-generative capsule networks with intermediate routing, we are able to generalize to new information over…

计算机视觉与模式识别 · 计算机科学 2018-04-27 Andrew Gritsevskiy , Maksym Korablyov

Several text classification tasks such as sentiment analysis, news categorization, multi-label classification and opinion classification are challenging problems even for modern deep learning networks. Recently, Capsule Networks (CapsNets)…

计算与语言 · 计算机科学 2020-07-09 Akhilesh Kumar Gangwar , Vadlamani Ravi

Text classification is one of the most widely studied tasks in natural language processing. Motivated by the principle of compositionality, large multilayer neural network models have been employed for this task in an attempt to effectively…

计算与语言 · 计算机科学 2018-08-07 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

Capsule networks, which incorporate the paradigms of connectionism and symbolism, have brought fresh insights into artificial intelligence. The capsule, as the building block of capsule networks, is a group of neurons represented by a…

量子物理 · 物理学 2022-12-19 Zidu Liu , Pei-Xin Shen , Weikang Li , L. -M. Duan , Dong-Ling Deng

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Jindong Gu , Volker Tresp

We present a method for fast inference in Capsule Networks (CapsNets) by taking advantage of a key insight regarding the routing coefficients that link capsules between adjacent network layers. Since the routing coefficients are responsible…

计算机视觉与模式识别 · 计算机科学 2019-04-17 Zhen Zhao , Ashley Kleinhans , Gursharan Sandhu , Ishan Patel , K. P. Unnikrishnan

In this study, we first investigate a novel capsule network with dynamic routing for linear time Neural Machine Translation (NMT), referred as \textsc{CapsNMT}. \textsc{CapsNMT} uses an aggregation mechanism to map the source sentence into…

计算与语言 · 计算机科学 2020-10-13 Mingxuan Wang , Jun Xie , Zhixing Tan , Jinsong Su , Deyi Xiong , Lei Li

Capsule networks use routing algorithms to flow information between consecutive layers. In the existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In a nutshell, the next-layer capsule's…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Zhihao Zhao , Samuel Cheng

Context modeling is essential to generate coherent and consistent translation for Document-level Neural Machine Translations. The widely used method for document-level translation usually compresses the context information into a…

计算与语言 · 计算机科学 2019-11-22 Zhengxin Yang , Jinchao Zhang , Fandong Meng , Shuhao Gu , Yang Feng , Jie Zhou

This paper proposes a deep learning approach for traffic flow prediction in complex road networks. Traffic flow data from induction loop sensors are essentially a time series, which is also spatially related to traffic in different road…

计算机视觉与模式识别 · 计算机科学 2018-09-24 Youngjoo Kim , Peng Wang , Yifei Zhu , Lyudmila Mihaylova

CapsNet (Capsule Network) was first proposed by~\citet{capsule} and later another version of CapsNet was proposed by~\citet{emrouting}. CapsNet has been proved effective in modeling spatial features with much fewer parameters. However, the…

计算机视觉与模式识别 · 计算机科学 2018-08-28 Zhenhua Chen , David Crandall