English
Related papers

Related papers: Routing with Self-Attention for Multimodal Capsule…

200 papers

This paper proposes a deep learning approach for traffic flow prediction in complex road networks. Traffic flow data from induction loop sensors are essentially a time series, which is also spatially related to traffic in different road…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Youngjoo Kim , Peng Wang , Yifei Zhu , Lyudmila Mihaylova

This paper studies deep network architectures to address the problem of video classification. A multi-stream framework is proposed to fully utilize the rich multimodal information in videos. Specifically, we first train three Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Zuxuan Wu , Yu-Gang Jiang , Xi Wang , Hao Ye , Xiangyang Xue , Jun Wang

The core challenge with continual learning is catastrophic forgetting, the phenomenon that when neural networks are trained on a sequence of tasks they rapidly forget previously learned tasks. It has been observed that catastrophic…

Machine Learning · Computer Science 2020-09-10 Mark Collier , Efi Kokiopoulou , Andrea Gesmundo , Jesse Berent

Convolutional neural networks (CNNs) have shown remarkable results over the last several years for a wide range of computer vision tasks. A new architecture recently introduced by Sabour et al., referred to as a capsule networks with…

Machine Learning · Statistics 2018-10-15 Rodney LaLonde , Ulas Bagci

Transfer learning can boost the performance on the targettask by leveraging the knowledge of the source domain. Recent worksin neural architecture search (NAS), especially one-shot NAS, can aidtransfer learning by establishing sufficient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Ming Sun , Haoxuan Dou , Junjie Yan

The rapid evolution of machine learning has propelled neural networks to unprecedented success across diverse domains. In particular, multimodal learning has emerged as a transformative paradigm, leveraging complementary information from…

Machine Learning · Computer Science 2025-11-14 Fushuo Huo

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

Multimodal learning has become a pivotal approach in developing robust learning models with applications spanning multimedia, robotics, large language models, and healthcare. The efficiency of multimodal systems is a critical concern, given…

Machine Learning · Computer Science 2025-03-04 Zhe Gao , Jian Huang , Ting Li , Xueqin Wang

Deep neural network has recently shown very promising applications in different research directions and attracted the industry attention as well. Although the idea was introduced in the past but just recently the main limitation of using…

Signal Processing · Electrical Eng. & Systems 2019-04-16 Amin Abbasloo , Alan Salari

Convolutional neural networks (CNNs) have revolutionized the field of deep neural networks. However, recent research has shown that CNNs fail to generalize under various conditions and hence the idea of capsules was introduced in 2011,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Nidhin Harilal , Rohan Patil

This paper highlights the significance of including memory structures in neural networks when the latter are used to learn perception-action loops for autonomous robot navigation. Traditional navigation approaches rely on global maps of the…

Robotics · Computer Science 2017-05-24 Steven W Chen , Nikolay Atanasov , Arbaaz Khan , Konstantinos Karydis , Daniel D. Lee , Vijay Kumar

Recently, the attention-enhanced multi-layer encoder, such as Transformer, has been extensively studied in Machine Reading Comprehension (MRC). To predict the answer, it is common practice to employ a predictor to draw information only from…

Computation and Language · Computer Science 2022-08-19 Nuo Chen , Chenyu You

Unsupervised pre-training approaches have achieved great success in many fields such as Computer Vision (CV), Natural Language Processing (NLP) and so on. However, compared to typical deep learning models, pre-training or even fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xuanchen Hou , Yinsi Zhou

Large-scale models have exhibited remarkable capabilities across diverse domains, including automated medical services and intelligent customer support. However, as most large models are trained on single-modality corpora, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hao Sun , Yu Song , Jiaqing Liu , Jihong Hu , Yen-Wei Chen , Lanfen Lin

Self-attention has recently been adopted for a wide range of sequence modeling problems. Despite its effectiveness, self-attention suffers from quadratic compute and memory requirements with respect to sequence length. Successful approaches…

Machine Learning · Computer Science 2020-10-27 Aurko Roy , Mohammad Saffar , Ashish Vaswani , David Grangier

Vision and language tasks have benefited from attention. There have been a number of different attention models proposed. However, the scale at which attention needs to be applied has not been well examined. Particularly, in this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Badri N. Patro , Shivansh Patel , Vinay P. Namboodiri

Deep convolutional neural network has made huge revolution and shown its superior performance on computer vision tasks such as classification and segmentation. Recent years, researches devote much effort to scaling down size of network…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yingdong Hu

The objective of this paper is to design novel multi-layer neural network architectures for multiscale simulations of flows taking into account the observed data and physical modeling concepts. Our approaches use deep learning concepts…

Numerical Analysis · Mathematics 2018-06-14 Yating Wang , Siu Wun Cheung , Eric T. Chung , Yalchin Efendiev , Min Wang

Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, such a navigation task…

Robotics · Computer Science 2023-09-25 Bhabaranjan Panigrahi , Amir Hossain Raj , Mohammad Nazeri , Xuesu Xiao