English
Related papers

Related papers: Training Deep Capsule Networks with Residual Conne…

200 papers

This paper proposes a deep Convolutional Neural Network(CNN) with strong generalization ability for structural topology optimization. The architecture of the neural network is made up of encoding and decoding parts, which provide down- and…

Machine Learning · Computer Science 2020-04-01 Yiquan Zhang , Bo Peng , Xiaoyi Zhou , Cheng Xiang , Dalei Wang

Deep neural networks have achieved great success both in computer vision and natural language processing tasks. However, mostly state-of-art methods highly rely on external training or computing to improve the performance. To alleviate the…

Machine Learning · Computer Science 2020-09-25 Ming Yan , Xueli Xiao , Joey Tianyi Zhou , Yi Pan

Deep convolutional neural network has made huge revolution and shown its superior performance on computer vision tasks such as classification and segmentation. Recent years, researches devote much effort to scaling down size of network…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yingdong Hu

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal

Graph Convolutional Neural Networks (GCNNs) are the most recent exciting advancement in deep learning field and their applications are quickly spreading in multi-cross-domains including bioinformatics, chemoinformatics, social networks,…

Machine Learning · Statistics 2018-08-28 Saurabh Verma , Zhi-Li Zhang

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Training deep neural networks is a very demanding task, especially challenging is how to adapt architectures to improve the performance of trained models. We can find that sometimes, shallow networks generalize better than deep networks,…

Machine Learning · Computer Science 2022-08-03 David Peer , Bart Keulen , Sebastian Stabinger , Justus Piater , Antonio Rodríguez-Sánchez

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Atefeh Shahroudnejad , Arash Mohammadi , Konstantinos N. Plataniotis

In this paper, we develop and explore deep anomaly detection techniques based on the capsule network (CapsNet) for image data. Being able to encoding intrinsic spatial relationship between parts and a whole, CapsNet has been applied as both…

Machine Learning · Computer Science 2019-07-16 Xiaoyan Li , Iluju Kiringa , Tet Yeap , Xiaodan Zhu , Yifeng Li

Randomized Neural Networks explore the behavior of neural systems where the majority of connections are fixed, either in a stochastic or a deterministic fashion. Typical examples of such systems consist of multi-layered neural network…

Machine Learning · Computer Science 2021-02-03 Claudio Gallicchio , Simone Scardapane

Deep neural networks have become ubiquitous for applications related to visual recognition and language understanding tasks. However, it is often prohibitive to use typical neural networks on devices like mobile phones or smart watches…

Machine Learning · Computer Science 2017-08-10 Sujith Ravi

Deep neural networks have been extremely successful at various image, speech, video recognition tasks because of their ability to model deep structures within the data. However, they are still prohibitively expensive to train and apply for…

Neural and Evolutionary Computing · Computer Science 2015-04-13 Sudheendra Vijayanarasimhan , Jonathon Shlens , Rajat Monga , Jay Yagnik

In this study, we explore capsule networks with dynamic routing for text classification. We propose three strategies to stabilize the dynamic routing process to alleviate the disturbance of some noise capsules which may contain "background"…

Computation and Language · Computer Science 2018-09-05 Wei Zhao , Jianbo Ye , Min Yang , Zeyang Lei , Suofei Zhang , Zhou Zhao

A formal description of the compositionality of neural networks is associated directly with the formal grammar-structure of the objects it seeks to represent. This formal grammar-structure specifies the kind of components that make up an…

Machine Learning · Computer Science 2020-10-07 Sai Raam Venkatraman , Ankit Anand , S. Balasubramanian , R. Raghunatha Sarma

In this paper, we present a novel deep learning approach, deeply-fused nets. The central idea of our approach is deep fusion, i.e., combine the intermediate representations of base networks, where the fused output serves as the input of the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-26 Jingdong Wang , Zhen Wei , Ting Zhang , Wenjun Zeng

Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynamic routing algorithm comes with a steep computational…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Bodhisatwa Mandal , Swarnendu Ghosh , Ritesh Sarkhel , Nibaran Das , Mita Nasipuri

Capsule network (CapsNet) was introduced as an enhancement over convolutional neural networks, supplementing the latter's invariance properties with equivariance through pose estimation. CapsNet achieved a very decent performance with a…

Machine Learning · Computer Science 2019-10-29 Mohammed Amer , Tomás Maul

Capsule networks(CapsNet) are recently proposed neural network models with new processing layers, specifically for entity representation and discovery of images. It is well known that CapsNet have some advantages over traditional neural…

Machine Learning · Computer Science 2025-01-14 Daoyuan Ye , Juntao Li , Yiting Shen

Capsule networks (CapsNets) are an emerging trend in image processing. In contrast to a convolutional neural network, CapsNets are not vulnerable to object deformation, as the relative spatial information of the objects is preserved across…

Machine Learning · Computer Science 2024-04-09 Miguel Costa , Diogo Costa , Tiago Gomes , Sandro Pinto

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio