English
Related papers

Related papers: Comparison of Neural Network Architectures for Spe…

200 papers

Traditional Convolutional Neural Networks (CNNs) typically use the same activation function (usually ReLU) for all neurons with non-linear mapping operations. For example, the deep convolutional architecture Inception-v4 uses ReLU. To…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Luna M. Zhang

Existing deep convolutional neural networks (CNNs) have shown their great success on image classification. CNNs mainly consist of convolutional and pooling layers, both of which are performed on local image areas without considering the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-29 Zhen Zuo , Bing Shuai , Gang Wang , Xiao Liu , Xingxing Wang , Bing Wang

Recurrent neural networks (RNNs) are omnipresent in sequence modeling tasks. Practical models usually consist of several layers of hundreds or thousands of neurons which are fully connected. This places a heavy computational and memory…

Machine Learning · Computer Science 2019-05-30 Matthijs Van Keirsbilck , Alexander Keller , Xiaodong Yang

Convolutional Neural Network (CNN) is the state-of-the-art for image classification task. Here we have briefly discussed different components of CNN. In this paper, We have explained different CNN architectures for image classification.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Farhana Sultana , A. Sufian , Paramartha Dutta

Recently, non-recurrent architectures (convolutional, self-attentional) have outperformed RNNs in neural machine translation. CNNs and self-attentional networks can connect distant words via shorter network paths than RNNs, and it has been…

Computation and Language · Computer Science 2018-11-13 Gongbo Tang , Mathias Müller , Annette Rios , Rico Sennrich

Recent work has shown that recurrent neural networks (RNNs) can implicitly capture and exploit hierarchical information when trained to solve common natural language processing tasks such as language modeling (Linzen et al., 2016) and…

Computation and Language · Computer Science 2018-08-29 Ke Tran , Arianna Bisazza , Christof Monz

Despite significant efforts over the last few years to build a robust automatic speech recognition (ASR) system for different acoustic settings, the performance of the current state-of-the-art technologies significantly degrades in noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Salar Jafarlou , Soheil Khorram , Vinay Kothapally , John H. L. Hansen

The dominant approaches for named entity recognition (NER) mostly adopt complex recurrent neural networks (RNN), e.g., long-short-term-memory (LSTM). However, RNNs are limited by their recurrent nature in terms of computational efficiency.…

Computation and Language · Computer Science 2019-07-22 Hui Chen , Zijia Lin , Guiguang Ding , Jianguang Lou , Yusen Zhang , Borje Karlsson

Deep Convolutional Neural Networks (CNNs) have significantly advanced deep learning, driving breakthroughs in computer vision, natural language processing, medical diagnosis, object detection, and speech recognition. Architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Saddam Hussain Khan , Rashid Iqbal

The field of machine learning has taken a dramatic twist in recent times, with the rise of the Artificial Neural Network (ANN). These biologically inspired computational models are able to far exceed the performance of previous forms of…

Neural and Evolutionary Computing · Computer Science 2015-12-03 Keiron O'Shea , Ryan Nash

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs…

Machine Learning · Computer Science 2021-12-14 Zeyu Zhang , Yulong Pei

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Early detection is crucial for successful cancer treatment and increasing survivability rates, particularly in the most common forms. Ten different cancers have been identified in most of these advances that effectively use CNNs…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Hossein Molaeian , Kaveh Karamjani , Sina Teimouri , Saeed Roshani , Sobhan Roshani

Feed-forward convolutional neural networks (CNNs) are currently state-of-the-art for object classification tasks such as ImageNet. Further, they are quantitatively accurate models of temporally-averaged responses of neurons in the primate…

Neurons and Cognition · Quantitative Biology 2018-10-30 Aran Nayebi , Daniel Bear , Jonas Kubilius , Kohitij Kar , Surya Ganguli , David Sussillo , James J. DiCarlo , Daniel L. K. Yamins

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

Most of neural approaches to relation classification have focused on finding short patterns that represent the semantic relation using Convolutional Neural Networks (CNNs) and those approaches have generally achieved better performances…

Computation and Language · Computer Science 2017-11-02 Jonggu Kim , Jong-Hyeok Lee

Following the surge of popularity of Transformers in Computer Vision, several studies have attempted to determine whether they could be more robust to distribution shifts and provide better uncertainty estimates than Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Francesco Pinto , Philip H. S. Torr , Puneet K. Dokania