English
Related papers

Related papers: Very Deep Multilingual Convolutional Neural Networ…

200 papers

Time delay neural networks (TDNNs) are an effective acoustic model for large vocabulary speech recognition. The strength of the model can be attributed to its ability to effectively model long temporal contexts. However, current TDNN models…

Computation and Language · Computer Science 2018-02-21 Florian Kreyssig , Chao Zhang , Philip Woodland

Recent advances in deep learning based large vocabulary con- tinuous speech recognition (LVCSR) invoke growing demands in large scale speech transcription. The inference process of a speech recognizer is to find a sequence of labels whose…

Computation and Language · Computer Science 2018-08-03 Zhehuai Chen

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Motivated by the fact that characteristics of different sound classes are highly diverse in different temporal scales and hierarchical levels, a novel deep convolutional neural network (CNN) architecture is proposed for the environmental…

Sound · Computer Science 2018-06-15 Boqing Zhu , Kele Xu , Dezhi Wang , Lilun Zhang , Bo Li , Yuxing Peng

We propose a new method for creating computationally efficient convolutional neural networks (CNNs) by using low-rank representations of convolutional filters. Rather than approximating filters in previously-trained networks with more…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Yani Ioannou , Duncan Robertson , Jamie Shotton , Roberto Cipolla , Antonio Criminisi

Modern efficient Convolutional Neural Networks(CNNs) always use Depthwise Separable Convolutions(DSCs) and Neural Architecture Search(NAS) to reduce the number of parameters and the computational complexity. But some inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Liangqi Zhang , Haibo Shen , Yihao Luo , Xiang Cao , Leixilan Pan , Tianjiang Wang , Qi Feng

Recurrent neural networks (RNNs), especially long short-term memory (LSTM) RNNs, are effective network for sequential task like speech recognition. Deeper LSTM models perform well on large vocabulary continuous speech recognition, because…

Computation and Language · Computer Science 2017-03-22 Xu Tian , Jun Zhang , Zejun Ma , Yi He , Juan Wei , Peihao Wu , Wenchang Situ , Shuai Li , Yang Zhang

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

In this paper, we evaluate convolutional neural network (CNN) features using the AlexNet architecture and very deep convolutional network (VGGNet) architecture. To date, most CNN researchers have employed the last layers before output,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-28 Hirokatsu Kataoka , Kenji Iwata , Yutaka Satoh

Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high…

Computer Vision and Pattern Recognition · Computer Science 2016-05-17 Jiaxiang Wu , Cong Leng , Yuhang Wang , Qinghao Hu , Jian Cheng

Convolutional neural networks (CNNs) have constantly achieved better performance over years by introducing more complex topology, and enlarging the capacity towards deeper and wider CNNs. This makes the manual design of CNNs extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Bin Wang , Bing Xue , Mengjie Zhang

Convolutional neural networks (CNNs) have demonstrated remarkable results in image classification for benchmark tasks and practical applications. The CNNs with deeper architectures have achieved even higher performance recently thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ryo Takahashi , Takashi Matsubara , Kuniaki Uehara

We propose local binary convolution (LBC), an efficient alternative to convolutional layers in standard convolutional neural networks (CNN). The design principles of LBC are motivated by local binary patterns (LBP). The LBC layer comprises…

Machine Learning · Computer Science 2017-07-04 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

Recent progress in deep convolutional neural networks (CNNs) have enabled a simple paradigm of architecture design: larger models typically achieve better accuracy. Due to this, in modern CNN architectures, it becomes more important to…

Machine Learning · Computer Science 2019-05-14 Jongheon Jeong , Jinwoo Shin

Recently, progressive learning has shown its capacity to improve speech quality and speech intelligibility when it is combined with deep neural network (DNN) and long short-term memory (LSTM) based monaural speech enhancement algorithms,…

Sound · Computer Science 2020-01-14 Andong Li , Minmin Yuan , Chengshi Zheng , Xiaodong Li

Deep convolutional neural networks (CNNs) have been intensively used for multi-class segmentation of data from different modalities and achieved state-of-the-art performances. However, a common problem when dealing with large, high…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Chengjia Wang , Tom MacGillivray , Gillian Macnaught , Guang Yang , David Newby

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Lars Lien Ankile , Morgan Feet Heggland , Kjartan Krange

In recent years, convolutional neural networks (CNNs) have shown great performance in various fields such as image classification, pattern recognition, and multi-media compression. Two of the feature properties, local connectivity and…

Machine Learning · Computer Science 2018-07-24 Qianru Zhang , Meng Zhang , Tinghuan Chen , Zhifei Sun , Yuzhe Ma , Bei Yu