English
Related papers

Related papers: ContextNet: Improving Convolutional Neural Network…

200 papers

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These…

Computation and Language · Computer Science 2023-05-10 Xuandi Fu , Kanthashree Mysore Sathyendra , Ankur Gandhe , Jing Liu , Grant P. Strimel , Ross McGowan , Athanasios Mouchtaris

The recurrent neural network transducer (RNN-T) is a prominent streaming end-to-end (E2E) ASR technology. In RNN-T, the acoustic encoder commonly consists of stacks of LSTMs. Very recently, as an alternative to LSTM layers, the Conformer…

We propose an end-to-end affect recognition approach using a Convolutional Neural Network (CNN) that handles multiple languages, with applications to emotion and personality recognition from speech. We lay the foundation of a universal…

Computation and Language · Computer Science 2019-01-28 Dario Bertero , Onno Kampman , Pascale Fung

Reading text in the wild is a challenging task in the field of computer vision. Existing approaches mainly adopted Connectionist Temporal Classification (CTC) or Attention models based on Recurrent Neural Network (RNN), which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yunze Gao , Yingying Chen , Jinqiao Wang , Hanqing Lu

Casual conversations involving multiple speakers and noises from surrounding devices are common in everyday environments, which degrades the performances of automatic speech recognition systems. These challenging characteristics of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-24 Nelson Yalta , Shinji Watanabe , Takaaki Hori , Kazuhiro Nakadai , Tetsuya Ogata

End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system. RNN transducer (RNN-T) is one of the popular end-to-end methods. Previous studies have…

Computation and Language · Computer Science 2019-04-24 Senmao Wang , Pan Zhou , Wei Chen , Jia Jia , Lei Xie

Convolutional neural networks (CNN) have improved speech recognition performance greatly by exploiting localized time-frequency patterns. But these patterns are assumed to appear in symmetric and rigid kernels by the conventional CNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-19 Jiamin Xie , John H. L. Hansen

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen

We explore options to use Transformer networks in neural transducer for end-to-end speech recognition. Transformer networks use self-attention for sequence modeling and comes with advantages in parallel computation and capturing contexts.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Ching-Feng Yeh , Jay Mahadeokar , Kaustubh Kalgaonkar , Yongqiang Wang , Duc Le , Mahaveer Jain , Kjell Schubert , Christian Fuegen , Michael L. Seltzer

This article surveys convolution-based models including convolutional neural networks (CNNs), Conformers, ResNets, and CRNNs-as speech signal processing models and provide their statistical backgrounds and speech recognition, speaker…

Sound · Computer Science 2024-12-02 Nirmal Joshua Kapu , Raghav Karan

Digital histology images are amenable to the application of convolutional neural network (CNN) for analysis due to the sheer size of pixel data present in them. CNNs are generally used for representation learning from small image patches…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Muhammad Shaban , Ruqayya Awan , Muhammad Moazam Fraz , Ayesha Azam , David Snead , Nasir M. Rajpoot

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person…

Computation and Language · Computer Science 2022-09-08 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Veljko Miljanic , Sheng Zhao , Hosam Khalil

In computer vision, convolutional neural networks (CNN) such as ConvNeXt, have been able to surpass state-of-the-art transformers, partly thanks to depthwise separable convolutions (DSC). DSC, as an approximation of the regular convolution,…

Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations. Recently, Transformers -- originally introduced in natural language processing -- have been increasingly adopted in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Peng Gao , Jiasen Lu , Hongsheng Li , Roozbeh Mottaghi , Aniruddha Kembhavi

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering traditional word embeddings. In this work, we show that…

Computation and Language · Computer Science 2019-06-25 Daniel Loureiro , Alipio Jorge

This paper describes the extension and optimization of our previous work on very deep convolutional neural networks (CNNs) for effective recognition of noisy speech in the Aurora 4 task. The appropriate number of convolutional layers, the…

Computation and Language · Computer Science 2016-10-04 Yanmin Qian , Philip C Woodland

We present a technique for adding global context to deep convolutional networks for semantic segmentation. The approach is simple, using the average feature for a layer to augment the features at each location. In addition, we study several…

Computer Vision and Pattern Recognition · Computer Science 2015-11-23 Wei Liu , Andrew Rabinovich , Alexander C. Berg

Attempts to develop speech enhancement algorithms with improved speech intelligibility for cochlear implant (CI) users have met with limited success. To improve speech enhancement methods for CI users, we propose to perform speech…

Sound · Computer Science 2019-07-08 Nursadul Mamun , Soheil Khorram , John H. L. Hansen

We propose a novel convolutional architecture, named $gen$CNN, for word sequence prediction. Different from previous work on neural network-based language modeling and generation (e.g., RNN or LSTM), we choose not to greedily summarize the…

Computation and Language · Computer Science 2015-04-27 Mingxuan Wang , Zhengdong Lu , Hang Li , Wenbin Jiang , Qun Liu