English
Related papers

Related papers: Small Footprint Convolutional Recurrent Networks f…

200 papers

Despite significant efforts over the last few years to build a robust automatic speech recognition (ASR) system for different acoustic settings, the performance of the current state-of-the-art technologies significantly degrades in noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Salar Jafarlou , Soheil Khorram , Vinay Kothapally , John H. L. Hansen

Recently, progressive learning has shown its capacity to improve speech quality and speech intelligibility when it is combined with deep neural network (DNN) and long short-term memory (LSTM) based monaural speech enhancement algorithms,…

Sound · Computer Science 2020-01-14 Andong Li , Minmin Yuan , Chengshi Zheng , Xiaodong Li

In recent years, convolutional neural networks (CNNs) took over the field of document analysis and they became the predominant model for word spotting. Especially attribute CNNs, which learn the mapping between a word image and an attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Fabian Wolf , Philipp Oberdiek , Gernot A. Fink

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

Keyword Spotting (KWS) plays a vital role in human-computer interaction for smart on-device terminals and service robots. It remains challenging to achieve the trade-off between small footprint and high accuracy for KWS task. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-21 Ximin Li , Xiaodong Wei , Xiaowei Qin

Convolutional neural networks (CNN) have shown promising results for end-to-end speech recognition, albeit still behind other state-of-the-art methods in performance. In this paper, we study how to bridge this gap and go beyond with a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Wei Han , Zhengdong Zhang , Yu Zhang , Jiahui Yu , Chung-Cheng Chiu , James Qin , Anmol Gulati , Ruoming Pang , Yonghui Wu

This paper develops the FastRNN and FastGRNN algorithms to address the twin RNN limitations of inaccurate training and inefficient prediction. Previous approaches have improved accuracy at the expense of prediction costs making them…

Machine Learning · Computer Science 2019-01-09 Aditya Kusupati , Manish Singh , Kush Bhatia , Ashish Kumar , Prateek Jain , Manik Varma

In this paper, we propose a context-aware keyword spotting model employing a character-level recurrent neural network (RNN) for spoken term detection in continuous speech. The RNN is end-to-end trained with connectionist temporal…

Computation and Language · Computer Science 2015-12-31 Kyuyeon Hwang , Minjae Lee , Wonyong Sung

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Near-field channel estimation is a fundamental challenge in the sixth-generation (6G) wireless communication, where extremely large antenna arrays (ELAA) enable near-field communication (NFC) but introduce significant signal processing…

Signal Processing · Electrical Eng. & Systems 2025-05-21 Vu Tung Lam , Do Hai Son , Tran Thi Thuy Quynh , Le Trung Thanh

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

Deep convolutional neural networks (CNNs) are often of sophisticated design with numerous learnable parameters for the accuracy reason. To alleviate the expensive costs of deploying them on mobile devices, recent works have made huge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Mingjian Zhu , Kai Han , Enhua Wu , Qiulin Zhang , Ying Nie , Zhenzhong Lan , Yunhe Wang

In this work, we present Slimmable Neural Networks applied to the problem of small-footprint keyword spotting. We show that slimmable neural networks allow us to create super-nets from Convolutioanl Neural Networks and Transformers, from…

Sound · Computer Science 2023-04-25 Zuhaib Akhtar , Mohammad Omar Khursheed , Dongsu Du , Yuzong Liu

Recurrent Neural Network (RNN) and its variations such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), have become standard building blocks for learning online data of sequential nature in many research areas, including…

Computation and Language · Computer Science 2020-05-12 Enmao Diao , Jie Ding , Vahid Tarokh

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs. Recurrent Neural Networks (RNNs) have the ability, in…

Neural and Evolutionary Computing · Computer Science 2014-02-17 Jan Koutník , Klaus Greff , Faustino Gomez , Jürgen Schmidhuber

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen

Mainly for the sake of solving the lack of keyword-specific data, we propose one Keyword Spotting (KWS) system using Deep Neural Network (DNN) and Connectionist Temporal Classifier (CTC) on power-constrained small-footprint mobile devices,…

Computation and Language · Computer Science 2017-09-13 Zhiming Wang , Xiaolong Li , Jun Zhou

Keyword spotting is an important research field because it plays a key role in device wake-up and user interaction on smart devices. However, it is challenging to minimize errors while operating efficiently in devices with limited resources…

Sound · Computer Science 2023-07-06 Byeonggeun Kim , Simyung Chang , Jinkyu Lee , Dooyong Sung