English
Related papers

Related papers: Kaldi+PDNN: Building DNN-based ASR Systems with Ka…

200 papers

We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational…

Neural and Evolutionary Computing · Computer Science 2017-11-07 Sourya Dey , Yinan Shao , Keith M. Chugg , Peter A. Beerel

We study large-scale kernel methods for acoustic modeling and compare to DNNs on performance metrics related to both acoustic modeling and recognition. Measuring perplexity and frame-level classification accuracy, kernel-based acoustic…

Deep neural networks (DNNs) form the cornerstone of modern AI services, supporting a wide range of applications, including autonomous driving, chatbots, and recommendation systems. As models increase in size and complexity, DNN workloads…

Machine Learning · Computer Science 2025-11-14 Xiaokai Wang , Shaoyuan Huang , Yuting Li , Xiaofei Wang

This paper addresses the observed performance gap between automatic speech recognition (ASR) systems based on Long Short Term Memory (LSTM) neural networks trained with the connectionist temporal classification (CTC) loss function and…

Computation and Language · Computer Science 2018-05-24 Jayadev Billa

Deep neural networks (DNNs) have become an enabling component for a myriad of artificial intelligence applications. DNNs have shown sometimes superior performance, even compared to humans, in cases such as self-driving, health applications,…

Neural and Evolutionary Computing · Computer Science 2023-07-12 Ghada Alsuhli , Vasileios Sakellariou , Hani Saleh , Mahmoud Al-Qutayri , Baker Mohammad , Thanos Stouraitis

High quality Automatic Speech Recognition (ASR) is a prerequisite for speech-based applications and research. While state-of-the-art ASR software is freely available, the language dependent acoustic models are lacking for languages other…

Computation and Language · Computer Science 2018-07-30 Benjamin Milde , Arne Köhn

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

The feasibility of deep neural networks (DNNs) to address data stream problems still requires intensive study because of the static and offline nature of conventional deep learning approaches. A deep continual learning algorithm, namely…

Machine Learning · Computer Science 2020-01-10 Andri Ashfahani , Mahardhika Pratama

The scarcity of labelled data makes training Deep Neural Network (DNN) models in bioacoustic applications challenging. In typical bioacoustics applications, manually labelling the required amount of data can be prohibitively expensive. To…

Sound · Computer Science 2024-07-02 Md Mohaimenuzzaman , Christoph Bergmeir , Bernd Meyer

Deep Neural Networks (DNN) have been widely employed in industry to address various Natural Language Processing (NLP) tasks. However, many engineers find it a big overhead when they have to choose from multiple frameworks, compare different…

Computation and Language · Computer Science 2019-10-21 Ming Gong , Linjun Shou , Wutao Lin , Zhijie Sang , Quanjia Yan , Ze Yang , Feixiang Cheng , Daxin Jiang

The development of deep learning technology has greatly promoted the performance improvement of automatic speech recognition (ASR) technology, which has demonstrated an ability comparable to human hearing in many tasks. Voice interfaces are…

Sound · Computer Science 2022-06-09 Jinghui Xu , Jifeng Zhu , Yong Yang

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

We present a comprehensive study of deep bidirectional long short-term memory (LSTM) recurrent neural network (RNN) based acoustic models for automatic speech recognition (ASR). We study the effect of size and depth and train models of up…

Neural and Evolutionary Computing · Computer Science 2019-08-06 Albert Zeyer , Patrick Doetsch , Paul Voigtlaender , Ralf Schlüter , Hermann Ney

Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential pace, while at the same time, there is a vast demand for…

The recent popularity of deep neural networks (DNNs) has generated a lot of research interest in performing DNN-related computation efficiently. However, the primary focus is usually very narrow and limited to (i) inference -- i.e. how to…

Machine Learning · Computer Science 2018-04-17 Hongyu Zhu , Mohamed Akrout , Bojian Zheng , Andrew Pelegris , Amar Phanishayee , Bianca Schroeder , Gennady Pekhimenko

Recently, deep neural networks (DNN) have been widely used in speaker recognition area. In order to achieve fast response time and high accuracy, the requirements for hardware resources increase rapidly. However, as the speaker recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Jingchi Zhang , Jonathan Huang , Michael Deisher , Hai Li , Yiran Chen

Deep neural network (DNN)-based speech enhancement algorithms in microphone arrays have now proven to be efficient solutions to speech understanding and speech recognition in noisy environments. However, in the context of ad-hoc microphone…

Signal Processing · Electrical Eng. & Systems 2020-11-04 Nicolas Furnon , Romain Serizel , Irina Illina , Slim Essid

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as…

Machine Learning · Computer Science 2020-10-19 Yu Li , Min Li , Bo Luo , Ye Tian , Qiang Xu

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

Computation and Language · Computer Science 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

Speech-driven visual speech synthesis involves mapping features extracted from acoustic speech to the corresponding lip animation controls for a face model. This mapping can take many forms, but a powerful approach is to use deep neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-17 Ahmed Hussen Abdelaziz , Barry-John Theobald , Justin Binder , Gabriele Fanelli , Paul Dixon , Nicholas Apostoloff , Thibaut Weise , Sachin Kajareker