English
Related papers

Related papers: Multistream CNN for Robust Acoustic Modeling

200 papers

We explore why deep convolutional neural networks (CNNs) with small two-dimensional kernels, primarily used for modeling spatial relations in images, are also effective in speech recognition. We analyze the representations learned by deep…

Computation and Language · Computer Science 2018-11-13 Joanna Rownicka , Peter Bell , Steve Renals

Recently, there has been an increasing interest in unifying streaming and non-streaming speech recognition models to reduce development, training and deployment cost. The best-known approaches rely on either window-based or dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-27 Xilai Li , Goeric Huybrechts , Srikanth Ronanki , Jeff Farris , Sravan Bodapati

Self-supervised speech representation learning enables the extraction of meaningful features from raw waveforms. These features can then be efficiently used across multiple downstream tasks. However, two significant issues arise when…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Heitor R. Guimarães , Arthur Pimentel , Anderson R. Avila , Mehdi Rezagholizadeh , Boxing Chen , Tiago H. Falk

Deep Convolutional Neural Networks (CNNs) have significantly advanced deep learning, driving breakthroughs in computer vision, natural language processing, medical diagnosis, object detection, and speech recognition. Architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Saddam Hussain Khan , Rashid Iqbal

Monaural Singing Voice Separation (MSVS) is a challenging task and has been studied for decades. Deep neural networks (DNNs) are the current state-of-the-art methods for MSVS. However, the existing DNNs are often designed manually, which is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Weitao Yuan , Bofei Dong , Shengbei Wang , Masashi Unoki , Wenwu Wang

This paper presents an end-to-end deep learning model for Automatic Speech Recognition (ASR) that transcribes Nepali speech to text. The model was trained and tested on the OpenSLR (audio, text) dataset. The majority of the audio dataset…

Computation and Language · Computer Science 2024-06-27 Manish Dhakal , Arman Chhetri , Aman Kumar Gupta , Prabin Lamichhane , Suraj Pandey , Subarna Shakya

Non-autoregressive (NAR) models have achieved a large inference computation reduction and comparable results with autoregressive (AR) models on various sequence to sequence tasks. However, there has been limited research aiming to explore…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Pengcheng Guo , Xuankai Chang , Shinji Watanabe , Lei Xie

In speech enhancement, an end-to-end deep neural network converts a noisy speech signal to a clean speech directly in time domain without time-frequency transformation or mask estimation. However, aggregating contextual information from a…

Sound · Computer Science 2020-02-10 Kai Zhen , Mi Suk Lee , Minje Kim

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez

We present an efficient speech separation neural network, ARFDCN, which combines dilated convolutions, multi-scale fusion (MSF), and channel attention to overcome the limited receptive field of convolution-based networks and the high…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Junyu Wang

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

This study develops a neural network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low- and…

Machine Learning · Computer Science 2021-01-19 Jiali Wang , Zhengchun Liu , Ian Foster , Won Chang , Rajkumar Kettimuthu , Rao Kotamarthi

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-15 Bin Gu , Wu Guo

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in audio tagging tasks. However, deploying these models on resource-constrained devices like the Raspberry Pi poses challenges related to computational…

Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-20 Jean-Marc Valin , Jan Skoglund

Learning robust speaker embeddings is a crucial step in speaker diarization. Deep neural networks can accurately capture speaker discriminative characteristics and popular deep embeddings such as x-vectors are nowadays a fundamental…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-14 Nauman Dawalatabad , Mirco Ravanelli , François Grondin , Jenthe Thienpondt , Brecht Desplanques , Hwidong Na

Automatic dysarthric speech detection can provide reliable and cost-effective computer-aided tools to assist the clinical diagnosis and management of dysarthria. In this paper we propose a novel automatic dysarthric speech detection…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-01 P. Janbakhshi , I. Kodrasi , H. Bourlard

Recent studies in deep learning-based speech separation have proven the superiority of time-domain approaches to conventional time-frequency-based methods. Unlike the time-frequency domain approaches, the time-domain separation systems…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-30 Yi Luo , Zhuo Chen , Takuya Yoshioka

Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Shubo Lv , Yihui Fu , Yukai Jv , Lei Xie , Weixin Zhu , Wei Rao , Yannan Wang