English
Related papers

Related papers: End-to-end speech enhancement based on discrete co…

200 papers

Speech enhancement aims to improve speech quality and intelligibility in noisy environments. Recent advancements have concentrated on deep neural networks, particularly employing the Two-Stage (TS) architecture to enhance feature…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-19 Zizhen Lin , Yuanle Li , Junyu Wang , Ruili Li

Deep learning-based techniques for automatic dysarthric speech detection have recently attracted interest in the research community. State-of-the-art techniques typically learn neurotypical and dysarthric discriminative representations by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-04 Ina Kodrasi

Deep learning based speech enhancement in the short-time Fourier transform (STFT) domain typically uses a large window length such as 32 ms. A larger window can lead to higher frequency resolution and potentially better enhancement. This…

Sound · Computer Science 2022-12-07 Zhong-Qiu Wang , Gordon Wichern , Shinji Watanabe , Jonathan Le Roux

In this paper, we propose a deep learning based system for the task of deepfake audio detection. In particular, the draw input audio is first transformed into various spectrograms using three transformation methods of Short-time Fourier…

Sound · Computer Science 2024-07-03 Lam Pham , Phat Lam , Truong Nguyen , Huyen Nguyen , Alexander Schindler

In this paper we propose a Deep Neural Network (DNN) based Speech Enhancement (SE) system that is designed to maximize an approximation of the Short-Time Objective Intelligibility (STOI) measure. We formalize an approximate-STOI cost…

Sound · Computer Science 2018-02-05 Morten Kolbæk , Zheng-Hua Tan , Jesper Jensen

Subjective evaluation results for two low-latency deep neural networks (DNN) are compared to a matured version of a traditional Wiener-filter based noise suppressor. The target use-case is real-world single-channel speech enhancement…

We investigate training end-to-end speech recognition models with the recurrent neural network transducer (RNN-T): a streaming, all-neural, sequence-to-sequence architecture which jointly learns acoustic and language model components from…

Computation and Language · Computer Science 2018-01-04 Kanishka Rao , Haşim Sak , Rohit Prabhavalkar

Prediction of late reverberation component using multi-channel linear prediction (MCLP) in short-time Fourier transform (STFT) domain is an effective means to enhance reverberant speech. Traditionally, a speech power spectral density (PSD)…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-05 Srikanth Raj Chetupalli , Thippur V. Sreenivas

Due to the high computational complexity to model more frequency bands, it is still intractable to conduct real-time full-band speech enhancement based on deep neural networks. Recent studies typically utilize the compressed perceptually…

Sound · Computer Science 2022-06-16 Guochen Yu , Andong Li , Wenzhe Liu , Chengshi Zheng , Yutian Wang , Hui Wang

We investigate the viability of a variational U-Net architecture for denoising of single-channel audio data. Deep network speech enhancement systems commonly aim to estimate filter masks, or opt to work on the waveform signal, potentially…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Eike J. Nustede , Jörn Anemüller

Single-channel speech enhancement (SE) is an important task in speech processing. A widely used framework combines an analysis/synthesis filterbank with a mask prediction network, such as the Conv-TasNet architecture. In such systems, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-06 Yuma Koizumi , Shigeki Karita , Scott Wisdom , Hakan Erdogan , John R. Hershey , Llion Jones , Michiel Bacchiani

Neural end-to-end text-to-speech (TTS) , which adopts either a recurrent model, e.g. Tacotron, or an attention one, e.g. Transformer, to characterize a speech utterance, has achieved significant improvement of speech synthesis. However, it…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-18 Xi Wang , Huaiping Ming , Lei He , Frank K. Soong

In this paper we consider the problem of speech enhancement in real-world like conditions where multiple noises can simultaneously corrupt speech. Most of the current literature on speech enhancement focus primarily on presence of single…

Sound · Computer Science 2016-05-10 Anurag Kumar , Dinei Florencio

The inverse short-time Fourier transform network (iSTFTNet) has garnered attention owing to its fast, lightweight, and high-fidelity speech synthesis. It obtains these characteristics using a fast and lightweight 1D CNN as the backbone and…

Sound · Computer Science 2023-08-15 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Shogo Seki

This paper proposes an unsupervised DNN-based speech enhancement approach founded on deep priors (DPs). Here, DP signifies that DNNs are more inclined to produce clean speech signals than noises. Conventional methods based on DP typically…

Sound · Computer Science 2024-07-08 Hien Ohnaka , Ryoichi Miyazaki

Deep gated convolutional networks have been proved to be very effective in single channel speech separation. However current state-of-the-art framework often considers training the gated convolutional networks in time-frequency (TF) domain.…

Sound · Computer Science 2019-03-19 Ziqiang Shi , Huibin Lin , Liu Liu , Rujie Liu , Shoji Hayakawa , Shouji Harada , Jiqing Han

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

Sound · Computer Science 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

To further reduce the complexity of lightweight speech enhancement models, we introduce a gating-based Dynamically Slimmable Network (DSN). The DSN comprises static and dynamic components. For architecture-independent applicability, we…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Haixin Zhao , Kaixuan Yang , Nilesh Madhu

Speech derverberation using a single microphone is addressed in this paper. Motivated by the recent success of the fully convolutional networks (FCN) in many image processing applications, we investigate their applicability to enhance the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-05 Ori Ernst , Shlomo E. Chazan , Sharon Gannot , Jacob Goldberger

Deep learning based single-channel speech enhancement tries to train a neural network model for the prediction of clean speech signal. There are a variety of popular network structures for single-channel speech enhancement, such as TCNN,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Xupeng Jia , Dongmei Li