English
Related papers

Related papers: Deep neural network Based Low-latency Speech Separ…

200 papers

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

Machine Learning · Computer Science 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

This paper presents a neural method for distant speech recognition (DSR) that jointly separates and diarizes speech mixtures without supervision by isolated signals. A standard separation method for multi-talker DSR is a statistical…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yoshiaki Bando , Tomohiko Nakamura , Shinji Watanabe

Today's Automatic Speech Recognition systems only rely on acoustic signals and often don't perform well under noisy conditions. Performing multi-modal speech recognition - processing acoustic speech signals and lip-reading video…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Matthijs Van keirsbilck , Bert Moons , Marian Verhelst

While neural network approaches have made significant strides in resolving classical signal processing problems, it is often the case that hybrid approaches that draw insight from both signal processing and neural networks produce more…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-13 Karim Helwani , Masahito Togami , Paris Smaragdis , Michael M. Goodwin

In this paper, we propose a two-step training procedure for source separation via a deep neural network. In the first step we learn a transform (and it's inverse) to a latent space where masking-based separation performance using oracles is…

Machine Learning · Computer Science 2021-05-12 Efthymios Tzinis , Shrikant Venkataramani , Zhepei Wang , Cem Subakan , Paris Smaragdis

Recent advances in the design of neural network architectures, in particular those specialized in modeling sequences, have provided significant improvements in speech separation performance. In this work, we propose to use a bio-inspired…

Sound · Computer Science 2021-12-07 Xiaolin Hu , Kai Li , Weiyi Zhang , Yi Luo , Jean-Marie Lemercier , Timo Gerkmann

In this study, we conduct a comparative analysis of deep learning-based noise reduction methods in low signal-to-noise ratio (SNR) scenarios. Our investigation primarily focuses on five key aspects: The impact of training data, the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Low power deep learning accelerators on the speech processing enable real-time applications on edge devices. However, most of the existing accelerators suffer from high power consumption and focus on image applications only. This paper…

Sound · Computer Science 2023-12-18 Chih-Chyau Yang , Tian-Sheuan Chang

Hybrid ventilation is an energy-efficient solution to provide fresh air for most climates, given that it has a reliable control system. To operate such systems optimally, a high-fidelity control-oriented modesl is required. It should enable…

Machine Learning · Computer Science 2023-03-24 Gaurav Chaudhary , Hicham Johra , Laurent Georges , Bjørn Austbø

Recent single-channel speech enhancement methods based on deep neural networks (DNNs) have achieved remarkable results, but there are still generalization problems in real scenes. Like other data-driven methods, DNN-based speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Lu Zhang , Mingjiang Wang , Andong Li , Zehua Zhang , Xuyi Zhuang

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

This paper presents sampling-based speech parameter generation using moment-matching networks for Deep Neural Network (DNN)-based speech synthesis. Although people never produce exactly the same speech even if we try to express the same…

Sound · Computer Science 2017-04-13 Shinnosuke Takamichi , Tomoki Koriyama , Hiroshi Saruwatari

Despite noise suppression being a mature area in signal processing, it remains highly dependent on fine tuning of estimator algorithms and parameters. In this paper, we demonstrate a hybrid DSP/deep learning approach to noise suppression. A…

Sound · Computer Science 2018-06-04 Jean-Marc Valin

Deep learning methods have brought substantial advancements in speech separation (SS). Nevertheless, it remains challenging to deploy deep-learning-based models on edge devices. Thus, identifying an effective way to compress these large…

Sound · Computer Science 2019-12-10 Chao-I Tuan , Yuan-Kuei Wu , Hung-yi Lee , Yu Tsao

To date, mainstream target speech separation (TSS) approaches are formulated to estimate the complex ratio mask (cRM) of the target speech in time-frequency domain under supervised deep learning framework. However, the existing deep models…

Sound · Computer Science 2021-09-08 Rongzhi Gu , Shi-Xiong Zhang , Yuexian Zou , Dong Yu

We propose a single-channel Deep Cascade Fusion of Diarization and Separation (DCF-DS) framework for back-end automatic speech recognition (ASR), combining neural speaker diarization (NSD) and speech separation (SS). First, we sequentially…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Shu-Tong Niu , Jun Du , Ruo-Yu Wang , Gao-Bin Yang , Tian Gao , Jia Pan , Yu Hu

Current performance evaluation for audio source separation depends on comparing the processed or separated signals with reference signals. Therefore, common performance evaluation toolkits are not applicable to real-world situations where…

Sound · Computer Science 2019-06-25 Emad M. Grais , Hagen Wierstorf , Dominic Ward , Russell Mason , Mark D. Plumbley

Diadochokinetic speech tasks (DDK), in which participants repeatedly produce syllables, are commonly used as part of the assessment of speech motor impairments. These studies rely on manual analyses that are time-intensive, subjective, and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-30 Yael Segal , Kasia Hitczenko , Matthew Goldrick , Adam Buchwald , Angela Roberts , Joseph Keshet

We address monaural multi-speaker-image separation in reverberant conditions, aiming at separating mixed speakers but preserving the reverberation of each speaker. A straightforward approach for this task is to directly train end-to-end DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Jingqi Sun , Shulin He , Ruizhe Pang , Zhong-Qiu Wang

Far-field speech recognition in noisy and reverberant conditions remains a challenging problem despite recent deep learning breakthroughs. This problem is commonly addressed by acquiring a speech signal from multiple microphones and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-17 Zhong Meng , Shinji Watanabe , John R. Hershey , Hakan Erdogan