English
Related papers

Related papers: Using Optimal Ratio Mask as Training Target for Su…

200 papers

A promising approach for speech dereverberation is based on supervised learning, where a deep neural network (DNN) is trained to predict the direct sound from noisy-reverberant speech. This data-driven approach is based on leveraging prior…

Sound · Computer Science 2021-11-11 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $4+$ sources with 2 microphones) they assume a known or fixed…

Sound · Computer Science 2022-07-18 Zhongweiyang Xu , Romit Roy Choudhury

Deep neural network (DNN)-based speech enhancement ordinarily requires clean speech signals as the training target. However, collecting clean signals is very costly because they must be recorded in a studio. This requirement currently…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-11 Takuya Fujimura , Yuma Koizumi , Kohei Yatabe , Ryoichi Miyazaki

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

This paper describes a hands-on comparison on using state-of-the-art music source separation deep neural networks (DNNs) before and after task-specific fine-tuning for separating speech content from non-speech content in broadcast audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Martin Strauss , Jouni Paulus , Matteo Torcoli , Bernd Edler

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Separation of competing speech is a key challenge in signal processing and a feat routinely performed by the human auditory brain. A long standing benchmark of the spectrogram approach to source separation is known as the ideal binary mask.…

Sound · Computer Science 2015-03-25 Andrew J. R. Simpson

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

Machine Learning · Computer Science 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

Speech restoration aims at restoring high quality speech in the presence of a diverse set of distortions. Although several deep learning paradigms have been studied for this task, the power of the recently emerging language models has not…

Sound · Computer Science 2024-06-05 Xu Li , Qirui Wang , Xiaoyu Liu

In this study, we conduct a comparative analysis of deep learning-based noise reduction methods in low signal-to-noise ratio (SNR) scenarios. Our investigation primarily focuses on five key aspects: The impact of training data, the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

Detecting sound source objects within visual observation is important for autonomous robots to comprehend surrounding environments. Since sounding objects have a large variety with different appearances in our living environments, labeling…

Sound · Computer Science 2020-07-29 Yoshiki Masuyama , Yoshiaki Bando , Kohei Yatabe , Yoko Sasaki , Masaki Onishi , Yasuhiro Oikawa

We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation.…

Sound · Computer Science 2021-05-25 Zhong-Qiu Wang , Peidong Wang , DeLiang Wang

Time-frequency masking or spectrum prediction computed via short symmetric windows are commonly used in low-latency deep neural network (DNN) based source separation. In this paper, we propose the usage of an asymmetric analysis-synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Shanshan Wang , Gaurav Naithani , Archontis Politis , Tuomas Virtanen

This work proposes a new learning target based on reverberation time shortening (RTS) for speech dereverberation. The learning target for dereverberation is usually set as the direct-path speech or optionally with some early reflections.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-22 Rui Zhou , Wenye Zhu , Xiaofei Li

Speech separation is an important problem in speech processing, which targets to separate and generate clean speech from a mixed audio containing speech from different speakers. Empowered by the deep learning technologies over…

Sound · Computer Science 2021-02-22 Zining Zhang , Bingsheng He , Zhenjie Zhang

Extracting the speech of a target speaker from mixed audios, based on a reference speech from the target speaker, is a challenging yet powerful technology in speech processing. Recent studies of speaker-independent speech separation, such…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Zining Zhang , Bingsheng He , Zhenjie Zhang

The field of speech separation, addressing the "cocktail party problem", has seen revolutionary advances with DNNs. Speech separation enhances clarity in complex acoustic environments and serves as crucial pre-processing for speech…

Sound · Computer Science 2025-08-15 Kai Li , Guo Chen , Wendi Sang , Yi Luo , Zhuo Chen , Shuai Wang , Shulin He , Zhong-Qiu Wang , Andong Li , Zhiyong Wu , Xiaolin Hu

Deep-neural-network (DNN) based noise suppression systems yield significant improvements over conventional approaches such as spectral subtraction and non-negative matrix factorization, but do not generalize well to noise conditions they…

Sound · Computer Science 2018-06-06 Deepak Baby , Sarah Verhulst

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky