English
Related papers

Related papers: Deep Learning Based Phase Reconstruction for Speak…

200 papers

Speech signals are complex intermingling of various informative factors, and this information blending makes decoding any of the individual factors extremely difficult. A natural idea is to factorize each speech frame into independent…

Sound · Computer Science 2017-06-27 Dong Wang , Lantian Li , Ying Shi , Yixiang Chen , Zhiyuan Tang

The decoupling-style concept begins to ignite in the speech enhancement area, which decouples the original complex spectrum estimation task into multiple easier sub-tasks i.e., magnitude-only recovery and the residual complex spectrum…

Sound · Computer Science 2022-08-02 Guochen Yu , Andong Li , Hui Wang , Yutian Wang , Yuxuan Ke , Chengshi Zheng

Text-independent speaker verification is an important artificial intelligence problem that has a wide spectrum of applications, such as criminal investigation, payment certification, and interest-based customer services. The purpose of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Jiwei Xu , Xinggang Wang , Bin Feng , Wenyu Liu

This paper introduces a novel technique for reconstructing the phase of modified spectrograms of audio signals. From the analysis of mixtures of sinusoids we obtain relationships between phases of successive time frames in the…

Sound · Computer Science 2016-05-25 Paul Magron , Roland Badeau , Bertrand David

Traditional speech separation and speaker diarization approaches rely on prior knowledge of target speakers or a predetermined number of participants in audio signals. To address these limitations, recent advances focus on developing…

Many of the recent advances in speech separation are primarily aimed at synthetic mixtures of short audio utterances with high degrees of overlap. Most of these approaches need an additional stitching step to stitch the separated speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-07 Rohit Paturi , Sundararajan Srinivasan , Katrin Kirchhoff , Daniel Garcia-Romero

We propose a novel sparse representation for heavily underdetermined multichannel sound mixtures, i.e., with much more sources than microphones. The proposed approach operates in the complex Fourier domain, thus preserving spatial…

Sound · Computer Science 2014-10-10 Antoine Deleforge , Walter Kellermann

Monaural source separation is important for many real world applications. It is challenging because, with only a single channel of information available, without any constraints, an infinite number of solutions are possible. In this paper,…

Sound · Computer Science 2015-10-02 Po-Sen Huang , Minje Kim , Mark Hasegawa-Johnson , Paris Smaragdis

This paper presents a novel phase reconstruction method (only from a given amplitude spectrogram) by combining a signal-processing-based approach and a deep neural network (DNN). To retrieve a time-domain signal from its amplitude…

Sound · Computer Science 2019-03-12 Yoshiki Masuyama , Kohei Yatabe , Yuma Koizumi , Yasuhiro Oikawa , Noboru Harada

Harmonic/percussive source separation (HPSS) consists in separating the pitched instruments from the percussive parts in a music mixture. In this paper, we propose to apply the recently introduced Masker-Denoiser with twin networks (MaD…

Recent high-performance transformer-based speech enhancement models demonstrate that time domain methods could achieve similar performance as time-frequency domain methods. However, time-domain speech enhancement systems typically receive…

Sound · Computer Science 2023-10-31 Junhui Li , Pu Wang , Jialu Li , Xinzhe Wang , Youshan Zhang

Monaural speech enhancement has been widely studied using real networks in the time-frequency (TF) domain. However, the input and the target are naturally complex-valued in the TF domain, a fully complex network is highly desirable for…

Sound · Computer Science 2023-02-24 Shengkui Zhao , Bin Ma

Deep learning based models have significantly improved the performance of speech separation with input mixtures like the cocktail party. Prominent methods (e.g., frequency-domain and time-domain speech separation) usually build regression…

Sound · Computer Science 2022-01-11 Jing Shi , Xuankai Chang , Tomoki Hayashi , Yen-Ju Lu , Shinji Watanabe , Bo Xu

Various informative factors mixed in speech signals, leading to great difficulty when decoding any of the factors. An intuitive idea is to factorize each speech frame into individual informative factors, though it turns out to be highly…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-05 Lantian Li , Dong Wang , Yixiang Chen , Ying Shi , Zhiyuan Tang , Thomas Fang Zheng

In this paper we propose a new method of speaker diarization that employs a deep learning architecture to learn speaker embeddings. In contrast to the traditional approaches that build their speaker embeddings using manually hand-crafted…

Sound · Computer Science 2017-09-18 Pawel Cyrta , Tomasz Trzciński , Wojciech Stokowiec

Recently, self-supervised learning (SSL) techniques have been introduced to solve the monaural speech enhancement problem. Due to the lack of using clean phase information, the enhancement performance is limited in most SSL methods.…

Sound · Computer Science 2021-12-22 Yi Li , Yang Sun , Syed Mohsen Naqvi

In this paper, we propose a new convolutional layer called Depthwise-STFT Separable layer that can serve as an alternative to the standard depthwise separable convolutional layer. The construction of the proposed layer is inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Sudhakar Kumawat , Shanmuganathan Raman

We address monaural multi-speaker-image separation in reverberant conditions, aiming at separating mixed speakers but preserving the reverberation of each speaker. A straightforward approach for this task is to directly train end-to-end DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Jingqi Sun , Shulin He , Ruizhe Pang , Zhong-Qiu Wang

This paper proposes APSS, a novel neural speech separation model with parallel amplitude and phase spectrum estimation. Unlike most existing speech separation methods, the APSS distinguishes itself by explicitly estimating the phase…

Sound · Computer Science 2025-09-18 Fei Liu , Yang Ai , Zhen-Hua Ling

We propose mixture to mixture (M2M) training, a weakly-supervised neural speech separation algorithm that leverages close-talk mixtures as a weak supervision for training discriminative models to separate far-field mixtures. Our idea is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Zhong-Qiu Wang