English
Related papers

Related papers: Self-supervised learning with diffusion-based mult…

200 papers

In daily listening environments, speech is always distorted by background noise, room reverberation and interference speakers. With the developing of deep learning approaches, much progress has been performed on monaural multi-speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Chao Ma , Dongmei Li , Xupeng Jia

This paper proposes a novel lip-reading driven deep learning framework for speech enhancement. The proposed approach leverages the complementary strengths of both deep learning and analytical acoustic modelling (filtering based approach) as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Ahsan Adeel , Mandar Gogate , Amir Hussain , William M. Whitmer

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

Token-based language modeling is a prominent approach for speech generation, where tokens are obtained by quantizing features from self-supervised learning (SSL) models and extracting codes from neural speech codecs, generally referred to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Yang Yang , Yunpeng Li , George Sung , Shao-Fu Shih , Craig Dooley , Alessio Centazzo , Ramanan Rajeswaran

In this paper, we present an unsupervised single-channel method for joint blind dereverberation and room impulse response estimation, based on posterior sampling with diffusion models. We parameterize the reverberation operator using a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Eloi Moliner , Jean-Marie Lemercier , Simon Welker , Timo Gerkmann , Vesa Välimäki

In this paper, we propose a replay attack spoofing detection system for automatic speaker verification using multitask learning of noise classes. We define the noise that is caused by the replay attack as replay noise. We explore the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-26 Hye-Jin Shim , Jee-weon Jung , Hee-Soo Heo , Sunghyun Yoon , Ha-Jin Yu

Faced with the scarcity of clean label data in real scenarios, seismic denoising methods based on supervised learning (SL) often encounter performance limitations. Specifically, when a model trained on synthetic data is directly applied to…

Geophysics · Physics 2023-11-07 Shijun Cheng , Zhiyao Cheng , Chao Jiang , Weijian Mao , Qingchen Zhang

In this paper, we present an analysis of a DNN-based autoencoder for speech enhancement, dereverberation and denoising. The target application is a robust speaker recognition system. We started with augmenting the Fisher database with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Ondrej Novotny , Oldrich Plchot , Pavel Matejka , Ondrej Glembek

In noisy and reverberant environments, the performance of deep learning-based speech separation methods drops dramatically because previous methods are not designed and optimized for such situations. To address this issue, we propose a…

Sound · Computer Science 2023-03-08 Zhaoxi Mu , Xinyu Yang , Xiangyuan Yang , Wenjing Zhu

This paper introduces a practical approach for leveraging a real-time deep learning model to alternate between speech enhancement and joint speech enhancement and separation depending on whether the input mixture contains one or two active…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-17 Kashyap Patel , Anton Kovalyov , Issa Panahi

Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despite these advancements, achieving an optimal balance between…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Jinhyeok Yang , Junhyeok Lee , Hyeong-Seok Choi , Seunghun Ji , Hyeongju Kim , Juheon Lee

The automated classification of stuttered speech has significant implications for timely assessments providing assistance to speech language pathologists. Despite notable advancements in the field, the cases in which multiple disfluencies…

Sound · Computer Science 2025-02-27 Huma Ameer , Seemab Latif , Mehwish Fatima

Due to the successful application of deep learning, audio spoofing detection has made significant progress. Spoofed audio with speech synthesis or voice conversion can be well detected by many countermeasures. However, an automatic speaker…

Sound · Computer Science 2024-01-12 Lian Huang , Chi-Man Pun

Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-02 Hendrik Schröter , Alberto N. Escalante-B. , Tobias Rosenkranz , Andreas Maier

Recently, deep clustering (DPCL) based speaker-independent speech separation has drawn much attention, since it needs little speaker prior information. However, it still has much room of improvement, particularly in reverberant…

Sound · Computer Science 2019-10-25 Ziye Yang , Xiao-Lei Zhang

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

The task of estimating the maximum number of concurrent speakers from single channel mixtures is important for various audio-based applications, such as blind source separation, speaker diarisation, audio surveillance or auditory scene…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Fabian-Robert Stöter , Soumitro Chakrabarty , Bernd Edler , Emanuël A. P. Habets

In this paper, we propose a multi-channel speech source separation with a deep neural network (DNN) which is trained under the condition that no clean signal is available. As an alternative to a clean signal, the proposed method adopts an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-12 Masahito Togami , Yoshiki Masuyama , Tatsuya Komatsu , Yu Nakagome

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

In this paper, an improved strategy for automated text dependent speaker identification system has been proposed in noisy environment. The identification process incorporates the Neuro- Genetic hybrid algorithm with cepstral based features.…

Sound · Computer Science 2009-09-15 Md. Rabiul Islam , Md. Fayzur Rahman