中文
相关论文

相关论文: Diffiner: A Versatile Diffusion-based Generative R…

200 篇论文

Diffusion models have gained attention in speech enhancement tasks, providing an alternative to conventional discriminative methods. However, research on target speech extraction under multi-speaker noisy conditions remains relatively…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Leying Zhang , Yao Qian , Linfeng Yu , Heming Wang , Hemin Yang , Long Zhou , Shujie Liu , Yanmin Qian

In this paper, we propose to utilise diffusion models for data augmentation in speech emotion recognition (SER). In particular, we present an effective approach to utilise improved denoising diffusion probabilistic models (IDDPM) to…

声音 · 计算机科学 2023-05-22 Ibrahim Malik , Siddique Latif , Raja Jurdak , Björn Schuller

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

声音 · 计算机科学 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion…

密码学与安全 · 计算机科学 2025-01-15 Anton Firc , Kamil Malinka , Petr Hanáček

Discrete diffusion models have emerged as a promising direction for vision-language tasks, offering bidirectional context modeling and theoretical parallelization. However, their practical application is severely hindered by a…

计算与语言 · 计算机科学 2025-10-24 Yatai Ji , Teng Wang , Yuying Ge , Zhiheng Liu , Sidi Yang , Ying Shan , Ping Luo

Recently, conditional score-based diffusion models have gained significant attention in the field of supervised speech enhancement, yielding state-of-the-art performance. However, these methods may face challenges when generalising to…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Berné Nortier , Mostafa Sadeghi , Romain Serizel

In recent years, the joint training of speech enhancement front-end and automatic speech recognition (ASR) back-end has been widely used to improve the robustness of ASR systems. Traditional joint training methods only use enhanced speech…

声音 · 计算机科学 2023-05-31 Haoyu Lu , Nan Li , Tongtong Song , Longbiao Wang , Jianwu Dang , Xiaobao Wang , Shiliang Zhang

In this paper, we present a causal speech signal improvement system that is designed to handle different types of distortions. The method is based on a generative diffusion model which has been shown to work well in scenarios with missing…

音频与语音处理 · 电气工程与系统科学 2023-03-16 Julius Richter , Simon Welker , Jean-Marie Lemercier , Bunlong Lay , Tal Peer , Timo Gerkmann

A primary challenge when deploying speaker recognition systems in real-world applications is performance degradation caused by environmental mismatch. We propose a diffusion-based method that takes speaker embeddings extracted from a…

音频与语音处理 · 电气工程与系统科学 2025-05-23 KiHyun Nam , Jungwoo Heo , Jee-weon Jung , Gangin Park , Chaeyoung Jung , Ha-Jin Yu , Joon Son Chung

In this paper, we present a method that allows to further improve speech enhancement obtained with recently introduced Deep Neural Network (DNN) models. We propose a multi-channel refinement method of time-frequency masks obtained with…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Julitta Bartolewska , Stanisław Kacprzak , Konrad Kowalczyk

The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Dongjun Kim , Yeongmin Kim , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

We propose Uni-ArrayDPS, a novel diffusion-based refinement framework for unified multi-channel speech enhancement and separation. Existing methods for multi-channel speech enhancement/separation are mostly discriminative and are highly…

音频与语音处理 · 电气工程与系统科学 2026-03-27 Zhongweiyang Xu , Ashutosh Pandey , Juan Azcarreta , Zhaoheng Ni , Sanjeel Parekh , Buye Xu , Romit Roy Choudhury

It is promising to design a single model that can suppress various distortions and improve speech quality, i.e., universal speech enhancement (USE). Compared to supervised learning-based predictive methods, diffusion-based generative models…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Jie Zhang , Haoyin Yan , Xiaofei Li

Diffusion-based speech enhancement (SE) achieves natural-sounding speech and strong generalization, yet suffers from key limitations like generative artifacts and high inference latency. In this work, we systematically study artifact…

Remote sensing semantic segmentation must address both what the ground objects are within an image and where they are located. Consequently, segmentation models must ensure not only the semantic correctness of large-scale patches…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Hao Wang , Keyan Hu , Xin Guo , Haifeng Li , Chao Tao

Real-world audio recordings often contain multiple speakers and various degradations, which limit both the quantity and quality of speech data available for building state-of-the-art speech processing models. Although end-to-end approaches…

声音 · 计算机科学 2026-01-27 Kohei Asai , Wataru Nakata , Yuki Saito , Hiroshi Saruwatari

This paper proposes SEFGAN, a Deep Neural Network (DNN) combining maximum likelihood training and Generative Adversarial Networks (GANs) for efficient speech enhancement (SE). For this, a DNN is trained to synthesize the enhanced speech…

音频与语音处理 · 电气工程与系统科学 2023-12-05 Martin Strauss , Nicola Pia , Nagashree K. S. Rao , Bernd Edler

Diffusion models are a class of generative models that have been recently used for speech enhancement with remarkable success but are computationally expensive at inference time. Therefore, these models are impractical for processing…

音频与语音处理 · 电气工程与系统科学 2025-09-15 Bunlong Lay , Rostislav Makarov , Timo Gerkmann

Speech super-resolution (SR) is the task that restores high-resolution speech from low-resolution input. Existing models employ simulated data and constrained experimental settings, which limit generalization to real-world SR. Predictive…

音频与语音处理 · 电气工程与系统科学 2024-01-26 Heming Wang , Eric W. Healy , DeLiang Wang

Generative speech enhancement has recently shown promising advancements in improving speech quality in noisy environments. Multiple diffusion-based frameworks exist, each employing distinct training objectives and learning techniques. This…

音频与语音处理 · 电气工程与系统科学 2025-01-22 Julius Richter , Danilo de Oliveira , Timo Gerkmann