中文
相关论文

相关论文: Schr\"odinger Bridge for Generative Speech Enhance…

200 篇论文

Recently, score-based generative models have been successfully employed for the task of speech enhancement. A stochastic differential equation is used to model the iterative forward process, where at each step environmental noise and white…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Bunlong Lay , Simon Welker , Julius Richter , Timo Gerkmann

Current flow-based generative speech enhancement methods learn curved probability paths which model a mapping between clean and noisy speech. Despite impressive performance, the implications of curved probability paths are unknown. Methods…

声音 · 计算机科学 2025-08-29 Mattias Cross , Anton Ragni

We propose SE-Bridge, a novel method for speech enhancement (SE). After recently applying the diffusion models to speech enhancement, we can achieve speech enhancement by solving a stochastic differential equation (SDE). Each SDE…

声音 · 计算机科学 2023-05-24 Zhibin Qiu , Mengfan Fu , Fuchun Sun , Gulila Altenbek , Hao Huang

The dynamic Schr\"odinger bridge problem seeks a stochastic process that defines a transport between two target probability measures, while optimally satisfying the criteria of being closest, in terms of Kullback-Leibler divergence, to a…

机器学习 · 统计学 2023-12-25 Stefano Peluchetti

Recently, a series of papers proposed deep learning-based approaches to sample from target distributions using controlled diffusion processes, being trained only on the unnormalized target densities without access to samples. Building on…

机器学习 · 计算机科学 2024-05-24 Lorenz Richter , Julius Berner

The Schrodinger Bridge and Bass (SBB) formulation, which jointly controls drift and volatility, is an established extension of the classical Schrodinger Bridge (SB). Building on this framework, we introduce LightSBB-M, an algorithm that…

Diffusion models are a class of generative models that have been recently used for speech enhancement with remarkable success but are computationally expensive at inference time. Therefore, these models are impractical for processing…

音频与语音处理 · 电气工程与系统科学 2025-09-15 Bunlong Lay , Rostislav Makarov , Timo Gerkmann

Online Speech Enhancement was mainly reserved for predictive models. A key advantage of these models is that for an incoming signal frame from a stream of data, the model is called only once for enhancement. In contrast, generative Speech…

音频与语音处理 · 电气工程与系统科学 2025-10-22 Bunlong Lay , Rostislav Makarov , Simon Welker , Maris Hillemann , Timo Gerkmann

Score-based generative models (SGMs) have recently shown impressive results for difficult generative tasks such as the unconditional and conditional generation of natural images and audio signals. In this work, we extend these models to the…

音频与语音处理 · 电气工程与系统科学 2022-07-08 Simon Welker , Julius Richter , Timo Gerkmann

The Schr\"odinger Bridge (SB) problem offers a powerful framework for combining optimal transport and diffusion models. A promising recent approach to solve the SB problem is the Iterative Markovian Fitting (IMF) procedure, which alternates…

机器学习 · 计算机科学 2024-11-06 Nikita Gushchin , Daniil Selikhanovych , Sergei Kholkin , Evgeny Burnaev , Alexander Korotin

Speech enhancement has seen great improvement in recent years mainly through contributions in denoising, speaker separation, and dereverberation methods that mostly deal with environmental effects on vocal audio. To enhance speech beyond…

声音 · 计算机科学 2021-02-02 Adam Polyak , Lior Wolf , Yossi Adi , Ori Kabeli , Yaniv Taigman

Diffusion models (DMs), which enable both image generation from noise and inversion from data, have inspired powerful unpaired image-to-image (I2I) translation algorithms. However, they often require a larger number of neural function…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Jeongsol Kim , Beomsu Kim , Jong Chul Ye

Speech super-resolution (SR) is the task that restores high-resolution speech from low-resolution input. Existing models employ simulated data and constrained experimental settings, which limit generalization to real-world SR. Predictive…

音频与语音处理 · 电气工程与系统科学 2024-01-26 Heming Wang , Eric W. Healy , DeLiang Wang

Although deep neural network (DNN)-based speech enhancement (SE) methods outperform the previous non-DNN-based ones, they often degrade the perceptual quality of generated outputs. To tackle this problem, we introduce a DNN-based generative…

音频与语音处理 · 电气工程与系统科学 2023-08-31 Ryosuke Sawata , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Takashi Shibuya , Shusuke Takahashi , Yuki Mitsufuji

Diffusion-based generative models have recently gained attention in speech enhancement (SE), providing an alternative to conventional supervised methods. These models transform clean speech training samples into Gaussian noise centered at…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Jean-Eudes Ayilo , Mostafa Sadeghi , Romain Serizel

We propose Image-to-Image Schr\"odinger Bridge (I$^2$SB), a new class of conditional diffusion models that directly learn the nonlinear diffusion processes between two given distributions. These diffusion bridges are particularly useful for…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Guan-Horng Liu , Arash Vahdat , De-An Huang , Evangelos A. Theodorou , Weili Nie , Anima Anandkumar

Diffusion models have shown a great ability at bridging the performance gap between predictive and generative approaches for speech enhancement. We have shown that they may even outperform their predictive counterparts for non-additive…

音频与语音处理 · 电气工程与系统科学 2024-03-13 Jean-Marie Lemercier , Julius Richter , Simon Welker , Timo Gerkmann

With the advancements in deep learning approaches, the performance of speech enhancing systems in the presence of background noise have shown significant improvements. However, improving the system's robustness against reverberation is…

音频与语音处理 · 电气工程与系统科学 2022-11-24 Vinay Kothapally , J. H. L. Hansen

We propose to implement speech enhancement by the regeneration of clean speech from a salient representation extracted from the noisy signal. The network that extracts salient features is trained using a set of weight-sharing clones of the…

音频与语音处理 · 电气工程与系统科学 2019-09-12 Michael Chinen , W. Bastiaan Kleijn , Felicia S. C. Lim , Jan Skoglund

The Schr\"odinger bridge problem (SBP) is gaining increasing attention in generative modeling and showing promising potential even in comparison with the score-based generative models (SGMs). SBP can be interpreted as an entropy-regularized…