English
Related papers

Related papers: SpecGrad: Diffusion Probabilistic Model based Neur…

200 papers

This paper presents a neural vocoder based on a denoising diffusion probabilistic model (DDPM) incorporating explicit periodic signals as auxiliary conditioning signals. Recently, DDPM-based neural vocoders have gained prominence as…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Yukiya Hono , Kei Hashimoto , Yoshihiko Nankaku , Keiichi Tokuda

Denoising diffusion probabilistic models have been recently proposed to generate high-quality samples by estimating the gradient of the data density. The framework defines the prior noise as a standard Gaussian distribution, whereas the…

Machine Learning · Statistics 2022-02-22 Sang-gil Lee , Heeseung Kim , Chaehun Shin , Xu Tan , Chang Liu , Qi Meng , Tao Qin , Wei Chen , Sungroh Yoon , Tie-Yan Liu

Denoising diffusion probabilistic models (diffusion models for short) require a large number of iterations in inference to achieve the generation quality that matches or surpasses the state-of-the-art generative models, which invariably…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-10 Zehua Chen , Xu Tan , Ke Wang , Shifeng Pan , Danilo Mandic , Lei He , Sheng Zhao

Denoising diffusion probabilistic models (DDPMs) can be utilized to recover a clean signal from its degraded observation(s) by conditioning the model on the degraded signal. The degraded signals are themselves contaminated versions of the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Ching-Hua Lee , Chouchang Yang , Jaejin Cho , Yashas Malur Saidutta , Rakshith Sharma Srinivasa , Yilin Shen , Hongxia Jin

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

Computation and Language · Computer Science 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

There are many deterministic mathematical operations (e.g. compression, clipping, downsampling) that degrade speech quality considerably. In this paper we introduce a neural network architecture, based on a modification of the DiffWave…

Sound · Computer Science 2021-09-03 Jianwei Zhang , Suren Jayasuriya , Visar Berisha

This paper addresses the challenge of enhancing the realism of vocoder-generated singing voice audio by mitigating the distinguishable disparities between synthetic and real-life recordings, particularly in high-frequency spectrogram…

Sound · Computer Science 2025-08-05 Runxuan Yang , Kai Li , Guo Chen , Xiaolin Hu

Denoising Diffusion Probabilistic Models (DDPMs) are emerging in text-to-speech (TTS) synthesis because of their strong capability of generating high-fidelity samples. However, their iterative refinement process in high-dimensional data…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-02 Zehua Chen , Yihan Wu , Yichong Leng , Jiawei Chen , Haohe Liu , Xu Tan , Yang Cui , Ke Wang , Lei He , Sheng Zhao , Jiang Bian , Danilo Mandic

With the development of deep learning, speech enhancement has been greatly optimized in terms of speech quality. Previous methods typically focus on the discriminative supervised learning or generative modeling, which tends to introduce…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-31 Nan Xu , Zhaolong Huang , Xiaonan Zhi

Recently, denoising diffusion probabilistic models and generative score matching have shown high potential in modelling complex data distributions while stochastic calculus has provided a unified point of view on these techniques allowing…

Machine Learning · Computer Science 2021-08-06 Vadim Popov , Ivan Vovk , Vladimir Gogoryan , Tasnima Sadekova , Mikhail Kudinov

Ultrasound images are widespread in medical diagnosis for musculoskeletal, cardiac, and obstetrical imaging due to the efficiency and non-invasiveness of the acquisition methodology. However, the acquired images are degraded by acoustic…

Image and Video Processing · Electrical Eng. & Systems 2023-06-14 Hojat Asgariandehkordi , Sobhan Goudarzi , Adrian Basarab , Hassan Rivaz

Diffusion models have recently been shown to be relevant for high-quality speech generation. Most work has been focused on generating spectrograms, and as such, they further require a subsequent model to convert the spectrogram to a…

Sound · Computer Science 2024-03-12 Roi Benita , Michael Elad , Joseph Keshet

Reconstructing the sound field in a room is an important task for several applications, such as sound control and augmented (AR) or virtual reality (VR). In this paper, we propose a data-driven generative model for reconstructing the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-22 Federico Miotello , Luca Comanducci , Mirco Pezzoli , Alberto Bernardini , Fabio Antonacci , Augusto Sarti

Recent advances in neural text-to-speech (TTS) models bring thousands of TTS applications into daily life, where models are deployed in cloud to provide services for customs. Among these models are diffusion probabilistic models (DPMs),…

Sound · Computer Science 2023-09-01 Jie Chen , Xingchen Song , Zhendong Peng , Binbin Zhang , Fuping Pan , Zhiyong Wu

Voice conversion is a method that allows for the transformation of speaking style while maintaining the integrity of linguistic information. There are many researchers using deep generative models for voice conversion tasks. Generative…

Sound · Computer Science 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Previously, we introduced VoiceGrad, a nonparallel voice conversion (VC) technique enabling mel-spectrogram conversion from source to target speakers using a score-based diffusion model. The concept involves training a score network to…

Sound · Computer Science 2025-09-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Yuto Kondo

Diffusion models have recently set new benchmarks in Speech Enhancement (SE). However, most existing score-based models treat speech spectrograms merely as generic 2D images, applying uniform processing that ignores the intrinsic structural…

Sound · Computer Science 2026-02-03 Ke Xue , Rongfei Fan , Kai Li , Shanping Yu , Puning Zhao , Jianping An

Flow matching offers a robust and stable approach to training diffusion models. However, directly applying flow matching to neural vocoders can result in subpar audio quality. In this work, we present WaveFM, a reparameterized flow matching…

Sound · Computer Science 2025-03-24 Tianze Luo , Xingchen Miao , Wenbo Duan

Generative adversarial network (GAN) models can synthesize highquality audio signals while ensuring fast sample generation. However, they are difficult to train and are prone to several issues including mode collapse and divergence. In this…

Sound · Computer Science 2024-02-06 Teysir Baoueb , Haocheng Liu , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

Denoising diffusion probabilistic models (DDPMs) are a recent family of generative models that achieve state-of-the-art results. In order to obtain class-conditional generation, it was suggested to guide the diffusion process by gradients…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bahjat Kawar , Roy Ganz , Michael Elad
‹ Prev 1 2 3 10 Next ›