English
Related papers

Related papers: Voice Conversion with Denoising Diffusion Probabil…

200 papers

The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a…

Sound · Computer Science 2020-06-16 Andong Li , Chengshi Zheng , Renhua Peng , Cunhang Fan , Xiaodong Li

Generative Adversarial Networks (GANs) are a promising approach for text generation that, unlike traditional language models (LM), does not suffer from the problem of ``exposure bias''. However, A major hurdle for understanding the…

Computation and Language · Computer Science 2019-03-26 Guy Tevet , Gavriel Habib , Vered Shwartz , Jonathan Berant

Voice conversion is the task of converting a spoken utterance from a source speaker so that it appears to be said by a different target speaker while retaining the linguistic content of the utterance. Recent advances have led to major…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-02 Matthew Baas , Herman Kamper

The problem of audio synthesis has been increasingly solved using deep neural networks. With the introduction of Generative Adversarial Networks (GAN), another efficient and adjective path has opened up to solve this problem. In this paper,…

Sound · Computer Science 2021-02-23 Shreeviknesh Sankaran , Sukavanan Nanjundan , G. Paavai Anand

Generative audio technologies now enable highly realistic voice cloning and real-time voice conversion, increasing the risk of impersonation, fraud, and misinformation in communication channels such as phone and video calls. This study…

Sound · Computer Science 2026-01-09 Prajwal Chinchmalatpure , Suyash Chinchmalatpure , Siddharth Chavan

Building a voice conversion system for noisy target speakers, such as users providing noisy samples or Internet found data, is a challenging task since the use of contaminated speech in model training will apparently degrade the conversion…

Sound · Computer Science 2022-07-05 Liumeng Xue , Shan Yang , Na Hu , Dan Su , Lei Xie

Diffusion models are a state-of-the-art generative modeling framework that transform noise to images via Langevin sampling, guided by the score, which is the gradient of the logarithm of the data distribution. Recent works have shown…

Machine Learning · Computer Science 2025-08-01 Aadithya Srikanth , Siddarth Asokan , Nishanth Shetty , Chandra Sekhar Seelamantula

Automatic speech recognition (ASR) systems are of vital importance nowadays in commonplace tasks such as speech-to-text processing and language translation. This created the need for an ASR system that can operate in realistic crowded…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Sherif Abdulatif , Karim Armanious , Karim Guirguis , Jayasankar T. Sajeev , Bin Yang

Deep learning has become a standard approach for the modeling of audio effects, yet strictly black-box modeling remains problematic for time-varying systems. Unlike time-invariant effects, training models on devices with internal modulation…

Sound · Computer Science 2025-12-18 Yann Bourdin , Pierrick Legrand , Fanny Roche

We introduce EffiFusion-GAN (Efficient Fusion Generative Adversarial Network), a lightweight yet powerful model for speech enhancement. The model integrates depthwise separable convolutions within a multi-scale block to capture diverse…

Sound · Computer Science 2025-08-21 Bin Wen , Tien-Ping Tan

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

Generative Adversarial Network (GAN) and its variants have recently attracted intensive research interests due to their elegant theoretical foundation and excellent empirical performance as generative models. These tools provide a promising…

Machine Learning · Computer Science 2018-02-20 Liyang Xie , Kaixiang Lin , Shu Wang , Fei Wang , Jiayu Zhou

Influenced by the field of Computer Vision, Generative Adversarial Networks (GANs) are often adopted for the audio domain using fixed-size two-dimensional spectrogram representations as the "image data". However, in the (musical) audio…

Sound · Computer Science 2021-08-02 Javier Nistal , Cyran Aouameur , Stefan Lattner , Gaël Richard

Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model…

Computation and Language · Computer Science 2018-08-22 Jingjing Xu , Xuancheng Ren , Junyang Lin , Xu Sun

Diffusion models have emerged as a popular family of deep generative models (DGMs). In the literature, it has been claimed that one class of diffusion models -- denoising diffusion probabilistic models (DDPMs) -- demonstrate superior image…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Rucha Deshpande , Muzaffer Özbey , Hua Li , Mark A. Anastasio , Frank J. Brooks

In recent years, deep generative models, such as Generative Adversarial Network (GAN), has grabbed significant attention in the field of computer vision. This project focuses on the application of GAN in image deblurring with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zhengdong Li

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

Generative Adversarial Networks (GANs) dominate the research field in image-based virtual try-on, but have not resolved problems such as unnatural deformation of garments and the blurry generation quality. While the generative quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Jianhao Zeng , Dan Song , Weizhi Nie , Hongshuo Tian , Tongtong Wang , Anan Liu