English
Related papers

Related papers: Subband-based Generative Adversarial Network for N…

200 papers

Domain adaptation plays an important role for speech recognition models, in particular, for domains that have low resources. We propose a novel generative model based on cyclic-consistent generative adversarial network (CycleGAN) for…

Computation and Language · Computer Science 2018-07-11 Ehsan Hosseini-Asl , Yingbo Zhou , Caiming Xiong , Richard Socher

We propose a learning-based filter that allows us to directly modify a synthetic speech waveform into a natural speech waveform. Speech-processing systems using a vocoder framework such as statistical parametric speech synthesis and voice…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-02 Kou Tanaka , Takuhiro Kaneko , Nobukatsu Hojo , Hirokazu Kameoka

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

Adversarial waveform generation has been a popular approach as the backend of singing voice conversion (SVC) to generate high-quality singing audio. However, the instability of GAN also leads to other problems, such as pitch jitters and U/V…

Sound · Computer Science 2022-01-26 Haohan Guo , Zhiping Zhou , Fanbo Meng , Kai Liu

Voice conversion is a challenging task which transforms the voice characteristics of a source speaker to a target speaker without changing linguistic content. Recently, there have been many works on many-to-many Voice Conversion (VC) based…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Manh Luong , Viet Anh Tran

We present a Cycle-GAN based many-to-many voice conversion method that can convert between speakers that are not in the training set. This property is enabled through speaker embeddings generated by a neural network that is jointly trained…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-08 Gokce Keskin , Tyler Lee , Cory Stephenson , Oguz H. Elibol

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

Non-parallel many-to-many voice conversion, as well as zero-shot voice conversion, remain under-explored areas. Deep style transfer algorithms, such as generative adversarial networks (GAN) and conditional variational autoencoder (CVAE),…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-07 Kaizhi Qian , Yang Zhang , Shiyu Chang , Xuesong Yang , Mark Hasegawa-Johnson

The state-of-the-art in text-to-speech synthesis has recently improved considerably due to novel neural waveform generation methods, such as WaveNet. However, these methods suffer from their slow sequential inference process, while their…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

Voice conversion (VC) modifies voice characteristics while preserving linguistic content. This paper presents the Stepback network, a novel model for converting speaker identity using non-parallel data. Unlike traditional VC methods that…

Sound · Computer Science 2025-01-28 Qian Yang , Calbert Graham

This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are from the source or…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Gautam Bhattacharya , Joao Monteiro , Jahangir Alam , Patrick Kenny

This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguistic representations while a synthesizer recovers output…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

In recent years, large-scale pre-trained speech language models (SLMs) have demonstrated remarkable advancements in various generative speech modeling applications, such as text-to-speech synthesis, voice conversion, and speech enhancement.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-19 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Generative adversarial networks (GANs) are a powerful framework for generative tasks. However, they are difficult to train and tend to miss modes of the true data generation process. Although GANs can learn a rich representation of the…

Machine Learning · Computer Science 2017-11-27 Robin Winter , Djork-Arné Clevert

SCONE-GAN presents an end-to-end image translation, which is shown to be effective for learning to generate realistic and diverse scenery images. Most current image-to-image translation approaches are devised as two mappings: a translation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Iman Abbasnejad , Fabio Zambetta , Flora Salim , Timothy Wiley , Jeffrey Chan , Russell Gallagher , Ehsan Abbasnejad

Influenced by the field of Computer Vision, Generative Adversarial Networks (GANs) are often adopted for the audio domain using fixed-size two-dimensional spectrogram representations as the "image data". However, in the (musical) audio…

Sound · Computer Science 2021-08-02 Javier Nistal , Cyran Aouameur , Stefan Lattner , Gaël Richard

Neural vocoders based on the generative adversarial neural network (GAN) have been widely used due to their fast inference speed and lightweight networks while generating high-quality speech waveforms. Since the perceptually important…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-04 Taejun Bak , Junmo Lee , Hanbin Bae , Jinhyeok Yang , Jae-Sung Bae , Young-Sun Joo

Non-parallel voice conversion (VC) is a technique for learning mappings between source and target speeches without using a parallel corpus. Recently, cycle-consistent adversarial network (CycleGAN)-VC and CycleGAN-VC2 have shown promising…

Sound · Computer Science 2020-10-23 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

While generative adversarial networks (GANs) based neural text-to-speech (TTS) systems have shown significant improvement in neural speech synthesis, there is no TTS system to learn to synthesize speech from text sequences with only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-15 Sang-Hoon Lee , Hyun-Wook Yoon , Hyeong-Rae Noh , Ji-Hoon Kim , Seong-Whan Lee