English
Related papers

Related papers: Conditional Spoken Digit Generation with StyleGAN

200 papers

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

StyleGAN has demonstrated the ability of GANs to synthesize highly-realistic faces of imaginary people from random noise. One limitation of GAN-based image generation is the difficulty of controlling the features of the generated image, due…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Zhuo He , Paul Henderson , Nicolas Pugeault

Generative adversarial networks (GANs) have been remarkably successful in learning complex high dimensional real word distributions and generating realistic samples. However, they provide limited control over the generation process.…

Machine Learning · Computer Science 2020-10-27 Arunava Chakraborty , Rahul Ragesh , Mahir Shah , Nipun Kwatra

The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Dat Viet Thanh Nguyen , Phong Tran The , Tan M. Dinh , Cuong Pham , Anh Tuan Tran

Computer graphics has experienced a recent surge of data-centric approaches for photorealistic and controllable content creation. StyleGAN in particular sets new standards for generative modeling regarding image quality and controllability.…

Machine Learning · Computer Science 2022-05-06 Axel Sauer , Katja Schwarz , Andreas Geiger

While signal conversion and disentangled representation learning have shown promise for manipulating data attributes across domains such as audio, image, and multimodal generation, existing approaches, especially for speech style…

Sound · Computer Science 2025-10-10 Jonathan Svirsky , Ofir Lindenbaum , Uri Shaham

Image synthesis is currently one of the most addressed image processing topic in computer vision and deep learning fields of study. Researchers have tackled this problem focusing their efforts on its several challenging problems, e.g. image…

Machine Learning · Computer Science 2020-06-26 Tomaso Fontanini , Eleonora Iotti , Luca Donati , Andrea Prati

Current speech enhancement techniques operate on the spectral domain and/or exploit some higher-level feature. The majority of them tackle a limited number of noise conditions and rely on first-order statistics. To circumvent these issues,…

Machine Learning · Computer Science 2017-06-12 Santiago Pascual , Antonio Bonafonte , Joan Serrà

In recent years, generative adversarial networks (GANs) have made significant progress in generating audio sequences. However, these models typically rely on bandwidth-limited mel-spectrograms, which constrain the resolution of generated…

Sound · Computer Science 2025-05-15 Zeeshan Ahmad , Shudi Bao , Meng Chen

Disentanglement learning is crucial for obtaining disentangled representations and controllable generation. Current disentanglement methods face several inherent limitations: difficulty with high-resolution images, primarily focusing on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Weili Nie , Tero Karras , Animesh Garg , Shoubhik Debnath , Anjul Patney , Ankit B. Patel , Anima Anandkumar

Embodied agents, in the form of virtual agents or social robots, are rapidly becoming more widespread. In human-human interactions, humans use nonverbal behaviours to convey their attitudes, feelings, and intentions. Therefore, this…

Artificial Intelligence · Computer Science 2026-04-30 Carson Yu Liu , Gelareh Mohammadi , Yang Song , Wafa Johal

Neural network based approaches to speech enhancement have shown to be particularly powerful, being able to leverage a data-driven approach to result in a significant performance gain versus other approaches. Such approaches are reliant on…

Sound · Computer Science 2023-12-15 George Close , William Ravenscroft , Thomas Hain , Stefan Goetze

Recently, cycle-consistent adversarial network (Cycle-GAN) has been successfully applied to voice conversion to a different speaker without parallel data, although in those approaches an individual model is needed for each target speaker.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-26 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee , Lin-shan Lee

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

We consider the generative modeling of speech over multiple minutes, a requirement for long-form multimedia generation and audio-native voice assistants. However, textless spoken language models struggle to generate plausible speech past…

Computation and Language · Computer Science 2025-07-11 Se Jin Park , Julian Salazar , Aren Jansen , Keisuke Kinoshita , Yong Man Ro , RJ Skerry-Ryan

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

StyleGAN is known to produce high-fidelity images, while also offering unprecedented semantic editing. However, these fascinating abilities have been demonstrated only on a limited set of datasets, which are usually structurally aligned and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Ron Mokady , Michal Yarom , Omer Tov , Oran Lang , Daniel Cohen-Or , Tali Dekel , Michal Irani , Inbar Mosseri

Current child face generators are restricted by the limited size of the available datasets. In addition, feature selection can prove to be a significant challenge, especially due to the large amount of features that need to be trained for.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Sofie Daniels , Jiugeng Sun , Jiaqing Xie

Category text generation receives considerable attentions since it is beneficial for various natural language processing tasks. Recently, the generative adversarial network (GAN) has attained promising performance in text generation,…

Computation and Language · Computer Science 2023-08-03 Xinze Li , Kezhi Mao , Fanfan Lin , Zijian Feng

Image generation has rapidly evolved in recent years. Modern architectures for adversarial training allow to generate even high resolution images with remarkable quality. At the same time, more and more effort is dedicated towards…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Amrutha Saseendran , Kathrin Skubch , Margret Keuper