English
Related papers

Related papers: EVA-GAN: Enhanced Various Audio Generation via Sca…

200 papers

The advancement of generative AI, particularly in medical imaging, confronts the trilemma of ensuring high fidelity, diversity, and efficiency in synthetic data generation. While Generative Adversarial Networks (GANs) have shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lorenzo Tronchin , Tommy Löfstedt , Paolo Soda , Valerio Guarrasi

Vibrometry-based side channels pose a significant privacy risk, exploiting sensors like mmWave radars, light sensors, and accelerometers to detect vibrations from sound sources or proximate objects, enabling speech eavesdropping. Despite…

Cryptography and Security · Computer Science 2025-04-11 Jung-Woo Chang , Ke Sun , David Xia , Xinyu Zhang , Farinaz Koushanfar

Generative adversarial network (GAN)-based neural vocoders have been widely used in audio synthesis tasks due to their high generation quality, efficient inference, and small computation footprint. However, it is still challenging to train…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Sipan Li , Songxiang Liu , Luwen Zhang , Xiang Li , Yanyao Bian , Chao Weng , Zhiyong Wu , Helen Meng

Problem: There is a lack of big data for the training of deep learning models in medicine, characterized by the time cost of data collection and privacy concerns. Generative adversarial networks (GANs) offer both the potential to generate…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Ethan Schonfeld , Anand Veeravagu

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

We previously proposed a method that allows for nonparallel voice conversion (VC) by using a variant of generative adversarial networks (GANs) called StarGAN. The main features of our method, called StarGAN-VC, are as follows: First, it…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Generative Adversarial Networks (GAN) are generative neural networks which can be trained to implicitly model the…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst

Generative models are successfully used for image synthesis in the recent years. But when it comes to other modalities like audio, text etc little progress has been made. Recent works focus on generating audio from a generative model in an…

Computer Vision and Pattern Recognition · Computer Science 2018-09-30 Chae Young Lee , Anoop Toffy , Gue Jun Jung , Woo-Jin Han

Obtaining data to train robust artificial intelligence (AI)-based models for species classification can be challenging, particularly for rare species. Data augmentation can boost classification accuracy by increasing the diversity of…

Sound · Computer Science 2025-12-16 Anthony Gibbons , Emma King , Ian Donohue , Andrew Parnell

State-of-the-art under-determined audio source separation systems rely on supervised end-end training of carefully tailored neural network architectures operating either in the time or the spectral domain. However, these methods are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-29 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Rushil Anirudh , Andreas Spanias

Deep learning based visual to sound generation systems essentially need to be developed particularly considering the synchronicity aspects of visual and audio features with time. In this research we introduce a novel task of guiding a class…

Machine Learning · Computer Science 2021-07-21 Sanchita Ghose , John J. Prevost

The intelligibility of natural speech is seriously degraded when exposed to adverse noisy environments. In this work, we propose a deep learning-based speech modification method to compensate for the intelligibility loss, with the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Haoyu Li , Szu-Wei Fu , Yu Tsao , Junichi Yamagishi

Deep generative models such as Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), Diffusion Models, and Transformers, have shown great promise in a variety of applications, including image and speech synthesis, natural…

Machine Learning · Computer Science 2025-11-18 Lyle Regenwetter , Akash Srivastava , Dan Gutfreund , Faez Ahmed

Deep latent variable generative models based on variational autoencoder (VAE) have shown promising performance for audiovisual speech enhancement (AVSE). The underlying idea is to learn a VAEbased audiovisual prior distribution for clean…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Ali Golmakani , Mostafa Sadeghi , Romain Serizel

Speech synthesis is an important practical generative modeling problem that has seen great progress over the last few years, with likelihood-based autoregressive neural models now outperforming traditional concatenative systems. A downside…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Alexey A. Gritsenko , Tim Salimans , Rianne van den Berg , Jasper Snoek , Nal Kalchbrenner

Producing a large annotated speech corpus for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced, but collecting a relatively big unlabeled data set for such languages is more…

Computation and Language · Computer Science 2019-08-26 Kuan-Yu Chen , Che-Ping Tsai , Da-Rong Liu , Hung-Yi Lee , Lin-shan Lee

Electroencephalography (EEG) plays a vital role in recording brain activities and is integral to the development of brain-computer interface (BCI) technologies. However, the limited availability and high variability of EEG signals present…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Joshua Park , Priyanshu Mahey , Ore Adeniyi

Generative adversarial networks (GANs) are one of the most widely used generative models. GANs can learn complex multi-modal distributions, and generate real-like samples. Despite the major success of GANs in generating synthetic data, they…

Machine Learning · Computer Science 2021-09-07 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

Recent work in synthetic data generation in the time-series domain has focused on the use of Generative Adversarial Networks. We propose a novel architecture for synthetically generating time-series data with the use of Variational…

Machine Learning · Computer Science 2021-12-08 Abhyuday Desai , Cynthia Freeman , Zuhui Wang , Ian Beaver