English
Related papers

Related papers: Target matching based generative model for speech …

200 papers

Dynamical generative models that produce samples through an iterative process, such as Flow Matching and denoising diffusion models, have seen widespread use, but there have not been many theoretically-sound methods for improving these…

Machine Learning · Computer Science 2025-01-08 Carles Domingo-Enrich , Michal Drozdzal , Brian Karrer , Ricky T. Q. Chen

Data augmentation is a valuable tool for the design of deep learning systems to overcome data limitations and stabilize the training process. Especially in the medical domain, where the collection of large-scale data sets is challenging and…

Machine Learning · Computer Science 2025-02-11 Mane Margaryan , Matthias Seibold , Indu Joshi , Mazda Farshad , Philipp Fürnstahl , Nassir Navab

Generative adversarial networks have recently demonstrated outstanding performance in neural vocoding outperforming best autoregressive and flow-based models. In this paper, we show that this success can be extended to other tasks of…

Sound · Computer Science 2023-12-12 Pavel Andreev , Aibek Alanov , Oleg Ivanov , Dmitry Vetrov

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Huijie Zhang , Yifu Lu , Ismail Alkhouri , Saiprasad Ravishankar , Dogyoon Song , Qing Qu

Diffusion models, which iteratively denoise data samples to synthesize high-quality outputs, have achieved empirical success across domains. However, optimizing these models for downstream tasks often involves nested bilevel structures,…

Machine Learning · Computer Science 2025-08-06 Quan Xiao , Hui Yuan , A F M Saif , Gaowen Liu , Ramana Kompella , Mengdi Wang , Tianyi Chen

State of the art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Mingchi Hou , Ante Jukic , Ina Kodrasi

Machine learning-based unfolding has enabled unbinned and high-dimensional differential cross section measurements. Two main approaches have emerged in this research area: one based on discriminative models and one based on generative…

High Energy Physics - Phenomenology · Physics 2026-03-27 Sascha Diefenbacher , Guan-Horng Liu , Vinicius Mikuni , Benjamin Nachman , Weili Nie

Enhancing speech quality under adverse SNR conditions remains a significant challenge for discriminative deep neural network (DNN)-based approaches. In this work, we propose DisCoGAN, which is a time-frequency-domain generative adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Score-based stochastic denoising models have recently been demonstrated as powerful machine learning tools for conditional and unconditional image generation. The existing methods are based on a forward stochastic process wherein the…

Generative modeling of graphs with spatial structure is essential across many applications from computer graphics to spatial genomics. Recent flow-based generative models have achieved impressive results by gradually adding and then…

Machine Learning · Computer Science 2025-07-15 Peter Pao-Huang , Mitchell Black , Xiaojie Qiu

Diffusion models have emerged as powerful deep generative techniques, producing high-quality and diverse samples in applications in various domains including audio. While existing reviews provide overviews, there remains limited in-depth…

Sound · Computer Science 2026-01-16 Ge Zhu , Yutong Wen , Zhiyao Duan

We propose DiffSep, a new single channel source separation method based on score-matching of a stochastic differential equation (SDE). We craft a tailored continuous time diffusion-mixing process starting from the separated sources and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Robin Scheibler , Youna Ji , Soo-Whan Chung , Jaeuk Byun , Soyeon Choe , Min-Seok Choi

We propose a novel generative model for time series based on Schr{\"o}dinger bridge (SB) approach. This consists in the entropic interpolation via optimal transport between a reference probability measure on path space and a target measure…

Optimization and Control · Mathematics 2023-04-12 Mohamed Hamdouche , Pierre Henry-Labordere , Huyên Pham

The speech enhancement task usually consists of removing additive noise or reverberation that partially mask spoken utterances, affecting their intelligibility. However, little attention is drawn to other, perhaps more aggressive signal…

Sound · Computer Science 2019-04-09 Santiago Pascual , Joan Serrà , Antonio Bonafonte

In this paper, we investigate a deep learning approach for speech denoising through an efficient ensemble of specialist neural networks. By splitting up the speech denoising task into non-overlapping subproblems and introducing a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Aswin Sivaraman , Minje Kim

Recently developed deep neural models like NetGAN, CELL, and Variational Graph Autoencoders have made progress but face limitations in replicating key graph statistics on generating large graphs. Diffusion-based methods have emerged as…

Machine Learning · Computer Science 2023-10-31 Mingyang Wu , Xiaohui Chen , Li-Ping Liu

We address speech enhancement based on variational autoencoders, which involves learning a speech prior distribution in the time-frequency (TF) domain. A zero-mean complex-valued Gaussian distribution is usually assumed for the generative…

Sound · Computer Science 2023-10-27 Ali Golmakani , Mostafa Sadeghi , Xavier Alameda-Pineda , Romain Serizel

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While recent theory provides strong statistical guarantees, it typically relies on…

Machine Learning · Computer Science 2026-04-21 Yinbin Han , Meisam Razaviyayn , Renyuan Xu