English
Related papers

Related papers: WaveFlow: A Compact Flow-based Model for Raw Audio

200 papers

Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the reconstructed signal. However, most existing methods directly…

Sound · Computer Science 2026-04-13 Fei Liu , Yang Ai , Hui-Peng Du , Yu-Fei Shi , Zhen-Hua Ling

MeanFlow (MF) is a diffusion-motivated generative model that enables efficient few-step generation by learning long jumps directly from noise to data. In practice, it is often used as a latent MF by leveraging the pre-trained Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zheyuan Hu , Chieh-Hsin Lai , Ge Wu , Yuki Mitsufuji , Stefano Ermon

We propose a framework using normalizing-flow based models, SELF-Referencing Embedded Strings, and multi-objective optimization that efficiently generates small molecules. With an initial training set of only 100 small molecules, FastFlows…

Chemical Physics · Physics 2022-02-01 Nathan C. Frey , Vijay Gadepally , Bharath Ramsundar

Speech enhancement involves the distinction of a target speech signal from an intrusive background. Although generative approaches using Variational Autoencoders or Generative Adversarial Networks (GANs) have increasingly been used in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Martin Strauss , Bernd Edler

We present PixelFlow, a family of image generation models that operate directly in the raw pixel space, in contrast to the predominant latent-space models. This approach simplifies the image generation process by eliminating the need for a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Shoufa Chen , Chongjian Ge , Shilong Zhang , Peize Sun , Ping Luo

Flow-based generative models have greatly improved text-to-speech (TTS) synthesis quality, but inference speed remains limited by the iterative sampling process and multiple function evaluations (NFE). The recent MeanFlow model accelerates…

Sound · Computer Science 2025-10-10 Wei Wang , Rong Cao , Yi Guo , Zhengyang Chen , Kuan Chen , Yuanyuan Huo

Generative modelling of entire CT volumes conditioned on clinical reports has the potential to accelerate research through data augmentation, privacy-preserving synthesis and reducing regulator-constraints on patient data while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jiayi Wang , Hadrien Reynaud , Franciskus Xaverius Erick , Bernhard Kainz

Building efficient and effective generative models for neural network weights has been a research focus of significant interest that faces challenges posed by the high-dimensional weight spaces of modern neural networks and their…

Machine Learning · Computer Science 2026-05-01 Saumya Gupta , Scott Biggs , Moritz Laber , Zohair Shafi , Robin Walters , Ayan Paul

An emerging trend in audio processing is capturing low-level speech representations from raw waveforms. These representations have shown promising results on a variety of tasks, such as speech recognition and speech separation. Compared to…

Sound · Computer Science 2021-09-08 Zhongwei Teng , Quchen Fu , Jules White , Maria Powell , Douglas C. Schmidt

In this paper, we present a vocoder-free framework for audio super-resolution that employs a flow matching generative model to capture the conditional distribution of complex-valued spectral coefficients. Unlike conventional two-stage…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Woongjib Choi , Sangmin Lee , Hyungseob Lim , Hong-Goo Kang

Flow maps enable high-quality image generation in a single forward pass. However, unlike iterative diffusion models, their lack of an explicit sampling trajectory impedes incorporating external constraints for conditional generation and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Abbas Mammadov , So Takao , Bohan Chen , Ricardo Baptista , Morteza Mardani , Yee Whye Teh , Julius Berner

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Generating long, high-quality videos remains a challenge due to the complex interplay of spatial and temporal dynamics and hardware limitations. In this work, we introduce MaskFlow, a unified video generation framework that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Michael Fuest , Vincent Tao Hu , Björn Ommer

Modeling and synthesizing image noise is an important aspect in many computer vision applications. The long-standing additive white Gaussian and heteroscedastic (signal-dependent) noise models widely used in the literature provide only a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Abdelrahman Abdelhamed , Marcus A. Brubaker , Michael S. Brown

In recent years, speaker recognition systems based on raw waveform inputs have received increasing attention. However, the performance of such systems are typically inferior to the state-of-the-art handcrafted feature-based counterparts,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Jee-weon Jung , You Jin Kim , Hee-Soo Heo , Bong-Jin Lee , Youngki Kwon , Joon Son Chung

Immersive spatial audio has become increasingly critical for applications ranging from AR/VR to home entertainment and automotive sound systems. However, existing generative methods remain constrained to low-dimensional formats such as…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Zining Liang , Runbang Wang , Xuzhou Ye , Qiuqiang Kong

We present VoiceRestore, a novel approach to restoring the quality of speech recordings using flow-matching Transformers trained in a self-supervised manner on synthetic data. Our method tackles a wide range of degradations frequently found…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Stanislav Kirdey

Developing architectures suitable for modeling raw audio is a challenging problem due to the high sampling rates of audio waveforms. Standard sequence modeling approaches like RNNs and CNNs have previously been tailored to fit the demands…

Sound · Computer Science 2022-02-22 Karan Goel , Albert Gu , Chris Donahue , Christopher Ré

In recent years, diffusion-based generative models have demonstrated remarkable performance in speech conversion, including Denoising Diffusion Probabilistic Models (DDPM) and others. However, the advantages of these models come at the cost…

Sound · Computer Science 2025-06-03 Pengyu Ren , Wenhao Guan , Kaidi Wang , Peijie Chen , Qingyang Hong , Lin Li

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon