English
Related papers

Related papers: CRASH: Raw Audio Score-based Generative Modeling f…

200 papers

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

Recent advancements in diffusion-based models have demonstrated significant success in generating images from text. However, video editing models have not yet reached the same level of visual quality and user control. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ozgur Kara , Bariscan Kurtkaya , Hidir Yesiltepe , James M. Rehg , Pinar Yanardag

This work provides a solution to the challenge of small amounts of training data in Non-Destructive Ultrasonic Testing for composite components. It was demonstrated that direct simulation alone is ineffective at producing training data that…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Shaun McKnight , S. Gareth Pierce , Ehsan Mohseni , Christopher MacKinnon , Charles MacLeod , Tom OHare , Charalampos Loukas

In this work, we propose an approach to music source separation that uses a generative diffusion model as a last-stage refinement on top of a deterministic separator, progressively enhancing the separated sources through iterative…

Sound · Computer Science 2026-04-28 Tornike Karchkhadze , Mohammad Rasool Izadi , Shuo Zhang , Shlomo Dubnov

Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability…

Machine Learning · Computer Science 2023-10-11 Akhil Premkumar

This paper studies stable learning methods for generative models that enable high-quality data generation. Noise injection is commonly used to stabilize learning. However, selecting a suitable noise distribution is challenging.…

Machine Learning · Statistics 2024-10-29 Yoshitaka Koike , Takumi Nakagawa , Hiroki Waida , Takafumi Kanamori

Generating audio that is acoustically consistent with a scene is essential for immersive virtual environments. Recent neural acoustic field methods enable spatially continuous sound rendering but remain scene-specific, requiring dense audio…

Sound · Computer Science 2026-03-20 Amandine Brunetto

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

Recent generative methods for single-shot high dynamic range (HDR) image reconstruction show promising results, but often struggle with preserving fidelity to the input image. They require separate models to handle highlights and shadows,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Chinmay Talegaonkar , Jinshi He , Christopher McKenna , Nicholas Antipa

This study introduces a text-conditioned approach to generating drumbeats with Latent Diffusion Models (LDMs). It uses informative conditioning text extracted from training data filenames. By pretraining a text and drumbeat encoder through…

Sound · Computer Science 2024-08-07 Pushkar Jajoria , James McDermott

Diffusion models typically generate image batches from independent Gaussian initial noises. We argue that this independence assumption is only one choice within a broader class of valid joint noise designs. Instead, one can specify a…

Machine Learning · Computer Science 2026-05-13 Jing Jia , Liyue Shen , Guanyang Wang

Audio super-resolution is challenging owing to its ill-posed nature. Recently, the application of diffusion models in audio super-resolution has shown promising results in alleviating this challenge. However, diffusion-based models have…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-12 Jun-Hak Yun , Seung-Bin Kim , Seong-Whan Lee

Diffusion/score-based models have recently emerged as powerful generative priors for solving inverse problems, including accelerated MRI reconstruction. While their flexibility allows decoupling the measurement model from the learned prior,…

Image and Video Processing · Electrical Eng. & Systems 2025-09-15 Yaşar Utku Alçalar , Junno Yun , Mehmet Akçakaya

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Diffusion-based Generative Models (DGMs) have achieved unparalleled performance in synthesizing high-quality visual content, opening up the opportunity to improve image super-resolution (SR) tasks. Recent solutions for these tasks often…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ruibin Li , Qihua Zhou , Song Guo , Jie Zhang , Jingcai Guo , Xinyang Jiang , Yifei Shen , Zhenhua Han

We present a deep neural network-based methodology for synthesising percussive sounds with control over high-level timbral characteristics of the sounds. This approach allows for intuitive control of a synthesizer, enabling the user to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 António Ramires , Pritish Chandna , Xavier Favory , Emilia Gómez , Xavier Serra

Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desideratum in conditional synthesis is to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Ye Zhu , Yu Wu , Kyle Olszewski , Jian Ren , Sergey Tulyakov , Yan Yan

Diffusion models have shown impressive performance for image generation, often times outperforming other generative models. Since their introduction, researchers have extended the powerful noise-to-image denoising pipeline to discriminative…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu