English
Related papers

Related papers: Timbre transfer using image-to-image denoising dif…

200 papers

Denoising Diffusion Probabilistic Models (DDPMs) have made great strides in generating high-quality samples in both discrete and continuous domains. However, Discrete DDPMs (D3PMs) have yet to be applied to the domain of Symbolic Music.…

Sound · Computer Science 2023-05-17 Matthias Plasser , Silvan Peter , Gerhard Widmer

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

Denoising Diffusion Probabilistic Models (DDPMs) can generate synthetic timeseries data to help improve the performance of a classifier, but their sampling process is computationally expensive. We address this by combining implicit…

Machine Learning · Computer Science 2025-11-27 Heiko Oppel , Andreas Spilz , Michael Munz

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hiroshi Sasaki , Chris G. Willcocks , Toby P. Breckon

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

A comprehensive study on the applications of denoising diffusion models for wireless systems is provided. The article highlights the capabilities of diffusion models in learning complicated signal distributions, modeling wireless channels,…

Information Theory · Computer Science 2025-12-10 Mehdi Letafati , Samad Ali , Matti Latva-aho

FM Synthesis is a well-known algorithm used to generate complex timbre from a compact set of design primitives. Typically featuring a MIDI interface, it is usually impractical to control it from an audio source. On the other hand,…

Sound · Computer Science 2022-08-15 Franco Caspe , Andrew McPherson , Mark Sandler

The incorporation of Denoising Diffusion Models (DDMs) in the Text-to-Speech (TTS) domain is rising, providing great value in synthesizing high quality speech. Although they exhibit impressive audio quality, the extent of their semantic…

Sound · Computer Science 2024-06-05 Miri Varshavsky-Hassid , Roy Hirsch , Regev Cohen , Tomer Golany , Daniel Freedman , Ehud Rivlin

Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing feature of these…

Machine Learning · Computer Science 2022-10-25 Ashwini Pokle , Zhengyang Geng , Zico Kolter

We propose a unified model for three inter-related tasks: 1) to \textit{separate} individual sound sources from a mixed music audio, 2) to \textit{transcribe} each sound source to MIDI notes, and 3) to\textit{ synthesize} new pieces based…

Sound · Computer Science 2021-08-10 Liwei Lin , Qiuqiang Kong , Junyan Jiang , Gus Xia

Recent diffusion models have achieved promising performances in audio-denoising tasks. The unique property of the reverse process could recover clean signals. However, the distribution of real-world noises does not comply with a single…

Sound · Computer Science 2024-06-14 Pu Wang , Junhui Li , Jialu Li , Liangdong Guo , Youshan Zhang

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong

Diffusion models have demonstrated powerful data generation capabilities in various research fields such as image generation. However, in the field of vibration signal generation, the criteria for evaluating the quality of the generated…

Machine Learning · Computer Science 2024-07-02 Haiming Yi , Lei Hou , Yuhong Jin , Nasser A. Saeed , Ali Kandil , Hao Duan

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

We present a fast and high-fidelity method for music generation, based on specified f0 and loudness, such that the synthesized audio mimics the timbre and articulation of a target instrument. The generation process consists of learned…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Michael Michelashvili , Lior Wolf

Diffusion models (DMs) have demonstrated exceptional generative capabilities across various domains, including image, video, and so on. A key factor contributing to their effectiveness is the high quantity and quality of data used during…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Qianlong Xiang , Miao Zhang , Yuzhang Shang , Jianlong Wu , Yan Yan , Liqiang Nie

Masked diffusion language models (MDMs) have recently gained traction as a viable generative framework for natural language. This can be attributed to its scalability and ease of training compared to other diffusion model paradigms for…

Computation and Language · Computer Science 2025-08-19 Tejomay Kishor Padole , Suyash P Awate , Pushpak Bhattacharyya

This paper aims to apply a new deep learning approach to the task of generating raw audio files. It is based on diffusion models, a recent type of deep generative model. This new type of method has recently shown outstanding results with…

Sound · Computer Science 2023-07-21 Svetlana Pavlova

Images captured in challenging environments often experience various forms of degradation, including noise, color cast, blur, and light scattering. These effects significantly reduce image quality, hindering their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Abbas Anwar , Mohammad Shullar , Ali Arshad Nasir , Mudassir Masood , Saeed Anwar