English
Related papers

Related papers: Score Distillation Sampling for Audio: Source Sepa…

200 papers

We introduce DreamPolish, a text-to-3D generation model that excels in producing refined geometry and high-quality textures. In the geometry construction phase, our approach leverages multiple neural representations to enhance the stability…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yean Cheng , Ziqi Cai , Ming Ding , Wendi Zheng , Shiyu Huang , Yuxiao Dong , Jie Tang , Boxin Shi

We introduce SRC-gAudio, a novel audio generation model designed to facilitate text-to-audio generation across a wide range of sampling rates within a single model architecture. SRC-gAudio incorporates the sampling rate as part of the…

Sound · Computer Science 2024-10-10 Chenxing Li , Manjie Xu , Dong Yu

We introduce Score identity Distillation (SiD), an innovative data-free method that distills the generative capabilities of pretrained diffusion models into a single-step generator. SiD not only facilitates an exponentially fast reduction…

Machine Learning · Computer Science 2024-05-27 Mingyuan Zhou , Huangjie Zheng , Zhendong Wang , Mingzhang Yin , Hai Huang

The field of Singing Voice Synthesis (SVS) has seen significant advancements in recent years due to the rapid progress of diffusion-based approaches. However, capturing vocal style, genre-specific pitch inflections, and language-dependent…

Sound · Computer Science 2025-12-01 Sandipan Dhar , Mayank Gupta , Preeti Rao

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

Audio diffusion models can synthesize a wide variety of sounds. Existing models often operate on the latent domain with cascaded phase recovery modules to reconstruct waveform. This poses challenges when generating high-fidelity audio. In…

Sound · Computer Science 2023-11-21 Ge Zhu , Yutong Wen , Marc-André Carbonneau , Zhiyao Duan

Recent works have shown the capability of deep generative models to tackle general audio synthesis from a single label, producing a variety of impulsive, tonal, and environmental sounds. Such models operate on band-limited signals and, as a…

Sound · Computer Science 2022-10-27 Santiago Pascual , Gautam Bhattacharya , Chunghsin Yeh , Jordi Pons , Joan Serrà

Editing images with diffusion models under strict training-free constraints remains a significant challenge. While recent optimisation-based methods achieve strong zero-shot edits from text, they struggle to preserve identity and capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Niki Foteinopoulou , Ignas Budvytis , Stephan Liwicki

The term "differentiable digital signal processing" describes a family of techniques in which loss function gradients are backpropagated through digital signal processors, facilitating their integration into neural networks. This article…

Sound · Computer Science 2023-08-30 Ben Hayes , Jordie Shier , György Fazekas , Andrew McPherson , Charalampos Saitis

Single-channel audio separation aims to separate individual sources from a single-channel mixture. Most existing methods rely on supervised learning with synthetically generated paired data. However, obtaining high-quality paired data in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Runwu Shi , Chang Li , Jiang Wang , Rui Zhang , Nabeela Khan , Benjamin Yen , Takeshi Ashizawa , Kazuhiro Nakadai

Source separation is a fundamental task in speech, music, and audio processing, and it also provides cleaner and larger data for training generative models. However, improving separation performance in practice often depends on increasingly…

Sound · Computer Science 2025-10-15 Yongsheng Feng , Yuetonghui Xu , Jiehui Luo , Hongjia Liu , Xiaobing Li , Feng Yu , Wei Li

While diffusion models are best known for their performance in generative tasks, they have also been successfully applied to many other tasks, including audio source separation. However, current generative approaches to music source…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-24 Yun-Ning , Hung , Richard Vogl , Filip Korzeniowski , Igor Pereira

3D Gaussian Splatting (3DGS) has achieved excellent rendering quality with fast training and rendering speed. However, its optimization process lacks explicit geometric constraints, leading to suboptimal geometric reconstruction in regions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lin-Zhuo Chen , Kangjie Liu , Youtian Lin , Siyu Zhu , Zhihao Li , Xun Cao , Yao Yao

Versatile audio super-resolution (SR) is the challenging task of restoring high-frequency components from low-resolution audio with sampling rates between 4kHz and 32kHz in various domains such as music, speech, and sound effects. Previous…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Jaekwon Im , Juhan Nam

While diffusion models show promising results in image editing given a target prompt, achieving both prompt fidelity and background preservation remains difficult. Recent works have introduced score distillation techniques that leverage the…

With the remarkable advent of text-to-image diffusion models, image editing methods have become more diverse and continue to evolve. A promising recent approach in this realm is Delta Denoising Score (DDS) - an image editing technique based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hyelin Nam , Gihyun Kwon , Geon Yeong Park , Jong Chul Ye

Diffusion distillation models effectively accelerate reverse sampling by compressing the process into fewer steps. However, these models still exhibit a performance gap compared to their pre-trained diffusion model counterparts, exacerbated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Geon Yeong Park , Sang Wan Lee , Jong Chul Ye

We consider the general problem of recovering a high-dimensional signal from noisy quantized measurements. Quantization, especially coarse quantization such as 1-bit sign measurements, leads to severe information loss and thus a good prior…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Xiangming Meng , Yoshiyuki Kabashima

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

Generative models have attracted considerable attention for speech separation tasks, and among these, diffusion-based methods are being explored. Despite the notable success of diffusion techniques in generation tasks, their adaptation to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-28 Jinwei Dong , Xinsheng Wang , Qirong Mao