中文
相关论文

相关论文: Timbre transfer using image-to-image denoising dif…

200 篇论文

Timbre is a primary mode of expression in diverse musical contexts. However, prevalent audio-driven synthesis methods predominantly rely on pitch and loudness envelopes, effectively flattening timbral expression from the input. Our approach…

声音 · 计算机科学 2024-07-08 Jordie Shier , Charalampos Saitis , Andrew Robertson , Andrew McPherson

Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for eliminating noise leads us to wonder whether DM can be…

信息论 · 计算机科学 2023-09-19 Tong Wu , Zhiyong Chen , Dazhi He , Liang Qian , Yin Xu , Meixia Tao , Wenjun Zhang

Recent score-based diffusion models (SBDMs) show promising results in unpaired image-to-image translation (I2I). However, existing methods, either energy-based or statistically-based, provide no explicit form of the interfered intermediate…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Shikun Sun , Longhui Wei , Junliang Xing , Jia Jia , Qi Tian

Our goal is to extend the denoising diffusion implicit model (DDIM) to general diffusion models~(DMs) besides isotropic diffusions. Instead of constructing a non-Markov noising process as in the original DDIM, we examine the mechanism of…

机器学习 · 计算机科学 2023-03-24 Qinsheng Zhang , Molei Tao , Yongxin Chen

Diffusion models have been widely used in the generative domain due to their convincing performance in modeling complex data distributions. Moreover, they have shown competitive results on discriminative tasks, such as image segmentation.…

声音 · 计算机科学 2025-01-14 Hounsu Kim , Taegyun Kwon , Juhan Nam

The audio denoising technique has captured widespread attention in the deep neural network field. Recently, the audio denoising problem has been converted into an image generation task, and deep learning-based approaches have been applied…

声音 · 计算机科学 2024-06-14 Junhui Li , Pu Wang , Jialu Li , Youshan Zhang

Denoising diffusion models (DDMs) have led to staggering performance leaps in image generation, editing and restoration. However, existing DDMs use very large datasets for training. Here, we introduce a framework for training a DDM on a…

计算机视觉与模式识别 · 计算机科学 2023-06-08 Vladimir Kulikov , Shahar Yadin , Matan Kleiner , Tomer Michaeli

Diffusion probabilistic models (DPMs) and their extensions have emerged as competitive generative models yet confront challenges of efficient sampling. We propose a new bilateral denoising diffusion model (BDDM) that parameterizes both the…

音频与语音处理 · 电气工程与系统科学 2022-03-28 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Neural audio synthesis is an actively researched topic, having yielded a wide range of techniques that leverages machine learning architectures. Google Magenta elaborated a novel approach called Differential Digital Signal Processing (DDSP)…

Diffusion models have shown exceptional scaling properties in the image synthesis domain, and initial attempts have shown similar benefits for applying diffusion to unconditional text synthesis. Denoising diffusion models attempt to…

音频与语音处理 · 电气工程与系统科学 2022-10-17 Matthew Baas , Kevin Eloff , Herman Kamper

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

Diffusion Models achieve state-of-the-art performance in generating new samples but lack a low-dimensional latent space that encodes the data into editable features. Inversion-based methods address this by reversing the denoising…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Łukasz Staniszewski , Łukasz Kuciński , Kamil Deja

Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for removing noise leads us to wonder whether DM can be applied…

信息论 · 计算机科学 2023-05-17 Tong Wu , Zhiyong Chen , Dazhi He , Liang Qian , Yin Xu , Meixia Tao , Wenjun Zhang

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

We explore two approaches to creatively altering vocal timbre using Differentiable Digital Signal Processing (DDSP). The first approach is inspired by classic cross-synthesis techniques. A pretrained DDSP decoder predicts a filter for a…

声音 · 计算机科学 2023-06-21 David Südholt , Cumhur Erkut

Learning diffusion bridge models is easy; making them fast and practical is an art. Diffusion bridge models (DBMs) are a promising extension of diffusion models for applications in image-to-image translation. However, like many modern…

机器学习 · 计算机科学 2025-08-19 Nikita Gushchin , David Li , Daniil Selikhanovych , Evgeny Burnaev , Dmitry Baranchuk , Alexander Korotin

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

图像与视频处理 · 电气工程与系统科学 2022-06-28 Boah Kim , Jong Chul Ye

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

计算机视觉与模式识别 · 计算机科学 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

Recommender systems often grapple with noisy implicit feedback. Most studies alleviate the noise issues from data cleaning perspective such as data resampling and reweighting, but they are constrained by heuristic assumptions. Another…

信息检索 · 计算机科学 2024-06-18 Jujia Zhao , Wenjie Wang , Yiyan Xu , Teng Sun , Fuli Feng , Tat-Seng Chua