English
Related papers

Related papers: Spectral Regularization for Diffusion Models

200 papers

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

Diffusion models have been widely used in the generative domain due to their convincing performance in modeling complex data distributions. Moreover, they have shown competitive results on discriminative tasks, such as image segmentation.…

Sound · Computer Science 2025-01-14 Hounsu Kim , Taegyun Kwon , Juhan Nam

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-15 Kuang Gong , Keith A. Johnson , Georges El Fakhri , Quanzheng Li , Tinsu Pan

Standard diffusion models (DMs) rely on the total destruction of data into non-informative white noise, forcing the backward process to denoise from a fully unstructured noise state. While ensuring diversity, this results in a cumbersome…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Baohua Yan , Jennifer Kava , Qingyuan Liu , Xuan Di

We propose a simple architecture for deep reinforcement learning by embedding inputs into a learned Fourier basis and show that it improves the sample efficiency of both state-based and image-based RL. We perform infinite-width analysis of…

Machine Learning · Computer Science 2021-12-07 Alexander C. Li , Deepak Pathak

Nuclear Magnetic Resonance (NMR) spectroscopy leverages nuclear magnetization to probe molecules' chemical environment, structure, and dynamics, with applications spanning from pharmaceuticals to the petroleum industry. Despite its utility,…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Sen Yan , Fabrizio Gabellieri , Etienne Goffinet , Filippo Castiglione , Thomas Launey

Solving ill-posed inverse problems requires careful formulation of prior beliefs over the signals of interest and an accurate description of their manifestation into noisy measurements. Handcrafted signal priors based on e.g. sparsity are…

Machine Learning · Computer Science 2025-08-14 Tristan S. W. Stevens , Hans van Gorp , Faik C. Meral , Junseob Shin , Jason Yu , Jean-Luc Robert , Ruud J. G. van Sloun

Diffusion Probabilistic Models (DPMs) are a well-established class of diffusion models for unconditional image generation, while SGMSE+ is a well-established conditional diffusion model for speech enhancement. One of the downsides of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Bunlong Lay , Timo Gerkmann

Real-world image denoising is an extremely important image processing problem, which aims to recover clean images from noisy images captured in natural environments. In recent years, diffusion models have achieved very promising results in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Cheng Yang , Lijing Liang , Zhixun Su

This paper presents innovative enhancements to diffusion models by integrating a novel multi-resolution network and time-dependent layer normalization. Diffusion models have gained prominence for their effectiveness in high-fidelity image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Qihao Liu , Zhanpeng Zeng , Ju He , Qihang Yu , Xiaohui Shen , Liang-Chieh Chen

Ultrasound image reconstruction can be approximately cast as a linear inverse problem that has traditionally been solved with penalized optimization using the $l_1$ or $l_2$ norm, or wavelet-based terms. However, such regularization…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yuxin Zhang , Clément Huneau , Jérôme Idier , Diana Mateus

The problem of imaging extended targets (sources or scatterers) is formulated in the framework of compressed sensing with emphasis on subwavelength resolution. The proposed formulation of the problems of inverse source/scattering is…

Optics · Physics 2009-09-15 Albert C. Fannjiang

Diffusion models have recently received a surge of interest due to their impressive performance for image restoration, especially in terms of noise robustness. However, existing diffusion-based methods are trained on a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuchun Miao , Lefei Zhang , Liangpei Zhang , Dacheng Tao

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

We show how to use low-quality, synthetic, and out-of-distribution images to improve the quality of a diffusion model. Typically, diffusion models are trained on curated datasets that emerge from highly filtered data pools from the Web and…

Diffusion-based Generative Models (DGMs) have achieved unparalleled performance in synthesizing high-quality visual content, opening up the opportunity to improve image super-resolution (SR) tasks. Recent solutions for these tasks often…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ruibin Li , Qihua Zhou , Song Guo , Jie Zhang , Jingcai Guo , Xinyang Jiang , Yifei Shen , Zhenhua Han

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Diffusion models have demonstrated exceptional ability in modeling complex image distributions, making them versatile plug-and-play priors for solving imaging inverse problems. However, their reliance on large-scale clean datasets for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Weimin Bai , Weiheng Tang , Enze Ye , Siyi Chen , Wenzheng Chen , He Sun