English
Related papers

Related papers: Inversion by Direct Iteration: An Alternative to D…

200 papers

Despite recent advances in inversion-based editing, text-guided image manipulation remains challenging for diffusion models. The primary bottlenecks include 1) the time-consuming nature of the inversion process; 2) the struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Sihan Xu , Yidong Huang , Jiayi Pan , Ziqiao Ma , Joyce Chai

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

The lack of large-scale noisy-clean image pairs restricts supervised denoising methods' deployment in actual applications. While existing unsupervised methods are able to learn image denoising without ground-truth clean images, they either…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yi Zhang , Dasong Li , Ka Lung Law , Xiaogang Wang , Hongwei Qin , Hongsheng Li

While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Two of the main challenges of image restoration in real-world scenarios are the accurate characterization of an image prior and the precise modeling of the image degradation operator. Pre-trained diffusion models have been very successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Recent advances in Image Restoration (IR) have been largely driven by generative methods such as Diffusion Models and Flow Matching, which excel in synthesizing realistic textures while suffering from slow multi-step inference and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yi Liu , Jia Ma , Wengen Li , Jihong Guan , Shuigeng Zhou , Yichao Zhang

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Large-scale text-to-image diffusion models have been a ground-breaking development in generating convincing images following an input text prompt. The goal of image editing research is to give users control over the generated images by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Chuanming Tang , Kai Wang , Joost van de Weijer

Diffusion model (DM) has achieved SOTA performance by modeling the image synthesis process into a sequential application of a denoising network. However, different from image synthesis, image restoration (IR) has a strong constraint to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Luc Van Gool

Handling test-time unknown degradation is the major challenge in Blind Image Restoration (BIR), necessitating high model generalization. An effective strategy is to incorporate prior knowledge, either from human input or generative model.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jen-Yuan Huang , Haofan Wang , Qixun Wang , Xu Bai , Hao Ai , Peng Xing , Jen-Tse Huang

Image enhancement finds wide-ranging applications in real-world scenarios due to complex environments and the inherent limitations of imaging devices. Recent diffusion-based methods yield promising outcomes but necessitate prolonged and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yixuan Zhu , Haolin Wang , Ao Li , Wenliang Zhao , Yansong Tang , Jingxuan Niu , Lei Chen , Jie Zhou , Jiwen Lu

Image restoration tasks like deblurring, denoising, and dehazing usually need distinct models for each degradation type, restricting their generalization in real-world scenarios with mixed or unknown degradations. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Wenyang Luo , Haina Qin , Zewen Chen , Libin Wang , Dandan Zheng , Yuming Li , Yufan Liu , Bing Li , Weiming Hu

DDIM inversion has revealed the remarkable potential of real image editing within diffusion-based methods. However, the accuracy of DDIM reconstruction degrades as larger classifier-free guidance (CFG) scales being used for enhanced…

Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Yamin Arefeen , Brett Levac , Zach Stoebner , Jonathan Tamir

Diffusion models (DMs) have exhibited remarkable efficacy in various image restoration tasks. However, existing approaches typically operate within the high-dimensional pixel space, resulting in high computational overhead. While methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yang Zheng , Wen Li , Zhaoqiang Liu

Finding an initial noise vector that produces an input image when fed into the diffusion process (known as inversion) is an important problem in denoising diffusion models (DDMs), with applications for real image editing. The…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Bram Wallace , Akash Gokul , Nikhil Naik

Inverse problems generally require a regularizer or prior for a good solution. A recent trend is to train a convolutional net to denoise images, and use this net as a prior when solving the inverse problem. Several proposals depend on a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Kyle Luther , H. Sebastian Seung

Inverting real images into the noise space is essential for editing tasks using diffusion models, yet existing methods produce non-Gaussian noise with poor editability due to the inaccuracy in early noising steps. We identify the root…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chen Min , Enze Jiang , Jishen Peng , Zheng Ma

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu