English
Related papers

Related papers: Exploiting Diffusion Prior for Task-driven Image R…

200 papers

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Linwei Dong , Qingnan Fan , Yihong Guo , Zhonghao Wang , Qi Zhang , Jinwei Chen , Yawei Luo , Changqing Zou

We introduce DiffSteISR, a pioneering framework for reconstructing real-world stereo images. DiffSteISR utilizes the powerful prior knowledge embedded in pre-trained text-to-image model to efficiently recover the lost texture details in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Yuanbo Zhou , Xinlin Zhang , Wei Deng , Tao Wang , Tao Tan , Qinquan Gao , Tong Tong

Large-scale pre-trained diffusion models are becoming increasingly popular in solving the Real-World Image Super-Resolution (Real-ISR) problem because of their rich generative priors. The recent development of diffusion transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheng-Peng Duan , Jiawei Zhang , Xin Jin , Ziheng Zhang , Zheng Xiong , Dongqing Zou , Jimmy S. Ren , Chun-Le Guo , Chongyi Li

While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

Although diffusion prior is rising as a powerful solution for blind face restoration (BFR), the inherent gap between the vanilla diffusion model and BFR settings hinders its seamless adaptation. The gap mainly stems from the discrepancy…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yunqi Miao , Zhiyu Qu , Mingqi Gao , Changrui Chen , Jifei Song , Jungong Han , Jiankang Deng

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xin Lu , Xueyang Fu , Jie Xiao , Zihao Fan , Yurui Zhu , Zheng-Jun Zha

Hyperspectral image (HSI) reconstruction aims to recover 3D HSI from its degraded 2D measurements. Recently great progress has been made in deep learning-based methods, however, these methods often struggle to accurately capture…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Mingyang Yu , Zhijian Wu , Dingjiang Huang

Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Hanlin Wu , Jiangwei Mo , Xiaohui Sun , Jie Ma

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Image restoration aims to reconstruct the latent clear images from their degraded versions. Despite the notable achievement, existing methods predominantly focus on handling specific degradation types and thus require specialized models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xuanhua He , Lang Li , Yingying Wang , Hui Zheng , Ke Cao , Keyu Yan , Rui Li , Chengjun Xie , Jie Zhang , Man Zhou

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

Deep learning (DL) methods have been extensively applied to various image recovery problems, including magnetic resonance imaging (MRI) and computed tomography (CT) reconstruction. Beyond supervised models, other approaches have been…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Shijun Liang , Ismail Alkhouri , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

Diffusion models have demonstrated their powerful image generation capabilities, effectively fitting highly complex image distributions. These models can serve as strong priors for image restoration. Existing methods often utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hanbang Liang , Zhen Wang , Weihui Deng

Recent advancements in diffusion-based generative priors have enabled visually plausible image compression at extremely low bit rates. However, existing approaches suffer from slow sampling processes and suboptimal bit allocation due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yichong Xia , Yimin Zhou , Jinpeng Wang , Bin Chen

Diffusion is commonly used as a ranking or re-ranking method in retrieval tasks to achieve higher retrieval performance, and has attracted lots of attention in recent years. A downside to diffusion is that it performs slowly in comparison…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Fan Yang , Ryota Hinami , Yusuke Matsui , Steven Ly , Shin'ichi Satoh

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

Recently, diffusion models (DM) have been applied in magnetic resonance imaging (MRI) super-resolution (SR) reconstruction, exhibiting impressive performance, especially with regard to detailed reconstruction. However, the current DM-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Guangyuan Li , Chen Rao , Juncheng Mo , Zhanjie Zhang , Wei Xing , Lei Zhao

Deep learning has shown great potential in accelerating diffusion tensor imaging (DTI). Nevertheless, existing methods tend to suffer from Rician noise and detail loss in reconstructing the DTI-derived parametric maps especially when…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Wenxin Fan , Jian Cheng , Cheng Li , Xinrui Ma , Jing Yang , Juan Zou , Ruoyou Wu , Qiegen Liu , Shanshan Wang