English
Related papers

Related papers: Dual Prompting Image Restoration with Diffusion Tr…

200 papers

Diffusion models have achieved remarkable progress in generative modelling, particularly in enhancing image quality to conform to human preferences. Recently, these models have also been applied to low-level computer vision for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu

Diffusion models have shown remarkable capabilities in generating high quality and creative images conditioned on text. An interesting application of such models is structure preserving text guided image editing. Existing approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Hareesh Ravi , Sachin Kelkar , Midhun Harikumar , Ajinkya Kale

Diffusion models have achieved unprecedented performance in image generation, yet they suffer from slow inference due to their iterative sampling process. To address this, early-exiting has recently been proposed, where the depth of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Daniel Gallo Fernández , Răzvan-Andrei Matişan , Alejandro Monroy Muñoz , Ana-Maria Vasilcoiu , Janusz Partyka , Tin Hadži Veljković , Metod Jazbec

Scene text editing aims to modify text in a target region of an image while preserving surrounding background style and texture. Existing methods rely solely on image background information while neglecting the visual details of target…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Hongxi Li , Tong Wang , Chengjing Wu , Tianbao Liu , Jiangtao Yao , Xiaochao Qu , Xinxiao Wu , Luoqi Liu , Ting Liu

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood…

Medical Physics · Physics 2024-09-02 Shudong Li , Xiao Jiang , Matthew Tivnan , Grace J. Gang , Yuan Shen , J. Webster Stayman

In this study, we propose an enhanced image restoration model, SUPIR, based on the integration of two low-rank adaptive (LoRA) modules with the Stable Diffusion XL (SDXL) framework. Our method leverages the advantages of LoRA to fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Haiyang Zhao

Infrared imaging is essential for autonomous driving and robotic operations as a supportive modality due to its reliable performance in challenging environments. Despite its popularity, the limitations of infrared cameras, such as low…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xingyuan Li , Zirui Wang , Yang Zou , Zhixin Chen , Jun Ma , Zhiying Jiang , Long Ma , Jinyuan Liu

Image restoration aims to reconstruct the latent clear images from their degraded versions. Despite the notable achievement, existing methods predominantly focus on handling specific degradation types and thus require specialized models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xuanhua He , Lang Li , Yingying Wang , Hui Zheng , Ke Cao , Keyu Yan , Rui Li , Chengjun Xie , Jie Zhang , Man Zhou

Computed tomography (CT) is widely utilized in clinical settings because it delivers detailed 3D images of the human body. However, performing CT scans is not always feasible due to radiation exposure and limitations in certain surgical…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Xuhui Liu , Zhi Qiao , Runkun Liu , Hong Li , Juan Zhang , Xiantong Zhen , Zhen Qian , Baochang Zhang

Diffusion models have demonstrated their utility as learned priors for solving various inverse problems. However, most existing approaches are limited to linear inverse problems. This paper exploits the efficient and unsupervised posterior…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Mehmet Onurcan Kaya , Figen S. Oktem

Diffusion-based image super-resolution (SR) models have attracted substantial interest due to their powerful image restoration capabilities. However, prevailing diffusion models often struggle to strike an optimal balance between efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Qinpeng Cui , Yixuan Liu , Xinyi Zhang , Qiqi Bao , Qingmin Liao , Li Wang , Tian Lu , Zicheng Liu , Zhongdao Wang , Emad Barsoum

We propose Diverse Restormer (DART), a novel image restoration method that effectively integrates information from various sources (long sequences, local and global regions, feature dimensions, and positional dimensions) to address…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Juan Wen , Yawei Li , Chao Zhang , Weiyan Hou , Radu Timofte , Luc Van Gool

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

There is a growing interest in the use of latent diffusion models (LDMs) for image restoration (IR) tasks due to their ability to model effectively the distribution of natural images. While significant progress has been made, there are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Di You , Daniel Siromani , Pier Luigi Dragotti

Deep image prior (DIP) was recently introduced as an effective unsupervised approach for image restoration tasks. DIP represents the image to be recovered as the output of a deep convolutional neural network, and learns the network's…

Image and Video Processing · Electrical Eng. & Systems 2023-02-10 Riccardo Barbano , Johannes Leuschner , Maximilian Schmidt , Alexander Denker , Andreas Hauptmann , Peter Maaß , Bangti Jin

Diffusion models (DMs) have been successfully applied to real image editing. These models typically invert images into latent noise vectors used to reconstruct the original images (known as inversion), and then edit them during the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Jimin Dai , Yingzhen Zhang , Shuo Chen , Jian Yang , Lei Luo

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Exploiting pre-trained diffusion models for restoration has recently become a favored alternative to the traditional task-specific training approach. Previous works have achieved noteworthy success by limiting the solution space using…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Peiqing Yang , Shangchen Zhou , Qingyi Tao , Chen Change Loy