English
Related papers

Related papers: Text-Aware Image Restoration with Diffusion Models

200 papers

Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks and have shown unexpected potential in image Super-Resolution (SR). However, most existing T2I diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Brian B. Moser , Stanislav Frolov , Tobias C. Nauen , Federico Raue , Andreas Dengel

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Recent diffusion models have exhibited great potential in generative modeling tasks. Part of their success can be attributed to the ability of training stable on huge sets of paired synthetic data. However, adapting these models to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Yiyang Shen , Mingqiang Wei , Yongzhen Wang , Xueyang Fu , Jing Qin

The rising prevalence of vision-threatening retinal diseases poses a significant burden on the global healthcare systems. Deep learning (DL) offers a promising solution for automatic disease screening but demands substantial data.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Ruoyu Chen , Weiyi Zhang , Bowen Liu , Xiaolan Chen , Pusheng Xu , Shunming Liu , Mingguang He , Danli Shi

The rapid advancement of generative image models has transformed digital media to the point where AI generated images can no longer be reliably distinguished from authentic photographs by human observers or many conventional detection…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Mohd Ruhul Ameen , Akif Islam

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xin Lu , Xueyang Fu , Jie Xiao , Zihao Fan , Yurui Zhu , Zheng-Jun Zha

Image restoration faces challenges including ineffective feature fusion, computational bottlenecks and inefficient diffusion processes. To address these, we propose DiffRWKVIR, a novel framework unifying Test-Time Training (TTT) with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Rongchang Lu , Tianduo Luo , Yunzhi Jiang , Conghan Yue , Pei Yang , Guibao Liu , Changyang Gu

Learning-based Text-to-Image (TTI) models like Stable Diffusion have revolutionized the way visual content is generated in various domains. However, recent research has shown that nonnegligible social bias exists in current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ruifei He , Chuhui Xue , Haoru Tan , Wenqing Zhang , Yingchen Yu , Song Bai , Xiaojuan Qi

Diffusion models have advanced unsupervised anomaly detection by improving the transformation of pathological images into pseudo-healthy equivalents. Nonetheless, standard approaches may compromise critical information during pathology…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Cosmin I. Bercea , Benedikt Wiestler , Daniel Rueckert , Julia A. Schnabel

Diffusion models have gained attention for image editing yielding impressive results in text-to-image tasks. On the downside, one might notice that generated images of stable diffusion models suffer from deteriorated details. This pitfall…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Joshua Santoso , Christian Simon , Williem

Large-scale text-to-image generative models have shown remarkable ability to synthesize diverse and high-quality images. However, it is still challenging to directly apply these models for editing real images for two reasons. First, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Syed Muhmmad Israr , Feng Zhao

Diffusion-based zero-shot image restoration and enhancement models have achieved great success in various tasks of image restoration and enhancement. However, directly applying them to video restoration and enhancement results in severe…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Cong Cao , Huanjing Yue , Xin Liu , Jingyu Yang

Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aiwen Jiang , Zhi Wei , Long Peng , Feiqiang Liu , Wenbo Li , Mingwen Wang

Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely modeled explicitly. We propose a degradation-aware and structure-preserving diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Ji , Zonghao Chen , Zhihao Xue , Junqin Hu

This paper addresses the task of interactive, conversational text-to-image retrieval. Our DIR-TIR framework progressively refines the target image search through two specialized modules: the Dialog Refiner Module and the Image Refiner…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zongwei Zhen , Biqing Zeng

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based STE methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Weichao Zeng , Yan Shu , Zhenhang Li , Dongbao Yang , Yu Zhou

Although recent research applying text-to-image (T2I) diffusion models to real-world super-resolution (SR) has achieved remarkable progress, the misalignment of their targets leads to a suboptimal trade-off between inference speed and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yan Wang , Shijie Zhao , Kexin Zhang , Junlin Li , Li Zhang

Scene text recognition (STR) from high-resolution (HR) images has been significantly successful, however text reading on low-resolution (LR) images is still challenging due to insufficient visual information. Therefore, recently many scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Minyi Zhao , Yang Wang , Jihong Guan , Shuigeng Zhou

Phase retrieval aims to recover a signal from intensity-only measurements, a fundamental problem in many fields such as imaging, holography, optical computing, crystallography, and microscopy. Although there are several well-known phase…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Mehmet Onurcan Kaya , Figen S. Oktem

Image restoration is a long-standing problem in low-level computer vision with many interesting applications. We describe a flexible learning framework based on the concept of nonlinear reaction diffusion models for various image…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Yunjin Chen , Thomas Pock