English
Related papers

Related papers: Image Super-Resolution with Text Prompt Diffusion

200 papers

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Scene text recognition has witnessed rapid development with the advance of convolutional neural networks. Nonetheless, most of the previous methods may not work well in recognizing text with low resolution which is often seen in natural…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Wenjia Wang , Enze Xie , Peize Sun , Wenhai Wang , Lixun Tian , Chunhua Shen , Ping Luo

Most super-resolution (SR) models struggle with real-world low-resolution (LR) images. This issue arises because the degradation characteristics in the synthetic datasets differ from those in real-world LR images. Since SR models are…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Ru Ito , Supatta Viriyavisuthisakul , Kazuhiko Kawamoto , Hiroshi Kera

Due to the significant information loss in low-resolution (LR) images, it has become extremely challenging to further advance the state-of-the-art of single image super-resolution (SISR). Reference-based super-resolution (RefSR), on the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Zhifei Zhang , Zhaowen Wang , Zhe Lin , Hairong Qi

Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifying multiple tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jiaqi Ma , Tianheng Cheng , Guoli Wang , Qian Zhang , Xinggang Wang , Lefei Zhang

Realistic image restoration is a crucial task in computer vision, and diffusion-based models for image restoration have garnered significant attention due to their ability to produce realistic results. Restoration can be seen as a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Yuhong Zhang , Hengsheng Zhang , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

This study presents a new image super-resolution (SR) technique based on diffusion inversion, aiming at harnessing the rich image priors encapsulated in large pre-trained diffusion models to improve SR performance. We design a Partial noise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zongsheng Yue , Kang Liao , Chen Change Loy

Real-world image super-resolution (Real-ISR) has achieved a remarkable leap by leveraging large-scale text-to-image models, enabling realistic image restoration from given recognition textual prompts. However, these methods sometimes fail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiahua Xiao , Jiawei Zhang , Dongqing Zou , Xiaodan Zhang , Jimmy Ren , Xing Wei

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Although the lightweight Vision Transformer has significantly advanced image super-resolution (SR), it faces the inherent challenge of a limited receptive field due to the window-based self-attention modeling. The quadratic computational…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Wenyang Liu , Chen Cai , Jianjun Gao , Kejun Wu , Yi Wang , Kim-Hui Yap , Lap-Pui Chau

Super-resolution (SR) has traditionally been based on pairs of high-resolution images (HR) and their low-resolution (LR) counterparts obtained artificially with bicubic downsampling. However, in real-world SR, there is a large variety of…

Image and Video Processing · Electrical Eng. & Systems 2020-11-06 Mohammad Saeed Rad , Thomas Yu , Claudiu Musat , Hazim Kemal Ekenel , Behzad Bozorgtabar , Jean-Philippe Thiran

While burst Low-Resolution (LR) images are useful for improving their Super Resolution (SR) image compared to a single LR image, prior burst SR methods are trained in a deterministic manner, which produces a blurry SR image. Since such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Kento Kawai , Takeru Oba , Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Linwei Dong , Qingnan Fan , Yihong Guo , Zhonghao Wang , Qi Zhang , Jinwei Chen , Yawei Luo , Changqing Zou

Despite recent advances, single-image super-resolution (SR) remains challenging, especially in real-world scenarios with complex degradations. Diffusion-based SR methods, particularly those built on Stable Diffusion, leverage strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fabio D'Oronzio , Federico Putamorsi , Leonardo Zini , Marcella Cornia , Lorenzo Baraldi

Scene Text Image Super-Resolution (STISR) aims to enhance the resolution and legibility of text within low-resolution (LR) images, consequently elevating recognition accuracy in Scene Text Recognition (STR). Previous methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yuxuan Zhou , Liangcai Gao , Zhi Tang , Baole Wei

Recent advancements in text-to-image diffusion models have yielded impressive results in generating realistic and diverse images. However, these models still struggle with complex prompts, such as those that involve numeracy and spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Long Lian , Boyi Li , Adam Yala , Trevor Darrell

Diffusion models have gained significant popularity in the field of image-to-image translation. Previous efforts applying diffusion models to image super-resolution (SR) have demonstrated that iteratively refining pure Gaussian noise using…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Axi Niu , Pham Xuan Trung , Kang Zhang , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Image restoration involves recovering a high-quality clean image from its degraded version. Deep learning-based methods have significantly improved image restoration performance, however, they have limited generalization ability to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Vaishnav Potlapalli , Syed Waqas Zamir , Salman Khan , Fahad Shahbaz Khan

Image super-resolution (SR) has attracted increasing attention due to its wide applications. However, current SR methods generally suffer from over-smoothing and artifacts, and most work only with fixed magnifications. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sicheng Gao , Xuhui Liu , Bohan Zeng , Sheng Xu , Yanjing Li , Xiaoyan Luo , Jianzhuang Liu , Xiantong Zhen , Baochang Zhang

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes a Prompt Expansion framework that helps users generate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Siddhartha Datta , Alexander Ku , Deepak Ramachandran , Peter Anderson