English
Related papers

Related papers: Scene Text Image Super-resolution based on Text-co…

200 papers

Speech super-resolution (SR) reconstructs high-fidelity wideband speech from low-resolution inputs-a task that necessitates reconciling global harmonic coherence with local transient sharpness. While diffusion-based generative models yield…

Sound · Computer Science 2026-01-01 Jiajun Yuan , Xiaochen Wang , Yuhang Xiao , Yulin Wu , Chenhao Hu , Xueyang Lv

This paper presents Diffusion Model for Scene Text Recognition (DiffusionSTR), an end-to-end text recognition framework using diffusion models for recognizing text in the wild. While existing studies have viewed the scene text recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Masato Fujitake

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

We present ControlSR, a new method that can tame Diffusion Models for consistent real-world image super-resolution (Real-ISR). Previous Real-ISR models mostly focus on how to activate more generative priors of text-to-image diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yuhao Wan , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Ming-Ming Cheng , Bo Li

In the last decade, the blossom of deep learning has witnessed the rapid development of scene text recognition. However, the recognition of low-resolution scene text images remains a challenge. Even though some super-resolution methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Jingye Chen , Haiyang Yu , Jianqi Ma , Bin Li , Xiangyang Xue

Existing diffusion-based super-resolution approaches often exhibit semantic ambiguities due to inaccuracies and incompleteness in their text conditioning, coupled with the inherent tendency for cross-attention to divert towards irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Chen Chen , Majid Abdolshah , Violetta Shevchenko , Hongdong Li , Chang Xu , Pulak Purkait

Diffusion probabilistic models (DPM) have been widely adopted in image-to-image translation to generate high-quality images. Prior attempts at applying the DPM to image super-resolution (SR) have shown that iteratively refining a pure…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Axi Niu , Kang Zhang , Trung X. Pham , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Recently, various deep-neural-network (DNN)-based approaches have been proposed for single-image super-resolution (SISR). Despite their promising results on major structure regions such as edges and lines, they still suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2016-12-02 Il Jun Ahn , Woo Hyun Nam

Diffusion models have recently achieved significant success in various image manipulation tasks, including image super-resolution and perceptual quality enhancement. Pretrained text-to-image models, such as Stable Diffusion, have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sanchar Palit , Subhasis Chaudhuri , Biplab Banerjee

Diffusion models (DMs) have demonstrated remarkable success in real-world image super-resolution (SR), yet their reliance on time-consuming multi-step sampling largely hinders their practical applications. While recent efforts have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiaqi Xu , Wenbo Li , Haoze Sun , Fan Li , Zhixin Wang , Long Peng , Jingjing Ren , Haoran Yang , Xiaowei Hu , Renjing Pei , Pheng-Ann Heng

Diffusion-based methods, endowed with a formidable generative prior, have received increasing attention in Image Super-Resolution (ISR) recently. However, as low-resolution (LR) images often undergo severe degradation, it is challenging for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yunpeng Qu , Kun Yuan , Kai Zhao , Qizhi Xie , Jinhua Hao , Ming Sun , Chao Zhou

We present a novel algorithm for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our method aims to generate a target image by selectively editing the regions of interest in a source image,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Due to the significant information loss in low-resolution (LR) images, it has become extremely challenging to further advance the state-of-the-art of single image super-resolution (SISR). Reference-based super-resolution (RefSR), on the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Zhifei Zhang , Zhaowen Wang , Zhe Lin , Hairong Qi

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Diffusion models have gained attention for image editing yielding impressive results in text-to-image tasks. On the downside, one might notice that generated images of stable diffusion models suffer from deteriorated details. This pitfall…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Joshua Santoso , Christian Simon , Williem

Remote Sensing Image Super-Resolution (RSISR) reconstructs high-resolution (HR) remote sensing images from low-resolution inputs to support fine-grained ground object interpretation. Existing methods face three key challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yide Liu , Haijiang Sun , Xiaowen Zhang , Qiaoyuan Liu , Zhouchang Chen , Chongzhuo Xiao

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Advanced diffusion models (DMs) perform impressively in image super-resolution (SR), but the high memory and computational costs hinder their deployment. Binarization, an ultra-compression algorithm, offers the potential for effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zheng Chen , Haotong Qin , Yong Guo , Xiongfei Su , Xin Yuan , Linghe Kong , Yulun Zhang

Real-world image super-resolution (Real-ISR) has achieved a remarkable leap by leveraging large-scale text-to-image models, enabling realistic image restoration from given recognition textual prompts. However, these methods sometimes fail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiahua Xiao , Jiawei Zhang , Dongqing Zou , Xiaodan Zhang , Jimmy Ren , Xing Wei