English
Related papers

Related papers: PEAN: A Diffusion-Based Prior-Enhanced Attention N…

200 papers

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Diffusion models have demonstrated impressive performance in various image generation, editing, enhancement and translation tasks. In particular, the pre-trained text-to-image stable diffusion models provide a potential solution to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tao Yang , Rongyuan Wu , Peiran Ren , Xuansong Xie , Lei Zhang

Scene text image super-resolution has significantly improved the accuracy of scene text recognition. However, many existing methods emphasize performance over efficiency and ignore the practical need for lightweight solutions in deployment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 LeoWu TomyEnrique , Xiangcheng Du , Kangliang Liu , Han Yuan , Zhao Zhou , Cheng Jin

Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and contribute remarkable progress. However, most of the existing CNNs-based SISR methods do not adequately explore…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Jiqing Zhang , Chengjiang Long , Yuxin Wang , Haiyin Piao , Haiyang Mei , Xin Yang , Baocai Yin

Scene text removal (STR) contains two processes: text localization and background reconstruction. Through integrating both processes into a single network, previous methods provide an implicit erasure guidance by modifying all pixels in the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Yuxin Wang , Hongtao Xie , Shancheng Fang , Yadong Qu , Yongdong Zhang

Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. However, these methods still face two challenges: the requirement for dozens of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Aiping Zhang , Zongsheng Yue , Renjing Pei , Wenqi Ren , Xiaochun Cao

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

In an era where wearable technology is reshaping applications, Scene Text Detection and Recognition (STDR) becomes a straightforward choice through the lens of egocentric vision. Leveraging Meta's Project Aria smart glasses, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Joseph De Mathia , Carlos Francisco Moreno-García

Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework by continually improving the architectural components and training strategies associated with convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Fayaz Ali Dharejo , Muhammad Zawish , Farah Deeba Yuanchun Zhou , Kapal Dev , Sunder Ali Khowaja , Nawab Muhammad Faseeh Qureshi

Scene text recognition is a hot research topic in computer vision. Recently, many recognition methods based on the encoder-decoder framework have been proposed, and they can handle scene texts of perspective distortion and curve shape.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Zhi Qiao , Yu Zhou , Dongbao Yang , Yucan Zhou , Weiping Wang

Image restoration is a long-standing task that seeks to recover the latent sharp image from its deteriorated counterpart. Due to the robust capacity of self-attention to capture long-range dependencies, transformer-based methods or some…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Fangwei Hao , Jiesheng Wu , Ji Du , Yinjie Wang , Jing Xu

Recently, scene text detection has been a challenging task. Texts with arbitrary shape or large aspect ratio are usually hard to detect. Previous segmentation-based methods can describe curve text more accurately but suffer from over…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Qi Zhao , Yufei Wang , Shuchang Lyu , Lijiang Chen

Scene text recognition is a challenging task due to diverse variations of text instances in natural scene images. Conventional methods based on CNN-RNN-CTC or encoder-decoder with attention mechanism may not fully investigate stable and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Ruijie Yan , Liangrui Peng , Shanyu Xiao , Gang Yao

Scene text image super-resolution (STISR) has been regarded as an important pre-processing task for text recognition from low-resolution scene text images. Most recent approaches use the recognizer's feedback as clues to guide…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Minyi Zhao , Miao Wang , Fan Bai , Bingjia Li , Jie Wang , Shuigeng Zhou

Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. However, one critical limitation of these models is the low fidelity of generated images with respect to the text description, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Qiucheng Wu , Yujian Liu , Handong Zhao , Trung Bui , Zhe Lin , Yang Zhang , Shiyu Chang

Convolutional Neural Network (CNN) is intensively implemented to solve super resolution (SR) tasks because of its superior performance. However, the problem of super resolution is still challenging due to the lack of prior knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Yuxin Zhang , Zuquan Zheng , Roland Hu

Atmospheric turbulence introduces severe spatial and geometric distortions, challenging traditional image restoration methods. We propose the Probabilistic Prior Turbulence Removal Network (PPTRN), which combines probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Guodong Sun , Qixiang Ma , Liqiang Zhang , Hongwei Wang , Zixuan Gao , Haotian Zhang

Scene Text Recognition (STR) remains challenging due to real-world complexities, where decoupled visual-linguistic optimization in existing frameworks amplifies error propagation through cross-modal misalignment. Visual encoders exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Lixu Sun , Nurmemet Yolwas , Wushour Silamu

Image-text matching tasks have recently attracted a lot of attention in the computer vision field. The key point of this cross-domain problem is how to accurately measure the similarity between the visual and the textual contents, which…

Computation and Language · Computer Science 2019-07-24 Yaxiong Wang , Hao Yang , Xueming Qian , Lin Ma , Jing Lu , Biao Li , Xin Fan