English
Related papers

Related papers: DiffusionSTR: Diffusion Model for Scene Text Recog…

200 papers

Scene text recognition in low-resource languages frequently faces challenges due to the limited availability of training datasets derived from real-world scenes. This study proposes a novel approach that generates text images in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Chihiro Noguchi , Shun Fukuda , Shoichiro Mihara , Masao Yamanaka

Style transfer combines the content of one signal with the style of another. It supports applications such as data augmentation and scenario simulation, helping machine learning models generalize in data-scarce domains. While well developed…

This paper explores the multi-scale aggregation strategy for scene text detection in natural images. We present the Aggregated Text TRansformer(ATTR), which is designed to represent texts in scene images with a multi-scale self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhao Zhou , Xiangcheng Du , Yingbin Zheng , Cheng Jin

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-01 Cindy M. Nguyen , Eric R. Chan , Alexander W. Bergman , Gordon Wetzstein

Mask Diffusion Models (MDMs) have recently emerged as a promising alternative to auto-regressive models (ARMs) for vision-language tasks, owing to their flexible balance of efficiency and accuracy. In this paper, for the first time, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yongkun Du , Miaomiao Zhao , Songlin Fan , Zhineng Chen , Caiyan Jia , Yu-Gang Jiang

This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Raul Gomez , Ali Furkan Biten , Lluis Gomez , Jaume Gibert , Marçal Rusiñol , Dimosthenis Karatzas

We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zhengbo Zhang , Li Xu , Duo Peng , Hossein Rahmani , Jun Liu

Scene text retrieval aims to localize and search all text instances from an image gallery, which are the same or similar to a given query text. Such a task is usually realized by matching a query text to the recognized words, outputted by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hao Wang , Xiang Bai , Mingkun Yang , Shenggao Zhu , Jing Wang , Wenyu Liu

In this work, we jointly address the problem of text detection and recognition in natural scene images based on convolutional recurrent neural networks. We propose a unified network that simultaneously localizes and recognizes text with a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Hui Li , Peng Wang , Chunhua Shen

Scene flow estimation is an essential ingredient for a variety of real-world applications, especially for autonomous agents, such as self-driving cars and robots. While recent scene flow estimation approaches achieve a reasonable accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Yushan Zhang , Bastian Wandt , Maria Magnusson , Michael Felsberg

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

Reading text in the wild is a challenging task in the field of computer vision. Existing approaches mainly adopted Connectionist Temporal Classification (CTC) or Attention models based on Recurrent Neural Network (RNN), which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yunze Gao , Yingying Chen , Jinqiao Wang , Hanqing Lu

In this work we present an end-to-end system for text spotting -- localising and recognising text in natural scene images -- and text based image retrieval. This system is based on a region proposal mechanism for detection and deep…

Computer Vision and Pattern Recognition · Computer Science 2014-12-08 Max Jaderberg , Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Text-to-image diffusion models have demonstrated an unparalleled ability to generate high-quality, diverse images from a textual prompt. However, the internal representations learned by these models remain an enigma. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Hila Chefer , Oran Lang , Mor Geva , Volodymyr Polosukhin , Assaf Shocher , Michal Irani , Inbar Mosseri , Lior Wolf

We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , Xiaoou Tang

Detecting and recognizing text in natural scene images is a challenging, yet not completely solved task. In recent years several new systems that try to solve at least one of the two sub-tasks (text detection and text recognition) have been…

Computer Vision and Pattern Recognition · Computer Science 2017-12-18 Christian Bartz , Haojin Yang , Christoph Meinel

Scene text detection is a challenging problem in computer vision. In this paper, we propose a novel text detection network based on prevalent object detection frameworks. In order to obtain stronger semantic feature, we adopt ResNet as…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Xiangyu Zhu , Yingying Jiang , Shuli Yang , Xiaobing Wang , Wei Li , Pei Fu , Hua Wang , Zhenbo Luo

Neural Style Transfer (NST) is the field of study applying neural techniques to modify the artistic appearance of a content image to match the style of a reference style image. Traditionally, NST methods have focused on texture-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Dan Ruta , Gemma Canet Tarrés , Andrew Gilbert , Eli Shechtman , Nicholas Kolkin , John Collomosse