English
Related papers

Related papers: Scene Text Recognition with Semantics

200 papers

Multi-modal models have shown appealing performance in visual recognition tasks, as free-form text-guided training evokes the ability to understand fine-grained visual content. However, current models cannot be trivially applied to scene…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yongkun Du , Zhineng Chen , Yuchen Su , Caiyan Jia , Yu-Gang Jiang

Scene text recognition has attracted great interests from the computer vision and pattern recognition community in recent years. State-of-the-art methods use concolutional neural networks (CNNs), recurrent neural networks with long…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Fei Yin , Yi-Chao Wu , Xu-Yao Zhang , Cheng-Lin Liu

Scene text recognition (STR) enables computers to read text in natural scenes such as object labels, road signs and instructions. STR helps machines perform informed decisions such as what object to pick, which direction to go, and what is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Rowel Atienza

Inspired by speech recognition, recent state-of-the-art algorithms mostly consider scene text recognition as a sequence prediction problem. Though achieving excellent performance, these methods usually neglect an important fact that text in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Minghui Liao , Jian Zhang , Zhaoyi Wan , Fengming Xie , Jiajun Liang , Pengyuan Lyu , Cong Yao , Xiang Bai

Recently, transformer-based methods have achieved promising progresses in object detection, as they can eliminate the post-processes like NMS and enrich the deep representations. However, these methods cannot well cope with scene text due…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jingqun Tang , Wenqing Zhang , Hongye Liu , MingKun Yang , Bo Jiang , Guanglong Hu , Xiang Bai

Scene text recognition (STR) enables computers to recognize and read the text in various real-world scenes. Recent STR models benefit from taking linguistic information in addition to visual cues into consideration. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Jie Wu , Ying Peng , Shengming Zhang , Weigang Qi , Jian Zhang

Recently, scene text detection has become an active research topic in computer vision and document analysis, because of its great importance and significant challenge. However, vast majority of the existing methods detect text within local…

Computer Vision and Pattern Recognition · Computer Science 2016-07-06 Cong Yao , Xiang Bai , Nong Sang , Xinyu Zhou , Shuchang Zhou , Zhimin Cao

Dominant scene text recognition models commonly contain two building blocks, a visual model for feature extraction and a sequence model for text transcription. This hybrid architecture, although accurate, is complex and less efficient. In…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Yongkun Du , Zhineng Chen , Caiyan Jia , Xiaoting Yin , Tianlun Zheng , Chenxia Li , Yuning Du , Yu-Gang Jiang

Driven by deep learning and the large volume of data, scene text recognition has evolved rapidly in recent years. Formerly, RNN-attention based methods have dominated this field, but suffer from the problem of \textit{attention drift} in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhaoyi Wan , Minghang He , Haoran Chen , Xiang Bai , Cong Yao

Scene text recognition is a hot research topic in computer vision. Recently, many recognition methods based on the encoder-decoder framework have been proposed, and they can handle scene texts of perspective distortion and curve shape.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Zhi Qiao , Yu Zhou , Dongbao Yang , Yucan Zhou , Weiping Wang

Scene Text Recognition (STR), the task of recognizing text against complex image backgrounds, is an active area of research. Current state-of-the-art (SOTA) methods still struggle to recognize text written in arbitrary shapes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Ron Litman , Oron Anschel , Shahar Tsiper , Roee Litman , Shai Mazor , R. Manmatha

Scene text recognition (STR) is an important bridge between images and text, attracting abundant research attention. While convolutional neural networks (CNNS) have achieved remarkable progress in this task, most of the existing works need…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Yue Tao , Zhiwei Jia , Runze Ma , Shugong Xu

Training scene graph classification models requires a large amount of annotated image data. Meanwhile, scene graphs represent relational knowledge that can be modeled with symbolic data from texts or knowledge graphs. While image annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Sahand Sharifzadeh , Sina Moayed Baharlou , Martin Schmitt , Hinrich Schütze , Volker Tresp

Existing scene text removal (STR) task suffers from insufficient training data due to the expensive pixel-level labeling. In this paper, we aim to address this issue by introducing a Text-aware Masked Image Modeling algorithm (TMIM), which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Zixiao Wang , Hongtao Xie , YuXin Wang , Yadong Qu , Fengjun Guo , Pengwei Liu

Scene text recognition (STR) involves the task of reading text in cropped images of natural scenes. Conventional models in STR employ convolutional neural network (CNN) followed by recurrent neural network in an encoder-decoder framework.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yew Lee Tan , Adams Wai-kin Kong , Jung-Jae Kim

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Scene text recognition (STR) has been extensively studied in last few years. Many recently-proposed methods are specially designed to accommodate the arbitrary shape, layout and orientation of scene texts, but ignoring that various font (or…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Yizhi Wang , Zhouhui Lian

The existing image feature extraction methods are primarily based on the content and structure information of images, and rarely consider the contextual semantic information. Regarding some types of images such as scenes and objects, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Chiranjibi Sitaula , Yong Xiang , Anish Basnet , Sunil Aryal , Xuequan Lu

Linguistic knowledge has brought great benefits to scene text recognition by providing semantics to refine character sequences. However, since linguistic knowledge has been applied individually on the output sequence, previous methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Byeonghu Na , Yoonsik Kim , Sungrae Park

Scene text recognition (STR) has been widely studied in academia and industry. Training a text recognition model often requires a large amount of labeled data, but data labeling can be difficult, expensive, or time-consuming, especially for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yi-Chang Chen , Yu-Chuan Chang , Yen-Cheng Chang , Yi-Ren Yeh