English
Related papers

Related papers: TrOCR: Transformer-based Optical Character Recogni…

200 papers

This research paper introduces a novel word-level Optical Character Recognition (OCR) model specifically designed for digital Urdu text, leveraging transformer-based architectures and attention mechanisms to address the distinct challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Ahmed Mustafa , Muhammad Tahir Rafique , Muhammad Ijlal Baig , Hasan Sajid , Muhammad Jawad Khan , Karam Dad Kallu

Traditional OCR systems (OCR-1.0) are increasingly unable to meet people's usage due to the growing demand for intelligent processing of man-made optical characters. In this paper, we collectively refer to all artificial optical signals…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Haoran Wei , Chenglong Liu , Jinyue Chen , Jia Wang , Lingyu Kong , Yanming Xu , Zheng Ge , Liang Zhao , Jianjian Sun , Yuang Peng , Chunrui Han , Xiangyu Zhang

Most existing audio-text retrieval (ATR) approaches typically rely on a single-level interaction to associate audio and text, limiting their ability to align different modalities and leading to suboptimal matches. In this work, we present a…

Sound · Computer Science 2025-05-06 Yifei Xin , Zhihong Zhu , Xuxin Cheng , Xusheng Yang , Yuexian Zou

Prior work on Sign Language Translation has shown that having a mid-level sign gloss representation (effectively recognizing the individual signs) improves the translation performance drastically. In fact, the current state-of-the-art in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

Text Classification is the most essential and fundamental problem in Natural Language Processing. While numerous recent text classification models applied the sequential deep learning technique, graph neural network-based models can…

Computation and Language · Computer Science 2024-07-08 Kunze Wang , Yihao Ding , Soyeon Caren Han

A common approach for improving OCR quality is a post-processing step based on models correcting misdetected characters and tokens. These models are typically trained on aligned pairs of OCR read text and their manually corrected…

Computation and Language · Computer Science 2019-06-27 Kai Hakala , Aleksi Vesanto , Niko Miekka , Tapio Salakoski , Filip Ginter

Recent progress in deep learning has led to the development of Optical Character Recognition (OCR) systems which perform remarkably well. Most research has been around recurrent networks as well as complex gated layers which make the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Kartik Chaudhary , Raghav Bali

Speech recognition technologies are gaining enormous popularity in various industrial applications. However, building a good speech recognition system usually requires large amounts of transcribed data, which is expensive to collect. To…

Computation and Language · Computer Science 2019-11-01 Dongwei Jiang , Xiaoning Lei , Wubo Li , Ne Luo , Yuxuan Hu , Wei Zou , Xiangang Li

Recurrent Neural Networks (RNN) have recently achieved the best performance in off-line Handwriting Text Recognition. At the same time, learning RNN by gradient descent leads to slow convergence, and training times are particularly long…

Machine Learning · Computer Science 2013-12-09 Jérôme Louradour , Christopher Kermorvant

Achieving robustness in recognition systems across diverse domains is crucial for their practical utility. While ample data availability is usually assumed, low-resource languages, such as ancient manuscripts and non-western languages, tend…

Machine Learning · Computer Science 2025-06-19 Adrià Molina Rodríguez , Oriol Ramos Terrades , Josep Lladós

Encoder-decoder models have become an effective approach for sequence learning tasks like machine translation, image captioning and speech recognition, but have yet to show competitive results for handwritten text recognition. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Johannes Michael , Roger Labahn , Tobias Grüning , Jochen Zöllner

Video OCR is a technique that can greatly help to locate the topics of interest in video via the automatic extraction and reading of captions and annotations. Text in video can provide key indexing information. Recognizing such text for…

Information Retrieval · Computer Science 2013-01-03 Sankirti S. , P. M. Kamade

Transformer has become the new standard method in natural language processing (NLP), and it also attracts research interests in computer vision area. In this paper we investigate the application of Transformer in Image Quality (TRIQ)…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Junyong You , Jari Korhonen

Convolutional Recurrent Neural Networks (CRNNs) excel at scene text recognition. Unfortunately, they are likely to suffer from vanishing/exploding gradient problems when processing long text images, which are commonly found in scanned…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Duc Nguyen , Nhan Tran , Hung Le

Transformer-based OCR models have shown strong performance on Latin and CJK scripts, but their application to African syllabic writing systems remains limited. We present the first adaptation of TrOCR for printed Tigrinya using the Ge'ez…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yonatan Haile Medhanie , Yuanhua Ni

Handwritten Text Recognition remains challenging due to the limited data, high writing style variance, and scripts with complex diacritics. Existing approaches, though partially address these issues, often struggle to generalize without…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Pham Thach Thanh Truc , Dang Hoai Nam , Huynh Tong Dang Khoa , Vo Nguyen Le Duy

Reading text in the wild is a challenging task in the field of computer vision. Existing approaches mainly adopted Connectionist Temporal Classification (CTC) or Attention models based on Recurrent Neural Network (RNN), which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yunze Gao , Yingying Chen , Jinqiao Wang , Hanqing Lu

Rectified Flow (RF) models have advanced high-quality image and video synthesis via optimal transport theory. However, when applied to image-to-image translation, they still depend on costly multi-step denoising, hindering real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Shengqian Li , Ming Gao , Yi Liu , Zuzeng Lin , Feng Wang , Feng Dai

Image captioning is shown to be able to achieve a better performance by using scene graphs to represent the relations of objects in the image. The current captioning encoders generally use a Graph Convolutional Net (GCN) to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Xuewen Yang , Yingru Liu , Xin Wang

Cross-modal retrieval is an important functionality in modern search engines, as it increases the user experience by allowing queries and retrieved objects to pertain to different modalities. In this paper, we focus on the image-sentence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Nicola Messina , Giuseppe Amato , Fabrizio Falchi , Claudio Gennaro , Stéphane Marchand-Maillet