English
Related papers

Related papers: Leveraging Text Repetitions and Denoising Autoenco…

200 papers

Attention-based sequence-to-sequence models for speech recognition jointly train an acoustic model, language model (LM), and alignment mechanism using a single neural network and require only parallel audio-text pairs. Thus, the language…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-20 Jinxi Guo , Tara N. Sainath , Ron J. Weiss

In this paper I have proposed a method to find the major pixel intensity inside the text and thresholding an image accordingly to make it easier to be used for optical character recognition (OCR) models. In our method, instead of editing…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Rohan Lal Kshetry

Building large-scale datasets for training code-switching language models is challenging and very expensive. To alleviate this problem using parallel corpus has been a major workaround. However, existing solutions use linguistic constraints…

Computation and Language · Computer Science 2018-10-31 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

We analyze the performance of encoder-decoder neural models and compare them with well-known established methods. The latter represent different classes of traditional approaches that are applied to the monotone sequence-to-sequence tasks…

Computation and Language · Computer Science 2016-10-27 Carsten Schnober , Steffen Eger , Erik-Lân Do Dinh , Iryna Gurevych

Effective representation learning is critical for short text clustering due to the sparse, high-dimensional and noise attributes of short text corpus. Existing pre-trained models (e.g., Word2vec and BERT) have greatly improved the…

Computation and Language · Computer Science 2021-09-22 Hui Yin , Xiangyu Song , Shuiqiao Yang , Guangyan Huang , Jianxin Li

We aim to investigate the performance of current OCR systems on low resource languages and low resource scripts. We introduce and make publicly available a novel benchmark, OCR4MT, consisting of real and synthetic data, enriched with noise,…

Computation and Language · Computer Science 2022-03-15 Oana Ignat , Jean Maillard , Vishrav Chaudhary , Francisco Guzmán

Attention-based sequence-to-sequence (seq2seq) speech synthesis has achieved extraordinary performance. But a studio-quality corpus with manual transcription is necessary to train such seq2seq systems. In this paper, we propose an approach…

Sound · Computer Science 2020-10-28 Shan Yang , Yuxuan Wang , Lei Xie

A crucial component for the scene text based reasoning required for TextVQA and TextCaps datasets involve detecting and recognizing text present in the images using an optical character recognition (OCR) system. The current systems are…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Amanpreet Singh , Guan Pang , Mandy Toh , Jing Huang , Wojciech Galuba , Tal Hassner

The biggest challenge in the field of image processing is to recognize documents both in printed and handwritten format. Optical Character Recognition OCR is a type of document image analysis where scanned digital image that contains either…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Singh Vijendra , Nisha Vasudeva , Hem Jyotsana Parashar

In recent years, text-image joint pre-training techniques have shown promising results in various tasks. However, in Optical Character Recognition (OCR) tasks, aligning text instances with their corresponding text regions in images poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Chen Duan , Pei Fu , Shan Guo , Qianyi Jiang , Xiaoming Wei

Grammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, GEC suffers from the lack of plentiful parallel data. We…

Computation and Language · Computer Science 2019-04-12 Jared Lichtarge , Chris Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar , Simon Tong

Text images contain both visual and linguistic information. However, existing pre-training techniques for text recognition mainly focus on either visual representation learning or linguistic knowledge learning. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Pengyuan Lyu , Chengquan Zhang , Shanshan Liu , Meina Qiao , Yangliu Xu , Liang Wu , Kun Yao , Junyu Han , Errui Ding , Jingdong Wang

Recurrent Neural Networks (RNN) have recently achieved the best performance in off-line Handwriting Text Recognition. At the same time, learning RNN by gradient descent leads to slow convergence, and training times are particularly long…

Machine Learning · Computer Science 2013-12-09 Jérôme Louradour , Christopher Kermorvant

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learners, and produces a…

Computation and Language · Computer Science 2021-04-21 Eetu Sjöblom , Mathias Creutz , Teemu Vahtola

There are many difficulties facing a handwritten Arabic recognition system such as unlimited variation in human handwriting, similarities of distinct character shapes, interconnections of neighbouring characters and their position in the…

Computer Vision and Pattern Recognition · Computer Science 2014-02-27 Ahmed Sahlol , Cheng Suen

Neural Encoders are frequently used in the NLP domain to perform dense retrieval tasks, for instance, to generate the candidate documents for a given query in question-answering tasks. However, sparse annotation and label noise in the…

Machine Learning · Computer Science 2025-12-16 Arnab Sharma

This paper presents an simple yet sophisticated approach to the challenge by Sproat and Jaitly (2016)- given a large corpus of written text aligned to its normalized spoken form, train an RNN to learn the correct normalization function.…

Computation and Language · Computer Science 2017-12-20 Maryam Zare , Shaurya Rohatgi

The dearth of clean textual data often acts as a bottleneck in several natural language processing applications. The data available often lacks proper case (uppercase or lowercase) information. This often comes up when text is obtained from…

Computation and Language · Computer Science 2021-01-21 Gopi Ramena , Divija Nagaraju , Sukumar Moharana , Debi Prasanna Mohanty , Naresh Purre

The objective of the paper is to recognize handwritten samples of lower case Roman script using Tesseract open source Optical Character Recognition (OCR) engine under Apache License 2.0. Handwritten data samples containing isolated and…

Computer Vision and Pattern Recognition · Computer Science 2010-03-31 Sandip Rakshit , Subhadip Basu

Automatic speech recognition (ASR) systems often make unrecoverable errors due to subsystem pruning (acoustic, language and pronunciation models); for example pruning words due to acoustics using short-term context, prior to rescoring with…

Computation and Language · Computer Science 2019-07-01 Prashanth Gurunath Shivakumar , Haoqi Li , Kevin Knight , Panayiotis Georgiou