English
Related papers

Related papers: An Unsupervised Normalization Algorithm for Noisy …

200 papers

Document denoising is considered one of the most challenging tasks in computer vision. There exist millions of documents that are still to be digitized, but problems like document degradation due to natural and man-made factors make this…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Yashowardhan Shinde , Kishore Kulkarni , Sachin Kuberkar

Social media networks and chatting platforms often use an informal version of natural text. Adversarial spelling attacks also tend to alter the input text by modifying the characters in the text. Normalizing these texts is an essential step…

Computation and Language · Computer Science 2020-06-26 Fenil Doshi , Jimit Gandhi , Deep Gosalia , Sudhir Bagul

Capitalization normalization (truecasing) is the task of restoring the correct case (uppercase or lowercase) of noisy text. We propose a fast, accurate and compact two-level hierarchical word-and-character-based recurrent neural network…

Computation and Language · Computer Science 2022-02-17 Hao Zhang , You-Chi Cheng , Shankar Kumar , W. Ronny Huang , Mingqing Chen , Rajiv Mathews

Research in unsupervised text generation has been gaining attention over the years. One recent approach is local search towards a heuristically defined objective, which specifies language fluency, semantic meanings, and other task-specific…

Computation and Language · Computer Science 2022-03-24 Weikai Steven Lu

We propose MoNoise: a normalization model focused on generalizability and efficiency, it aims at being easily reusable and adaptable. Normalization is the task of translating texts from a non- canonical domain to a more canonical domain, in…

Computation and Language · Computer Science 2017-10-11 Rob van der Goot , Gertjan van Noord

We introduce an unsupervised formulation to estimate heteroscedastic uncertainty in retrieval systems. We propose an extension to triplet loss that models data uncertainty for each input. Besides improving performance, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

This paper addresses the ethical concerns arising from the use of unauthorized public data in deep learning models and proposes a novel solution. Specifically, building on the work of Huang et al. (2021), we extend their bi-level…

Computation and Language · Computer Science 2024-10-15 Xinzhe Li , Ming Liu , Shang Gao

Scene text recognition (STR) attracts much attention over the years because of its wide application. Most methods train STR model in a fully supervised manner which requires large amounts of labeled data. Although synthetic data contributes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Caiyuan Zheng , Hui Li , Seon-Min Rhee , Seungju Han , Jae-Joon Han , Peng Wang

We perform text normalization, i.e. the transformation of words from the written to the spoken form, using a memory augmented neural network. With the addition of dynamic memory access and storage mechanism, we present a neural architecture…

Computation and Language · Computer Science 2019-04-05 Subhojeet Pramanik , Aman Hussain

Imaging is a standard example of an inverse problem, where the task of reconstructing a ground truth from a noisy measurement is ill-posed. Recent state-of-the-art approaches for imaging use deep learning, spearheaded by unrolled and…

The supervised training of high-capacity models on large datasets containing hundreds of thousands of document-summary pairs is critical to the recent success of deep learning techniques for abstractive summarization. Unfortunately, in most…

Computation and Language · Computer Science 2020-04-22 Reinald Kim Amplayo , Mirella Lapata

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

Machine Learning · Computer Science 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Fangrui Liu , Zheng Liu

Removing noise from scanned pages is a vital step before their submission to the optical character recognition (OCR) system. Most available image denoising methods are supervised where the pairs of noisy/clean pages are required. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Mehrdad J Gangeh , Marcin Plata , Hamid Motahari , Nigel P Duffy

We present an architecture for information extraction from text that augments an existing parser with a character-level neural network. The network is trained using a measure of consistency of extracted data with existing databases as a…

Computation and Language · Computer Science 2017-01-25 Philipp Meerkamp , Zhengyi Zhou

Recurrent neural networks (RNNs) are powerful models of sequential data. They have been successfully used in domains such as text and speech. However, RNNs are susceptible to overfitting; regularization is important. In this paper we…

Machine Learning · Statistics 2018-07-16 Adji B. Dieng , Rajesh Ranganath , Jaan Altosaar , David M. Blei

Text normalization is an essential task in the processing and analysis of social media that is dominated with informal writing. It aims to map informal words to their intended standard forms. Previously proposed text normalization…

Computation and Language · Computer Science 2017-12-29 Salman Ahmad Ansari , Usman Zafar , Asim Karim

The massive amounts of web-mined parallel data contain large amounts of noise. Semantic misalignment, as the primary source of the noise, poses a challenge for training machine translation systems. In this paper, we first introduce a…

Computation and Language · Computer Science 2025-02-10 Yan Meng , Di Wu , Christof Monz

Text classification is a widely studied problem and has broad applications. In many real-world problems, the number of texts for training classification models is limited, which renders these models prone to overfitting. To address this…

Computation and Language · Computer Science 2021-03-25 Meng Zhou , Zechen Li , Pengtao Xie

In this paper, we focus on the challenge of learning controllable text simplifications in unsupervised settings. While this problem has been previously discussed for supervised learning algorithms, the literature on the analogies in…

Computation and Language · Computer Science 2020-12-04 Oleg Kariuk , Dima Karamshuk