English
Related papers

Related papers: Correcting diacritics and typos with a ByT5 transf…

200 papers

Sophisticated grammatical error detection/correction tools are available for a small set of languages such as English and Chinese. However, it is not straightforward -- if not impossible -- to adapt them to morphologically rich languages…

Computation and Language · Computer Science 2024-10-17 Ali Gebeşçe , Gözde Gül Şahin

The attention mechanisms are playing a boosting role in advancements in sequence-to-sequence problems. Transformer architecture achieved new state of the art results in machine translation, and it's variants are since being introduced in…

Machine Learning · Computer Science 2020-05-12 Abhishek Niranjan , M Ali Basha Shaik , Kushal Verma

This paper presents an empirical study of two machine translation-based approaches for Vietnamese diacritic restoration problem, including phrase-based and neural-based machine translation models. This is the first work that applies…

Computation and Language · Computer Science 2017-10-27 Thai-Hoang Pham , Xuan-Khoai Pham , Phuong Le-Hong

Grammatical Error Correction (GEC) aims to automatically detect and correct grammatical errors. In this aspect, dominant models are trained by one-iteration learning while performing multiple iterations of corrections during inference.…

Computation and Language · Computer Science 2022-03-18 Shaopeng Lai , Qingyu Zhou , Jiali Zeng , Zhongli Li , Chao Li , Yunbo Cao , Jinsong Su

Dyslexic spelling errors exhibit systematic phonological and orthographic patterns that distinguish them from the errors produced by typically developing writers. While this observation has motivated dyslexic-specific spell-checking and…

Computation and Language · Computer Science 2026-04-03 Samuel Rose , Debarati Chakraborty

This study propose a fully automated system for speech correction and accent reduction. Consider the application scenario that a recorded speech audio contains certain errors, e.g., inappropriate words, mispronunciations, that need to be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Daxin Tan , Liqun Deng , Nianzu Zheng , Yu Ting Yeung , Xin Jiang , Xiao Chen , Tan Lee

In this paper, we explore the capacity of a language model-based method for grammatical error detection in detail. We first show that 5 to 10% of training data are enough for a BERT-based error detection method to achieve performance…

Computation and Language · Computer Science 2021-08-30 Ryo Nagata , Manabu Kimura , Kazuaki Hanawa

This paper proposes a framework to improve the typing experience of mobile users in morphologically rich languages. Smartphone keyboards typically support features such as input decoding, corrections and predictions that all rely on…

Computation and Language · Computer Science 2022-01-19 Andreas Kabel , Keith Hall , Tom Ouyang , David Rybach , Daan van Esch , Françoise Beaufays

This study introduces AyutthayaAlpha, an advanced transformer-based machine learning model designed for the transliteration of Thai proper names into Latin script. Our system achieves state-of-the-art performance with 82.32% first-token…

Computation and Language · Computer Science 2024-12-06 Davor Lauc , Attapol Rutherford , Weerin Wongwarawipatr

Spell-checking is the process of detecting and sometimes providing suggestions for incorrectly spelled words in a text. Basically, the larger the dictionary of a spell-checker is, the higher is the error detection rate; otherwise,…

Computation and Language · Computer Science 2012-04-03 Youssef Bassil

Tashkeel, or Arabic Text Diacritization (ATD), greatly enhances the comprehension of Arabic text by removing ambiguity and minimizing the risk of misinterpretations caused by its absence. It plays a crucial role in improving Arabic text…

Computation and Language · Computer Science 2024-07-16 Faris Alasmary , Orjuwan Zaafarani , Ahmad Ghannam

This article presents an experiment in fine-tuning a pretrained causal language model (Meta's Llama 3.1 8B Instruct) to assist with restoring missing or illegible characters in ancient Greek inscriptions and documentary papyri. Utilizing a…

Computation and Language · Computer Science 2024-11-19 Eric Cullhed

We present a novel language adaptable spell checking system which detects spelling errors and suggests context sensitive corrections in real-time. We show that our system can be extended to new languages with minimal language-specific…

Computation and Language · Computer Science 2019-10-25 Prabhakar Gupta

Phonetic error detection, a core subtask of automatic pronunciation assessment, identifies pronunciation deviations at the phoneme level. Speech variability from accents and dysfluencies challenges accurate phoneme recognition, with current…

This paper studies Chinese Spelling Correction (CSC), which aims to detect and correct the potential spelling errors in a given sentence. Current state-of-the-art methods regard CSC as a sequence tagging task and fine-tune BERT-based models…

Computation and Language · Computer Science 2024-02-29 Linfeng Liu , Hongqiu Wu , Hai Zhao

Yor\`ub\'a is a widely spoken West African language with a writing system rich in tonal and orthographic diacritics. With very few exceptions, diacritics are omitted from electronic texts, due to limited device and application support.…

Computation and Language · Computer Science 2018-10-31 Iroro Orife

Hausa texts are often characterized by writing anomalies, such as incorrect character substitutions and spacing errors, which sometimes hinder natural language processing (NLP) applications. This paper presents an approach to automatically…

Computation and Language · Computer Science 2026-05-05 Ahmad Mustapha Wali , Sergiu Nisioi

Machine transliteration is a method for automatically converting words in one language into phonetically equivalent ones in another language. Machine transliteration plays an important role in natural language applications such as…

Computation and Language · Computer Science 2011-10-10 K. Choi , H. Isahara , J. Oh

Handwritten Text Recognition (HTR) is still a challenging problem because it must deal with two important difficulties: the variability among writing styles, and the scarcity of labelled data. To alleviate such problems, synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Lei Kang , Marçal Rusiñol , Alicia Fornés , Pau Riba , Mauricio Villegas

This paper introduces F5-TTS, a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT). Without requiring complex designs such as duration model, text encoder, and phoneme alignment, the text…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yushen Chen , Zhikang Niu , Ziyang Ma , Keqi Deng , Chunhui Wang , Jian Zhao , Kai Yu , Xie Chen