English
Related papers

Related papers: Correcting diacritics and typos with a ByT5 transf…

200 papers

In this paper, we reformulated the spell correction problem as a machine translation task under the encoder-decoder framework. This reformulation enabled us to use a single model for solving the problem that is traditionally formulated as…

Computation and Language · Computer Science 2019-05-21 Yingbo Zhou , Utkarsh Porwal , Roberto Konow

In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic…

Computation and Language · Computer Science 2023-06-01 Parker Glenn , Parag Pravin Dakle , Preethi Raghavan

Spelling error correction is one of topics which have a long history in natural language processing. Although previous studies have achieved remarkable results, challenges still exist. In the Vietnamese language, a state-of-the-art method…

Computation and Language · Computer Science 2021-11-10 Dinh-Truong Do , Ha Thanh Nguyen , Thang Ngoc Bui , Dinh Hieu Vo

Spelling correction is a remarkable challenge in the field of natural language processing. The objective of spelling correction tasks is to recognize and rectify spelling errors automatically. The development of applications that can…

Computation and Language · Computer Science 2024-05-07 Mohammad Dehghani , Heshaam Faili

We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e., poor and good). The…

Computation and Language · Computer Science 2020-11-03 Wangchunshu Zhou , Tao Ge , Chang Mu , Ke Xu , Furu Wei , Ming Zhou

The prevalence of half-truths, which are statements containing some truth but that are ultimately deceptive, has risen with the increasing use of the internet. To help combat this problem, we have created a comprehensive pipeline consisting…

Computation and Language · Computer Science 2023-08-17 Sandeep Singamsetty , Nishtha Madaan , Sameep Mehta , Varad Bhatnagar , Pushpak Bhattacharyya

Most of previous work on learning diacritization of the Arabic language relied on training models from scratch. In this paper, we investigate how to leverage pre-trained language models to learn diacritization. We finetune token-free…

Computation and Language · Computer Science 2023-03-28 Bashar Al-Rfooh , Gheith Abandah , Rami Al-Rfou

Automated program repair using neural models has shown promising results on benchmark datasets, yet practical deployment remains limited. In this study, we examine whether a small transformer model can meaningfully repair real-world Java…

Software Engineering · Computer Science 2025-12-30 Shaunak Samant

Automatic translation of dialogue texts is a much needed demand in many real life scenarios. However, the currently existing neural machine translation delivers unsatisfying results. In this paper, we conduct a deep analysis of a dialogue…

Computation and Language · Computer Science 2021-04-22 Tao Wang , Chengqi Zhao , Mingxuan Wang , Lei Li , Deyi Xiong

Models that rely on subword tokenization have significant drawbacks, such as sensitivity to character-level noise like spelling errors and inconsistent compression rates across different languages and scripts. While character- or byte-level…

Computation and Language · Computer Science 2025-04-03 Julie Kallini , Shikhar Murty , Christopher D. Manning , Christopher Potts , Róbert Csordás

Gradual typing enables developers to annotate types of their own choosing, offering a flexible middle ground between no type annotations and a fully statically typed language. As more and more code bases get type-annotated, static type…

Software Engineering · Computer Science 2024-01-15 Yiu Wai Chow , Luca Di Grazia , Michael Pradel

In recent years, speaker diarization has attracted widespread attention. To achieve better performance, some studies propose to diarize speech in multiple stages. Although these methods might bring additional benefits, most of them are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Jiangyu Han , Yuhang Cao , Heng Lu , Yanhua Long

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

The lack of large-scale datasets has been a major hindrance to the development of NLP tasks such as spelling correction and grammatical error correction (GEC). As a complementary new resource for these tasks, we present the GitHub Typo…

Computation and Language · Computer Science 2019-12-02 Masato Hagiwara , Masato Mita

Natural language correction has the potential to help language learners improve their writing skills. While approaches with separate classifiers for different error types have high precision, they do not flexibly handle errors such as…

Computation and Language · Computer Science 2016-04-01 Ziang Xie , Anand Avati , Naveen Arivazhagan , Dan Jurafsky , Andrew Y. Ng

The sequence-to-sequence (Seq2Seq) approach has recently been widely used in grammatical error correction (GEC) and shows promising performance. However, the Seq2Seq GEC approach still suffers from two issues. First, a Seq2Seq GEC model can…

Computation and Language · Computer Science 2023-10-24 Houquan Zhou , Yumeng Liu , Zhenghua Li , Min Zhang , Bo Zhang , Chen Li , Ji Zhang , Fei Huang

With natural language processing (NLP), researchers aim to enable computers to identify and understand patterns in human languages. This is often difficult because a language embeds many dynamic and varied properties in its syntax,…

Computation and Language · Computer Science 2026-01-27 Ignatius Ezeani

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in Chinese sentences caused by phonetic or visual similarities. While current CSC models integrate pinyin or glyph features and have shown significant…

Computation and Language · Computer Science 2024-09-10 Lei Sheng , Shuai-Shuai Xu

More than 2 billion mobile users worldwide type in multiple languages in the soft keyboard. On a monolingual keyboard, 38% of falsely auto-corrected words are valid in another language. This can be easily avoided by detecting the language…

Computation and Language · Computer Science 2021-01-12 Sourabh Vasant Gothe , Sourav Ghosh , Sharmila Mani , Guggilla Bhanodai , Ankur Agarwal , Chandramouli Sanchi

This report proposes state-of-the-art research in the field of Computer Assisted Language Learning (CALL). Mispronunciation detection is one of the core components of Computer Assisted Pronunciation Training (CAPT) systems which is a subset…

Sound · Computer Science 2022-01-26 Neha Baranwal , Sharatkumar Chilaka