English
Related papers

Related papers: Data Weighted Training Strategies for Grammatical …

200 papers

Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical…

Computation and Language · Computer Science 2021-04-19 Aomi Koyama , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Resources for Grammatical Error Correction (GEC) in non-English languages are scarce, while available spellcheckers in these languages are mostly limited to simple corrections and rules. In this paper we introduce a first GEC corpus for…

Computation and Language · Computer Science 2026-04-28 Teodor-Mihai Cotet , Stefan Ruseti , Mihai Dascalu

While there exist strong benchmark datasets for grammatical error correction (GEC), high-quality annotated spoken datasets for Spoken GEC (SGEC) are still under-resourced. In this paper, we propose a fully automated method to generate…

Computation and Language · Computer Science 2025-07-28 Penny Karanasou , Mengjie Qian , Stefano Bannò , Mark J. F. Gales , Kate M. Knill

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi

There has been an increased interest in data generation approaches to grammatical error correction (GEC) using pseudo data. However, these approaches suffer from several issues that make them inconvenient for real-world deployment including…

Computation and Language · Computer Science 2021-06-08 Masato Mita , Hitomi Yanaka

Large language models (LLMs) finetuned to follow human instruction have recently exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC), especially on languages…

Computation and Language · Computer Science 2023-12-15 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token generation, so…

Computation and Language · Computer Science 2023-11-15 Konstantin Yakovlev , Alexander Podolskiy , Andrey Bout , Sergey Nikolenko , Irina Piontkovskaya

In this paper, we investigate improvements to the GEC sequence tagging architecture with a focus on ensembling of recent cutting-edge Transformer-based encoders in Large configurations. We encourage ensembling models by majority votes on…

Computation and Language · Computer Science 2022-03-25 Maksym Tarnavskyi , Artem Chernodub , Kostiantyn Omelianchuk

Most existing Grammatical Error Correction (GEC) methods based on sequence-to-sequence mainly focus on how to generate more pseudo data to obtain better performance. Few work addresses few-shot GEC domain adaptation. In this paper, we treat…

Computation and Language · Computer Science 2021-02-01 Shengsheng Zhang , Yaping Huang , Yun Chen , Liner Yang , Chencheng Wang , Erhong Yang

Studies on grammatical error correction (GEC) have reported the effectiveness of pretraining a Seq2Seq model with a large amount of pseudodata. However, this approach requires time-consuming pretraining for GEC because of the size of the…

Computation and Language · Computer Science 2020-10-01 Satoru Katsumata , Mamoru Komachi

Generative Error Correction (GEC) has emerged as a powerful post-processing method to enhance the performance of Automatic Speech Recognition (ASR) systems. However, we show that GEC models struggle to generalize beyond the specific types…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Sreyan Ghosh , Mohammad Sadegh Rasooli , Michael Levit , Peidong Wang , Jian Xue , Dinesh Manocha , Jinyu Li

Grammatical Error Correction (GEC) is the task of correcting errorful sentences into grammatically correct, semantically consistent, and coherent sentences. Popular GEC models either use large-scale synthetic corpora or use a large number…

Computation and Language · Computer Science 2023-07-06 Hejing Cao , Dongyan Zhao

One of the goals of automatic evaluation metrics in grammatical error correction (GEC) is to rank GEC systems such that it matches human preferences. However, current automatic evaluations are based on procedures that diverge from human…

Computation and Language · Computer Science 2025-06-04 Takumi Goto , Yusuke Sakai , Taro Watanabe

With the rise of globalisation, code-switching (CSW) has become a ubiquitous part of multilingual conversation, posing new challenges for natural language processing (NLP), especially in Grammatical Error Correction (GEC). This work…

Computation and Language · Computer Science 2024-10-15 Tom Potter , Zheng Yuan

Grammatical error correction (GEC) aims to correct grammatical, spelling, and semantic errors in natural language text. With the growing of large language models (LLMs), direct text generation has gradually become the focus of the GEC…

Computation and Language · Computer Science 2025-02-13 Wei Li , Wen Luo , Guangyue Peng , Houfeng Wang

In recent years, sequence-to-sequence models have been very effective for end-to-end grammatical error correction (GEC). As creating human-annotated parallel corpus for GEC is expensive and time-consuming, there has been work on artificial…

Computation and Language · Computer Science 2019-07-23 Phu Mon Htut , Joel Tetreault

Grammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, GEC suffers from the lack of plentiful parallel data. We…

Computation and Language · Computer Science 2019-04-12 Jared Lichtarge , Chris Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar , Simon Tong

Code-switching (CSW) is a common phenomenon among multilingual speakers where multiple languages are used in a single discourse or utterance. Mixed language utterances may still contain grammatical errors however, yet most existing Grammar…

Computation and Language · Computer Science 2024-08-13 Kelvin Wey Han Chan , Christopher Bryant , Li Nguyen , Andrew Caines , Zheng Yuan

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learners, and produces a…

Computation and Language · Computer Science 2021-04-21 Eetu Sjöblom , Mathias Creutz , Teemu Vahtola

Grammatical error correction in English is a long studied problem with many existing systems and datasets. However, there has been only a limited research on error correction of other languages. In this paper, we present a new dataset…

Computation and Language · Computer Science 2019-10-17 Jakub Náplava , Milan Straka