English
Related papers

Related papers: A Comprehensive Survey of Grammar Error Correction

200 papers

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction…

We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transformer sequence-to-sequence model on 4B tokens of Wikipedia…

Computation and Language · Computer Science 2018-11-06 Jared Lichtarge , Christopher Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar

Automatic evaluation in grammatical error correction (GEC) is crucial for selecting the best-performing systems. Currently, reference-based metrics are a popular choice, which basically measure the similarity between hypothesis and…

Computation and Language · Computer Science 2026-02-06 Takumi Goto , Yusuke Sakai , Taro Watanabe

This work proposes a syntax-enhanced grammatical error correction (GEC) approach named SynGEC that effectively incorporates dependency syntactic information into the encoder part of GEC models. The key challenge for this idea is that…

Computation and Language · Computer Science 2022-10-25 Yue Zhang , Bo Zhang , Zhenghua Li , Zuyi Bao , Chen Li , Min Zhang

Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, these annotations are unavailable in many low-resource languages. In this paper, we investigate GED in this context. Leveraging the zero-shot…

Computation and Language · Computer Science 2024-07-17 Gaetan Lopez Latouche , Marc-André Carbonneau , Ben Swanson

We explore and improve the capabilities of LLMs to generate data for grammatical error correction (GEC). When merely producing parallel sentences, their patterns are too simplistic to be valuable as a corpus. To address this issue, we…

Computation and Language · Computer Science 2024-06-12 Jeiyoon Park , Chanjun Park , Heuiseok Lim

Most existing Grammatical Error Correction (GEC) methods based on sequence-to-sequence mainly focus on how to generate more pseudo data to obtain better performance. Few work addresses few-shot GEC domain adaptation. In this paper, we treat…

Computation and Language · Computer Science 2021-02-01 Shengsheng Zhang , Yaping Huang , Yun Chen , Liner Yang , Chencheng Wang , Erhong Yang

Grammatical error correction tools are effective at correcting grammatical errors in users' input sentences but do not provide users with \textit{natural language} explanations about their errors. Such explanations are essential for helping…

Computation and Language · Computer Science 2023-11-17 Yixiao Song , Kalpesh Krishna , Rajesh Bhatt , Kevin Gimpel , Mohit Iyyer

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learners, and produces a…

Computation and Language · Computer Science 2021-04-21 Eetu Sjöblom , Mathias Creutz , Teemu Vahtola

We extend a current sequence-tagging approach to Grammatical Error Correction (GEC) by introducing specialised tags for spelling correction and morphological inflection using the SymSpell and LemmInflect algorithms. Our approach improves…

Computation and Language · Computer Science 2023-02-14 Stuart Mesham , Christopher Bryant , Marek Rei , Zheng Yuan

Generative Error Correction (GEC) has emerged as a powerful post-processing method to enhance the performance of Automatic Speech Recognition (ASR) systems. However, we show that GEC models struggle to generalize beyond the specific types…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Sreyan Ghosh , Mohammad Sadegh Rasooli , Michael Levit , Peidong Wang , Jian Xue , Dinesh Manocha , Jinyu Li

Decoder-only large language models have shown superior performance in the fluency-edit English Grammatical Error Correction, but their adaptation for minimal-edit English GEC is still underexplored. To improve their effectiveness in the…

Computation and Language · Computer Science 2025-06-17 Ryszard Staruch , Filip Graliński , Daniel Dzienisiewicz

Chinese Grammatical Error Correction (CGEC) has been attracting growing attention from researchers recently. In spite of the fact that multiple CGEC datasets have been developed to support the research, these datasets lack the ability to…

Computation and Language · Computer Science 2023-11-10 Hanyue Du , Yike Zhao , Qingyuan Tian , Jiani Wang , Lei Wang , Yunshi Lan , Xuesong Lu

Studies on grammatical error correction (GEC) have reported the effectiveness of pretraining a Seq2Seq model with a large amount of pseudodata. However, this approach requires time-consuming pretraining for GEC because of the size of the…

Computation and Language · Computer Science 2020-10-01 Satoru Katsumata , Mamoru Komachi

In this paper, we present a simple and efficient GEC sequence tagger using a Transformer encoder. Our system is pre-trained on synthetic data and then fine-tuned in two stages: first on errorful corpora, and second on a combination of…

Computation and Language · Computer Science 2020-06-01 Kostiantyn Omelianchuk , Vitaliy Atrasevych , Artem Chernodub , Oleksandr Skurzhanskyi

Recently, Zhang et al. (2022) propose a syntax-aware grammatical error correction (GEC) approach, named SynGEC, showing that incorporating tailored dependency-based syntax of the input sentence is quite beneficial to GEC. This work…

Computation and Language · Computer Science 2022-11-16 Yue Zhang , Zhenghua Li

Research on Korean grammatical error correction (GEC) is limited, compared to other major languages such as English. We attribute this problematic circumstance to the lack of a carefully designed evaluation benchmark for Korean GEC. In this…

Computation and Language · Computer Science 2023-05-25 Soyoung Yoon , Sungjoon Park , Gyuwan Kim , Junhee Cho , Kihyo Park , Gyutae Kim , Minjoon Seo , Alice Oh

Reference-free evaluation metrics for grammatical error correction (GEC) have achieved high correlation with human judgments. However, these metrics are not designed to evaluate adversarial systems that aim to obtain unjustifiably high…

Computation and Language · Computer Science 2025-10-01 Takumi Goto , Yusuke Sakai , Taro Watanabe

In this paper we show that GEC systems display gender bias related to the use of masculine and feminine terms and the gender-neutral singular "they". We develop parallel datasets of texts with masculine and feminine terms and singular…

Computation and Language · Computer Science 2023-06-14 Gunnar Lund , Kostiantyn Omelianchuk , Igor Samokhin

Large language models (LLMs) finetuned to follow human instruction have recently exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC), especially on languages…

Computation and Language · Computer Science 2023-12-15 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed