English
Related papers

Related papers: The Unreasonable Effectiveness of Transformer Lang…

200 papers

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction…

Grammatical error correction (GEC) systems strive to correct both global errors in word order and usage, and local errors in spelling and inflection. Further developing upon recent work on neural machine translation, we propose a new hybrid…

Computation and Language · Computer Science 2017-07-11 Jianshu Ji , Qinlong Wang , Kristina Toutanova , Yongen Gong , Steven Truong , Jianfeng Gao

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are passed to the model…

Computation and Language · Computer Science 2021-06-01 Kevin Parnow , Zuchao Li , Hai Zhao

Recent works in Grammatical Error Correction (GEC) have leveraged the progress in Neural Machine Translation (NMT), to learn rewrites from parallel corpora of grammatically incorrect and corrected sentences, achieving state-of-the-art…

Computation and Language · Computer Science 2020-10-07 Vipul Raheja , Dimitrios Alikaniotis

Grammatical Error Correction (GEC) is the task of automatically detecting and correcting errors in text. The task not only includes the correction of grammatical errors, such as missing prepositions and mismatched subject-verb agreement,…

Computation and Language · Computer Science 2023-12-05 Christopher Bryant , Zheng Yuan , Muhammad Reza Qorib , Hannan Cao , Hwee Tou Ng , Ted Briscoe

Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token generation, so…

Computation and Language · Computer Science 2023-11-15 Konstantin Yakovlev , Alexander Podolskiy , Andrey Bout , Sergey Nikolenko , Irina Piontkovskaya

Grammatical Error Correction (GEC) is a task of detecting and correcting grammatical errors in sentences. Recently, neural machine translation systems have become popular approaches for this task. However, these methods lack the use of…

Computation and Language · Computer Science 2021-11-08 Zhaohong Wan , Xiaojun Wan

Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical…

Computation and Language · Computer Science 2021-04-19 Aomi Koyama , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Grammatical error correction is a significant task in NLP. Traditional methods based on encoder-decoder models have achieved certain success, but the application of LLMs in this field is still underexplored. Current research predominantly…

Computation and Language · Computer Science 2025-08-27 Yilin Li , Xunjian Yin , Yilin Chen , Xiaojun Wan

Grammatical error correction (GEC) is the task of detecting and correcting grammatical errors in texts written by second language learners. The statistical machine translation (SMT) approach to GEC, in which sentences written by second…

Computation and Language · Computer Science 2016-06-02 Duc Tam Hoang , Shamil Chollampatt , Hwee Tou Ng

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi

Error type information has been widely used to improve the performance of grammatical error correction (GEC) models, whether for generating corrections, re-ranking them, or combining GEC models. Combining GEC models that have complementary…

Computation and Language · Computer Science 2024-11-01 Muhammad Reza Qorib , Alham Fikri Aji , Hwee Tou Ng

We propose a neural encoder-decoder model with reinforcement learning (NRL) for grammatical error correction (GEC). Unlike conventional maximum likelihood estimation (MLE), the model directly optimizes towards an objective that considers a…

Computation and Language · Computer Science 2017-07-04 Keisuke Sakaguchi , Matt Post , Benjamin Van Durme

Progress in neural grammatical error correction (GEC) is hindered by the lack of annotated training data. Sufficient amounts of high-quality manually annotated data are not available, so recent research has relied on generating synthetic…

Computation and Language · Computer Science 2023-11-21 Andrey Bout , Alexander Podolskiy , Sergey Nikolenko , Irina Piontkovskaya

Evaluation of grammatical error correction (GEC) systems has primarily focused on essays written by non-native learners of English, which however is only part of the full spectrum of GEC applications. We aim to broaden the target domain of…

Computation and Language · Computer Science 2020-10-16 Simon Flachs , Ophélie Lacroix , Helen Yannakoudakis , Marek Rei , Anders Søgaard

Current grammatical error correction (GEC) models typically consider the task as sequence generation, which requires large amounts of annotated data and limit the applications in data-limited settings. We try to incorporate contextual…

Computation and Language · Computer Science 2020-01-13 Yiyuan Li , Antonios Anastasopoulos , Alan W Black

Grammar error correction (GEC) systems have become ubiquitous in a variety of software applications, and have started to approach human-level performance for some datasets. However, very little is known about how to efficiently personalize…

Computation and Language · Computer Science 2020-06-05 Maria Nadejde , Joel Tetreault

We present a grammar error correction (GEC) system that achieves state of the art for the Czech language. Our system is based on a neural network translation approach with the Transformer architecture, and its key feature is its real-time…

Computation and Language · Computer Science 2025-08-28 Petr Pechman , Milan Straka , Jana Straková , Jakub Náplava

Large language models based on transformer architectures have become integral to state-of-the-art natural language processing applications. However, their training remains computationally expensive and exhibits instabilities, some of which…

Numerical Analysis · Mathematics 2025-03-14 Stanislav Budzinskiy , Wenyi Fang , Longbin Zeng , Philipp Petersen

Grammatical Error Correction (GEC) systems perform a sequence-to-sequence task, where an input word sequence containing grammatical errors, is corrected for these errors by the GEC system to output a grammatically correct word sequence.…

Computation and Language · Computer Science 2022-08-22 Vyas Raina , Mark Gales