English
Related papers

Related papers: A BERT-based Unsupervised Grammatical Error Correc…

200 papers

Some grammatical error correction (GEC) systems incorporate hand-crafted rules and achieve positive results. However, manually defining rules is time-consuming and laborious. In view of this, we propose a method to mine error templates for…

Computation and Language · Computer Science 2022-06-24 Yue Zhang , Haochen Jiang , Zuyi Bao , Bo Zhang , Chen Li , Zhenghua Li

Grammatical error correction can be viewed as a low-resource sequence-to-sequence task, because publicly available parallel corpora are limited. To tackle this challenge, we first generate erroneous versions of large unannotated corpora…

Computation and Language · Computer Science 2019-07-03 Yo Joong Choe , Jiyeon Ham , Kyubyong Park , Yeoil Yoon

We present a grammar error correction (GEC) system that achieves state of the art for the Czech language. Our system is based on a neural network translation approach with the Transformer architecture, and its key feature is its real-time…

Computation and Language · Computer Science 2025-08-28 Petr Pechman , Milan Straka , Jana Straková , Jakub Náplava

In this paper, we explore the capacity of a language model-based method for grammatical error detection in detail. We first show that 5 to 10% of training data are enough for a BERT-based error detection method to achieve performance…

Computation and Language · Computer Science 2021-08-30 Ryo Nagata , Manabu Kimura , Kazuaki Hanawa

Large-scale pre-trained language models such as GPT-3 have shown remarkable performance across various natural language processing tasks. However, applying prompt-based methods with GPT-3 for Grammatical Error Correction (GEC) tasks and…

Computation and Language · Computer Science 2023-05-30 Mengsay Loem , Masahiro Kaneko , Sho Takase , Naoaki Okazaki

While there exist strong benchmark datasets for grammatical error correction (GEC), high-quality annotated spoken datasets for Spoken GEC (SGEC) are still under-resourced. In this paper, we propose a fully automated method to generate…

Computation and Language · Computer Science 2025-07-28 Penny Karanasou , Mengjie Qian , Stefano Bannò , Mark J. F. Gales , Kate M. Knill

Automatic evaluation in grammatical error correction (GEC) is crucial for selecting the best-performing systems. Currently, reference-based metrics are a popular choice, which basically measure the similarity between hypothesis and…

Computation and Language · Computer Science 2026-02-06 Takumi Goto , Yusuke Sakai , Taro Watanabe

BERT is inefficient for sentence-pair tasks such as clustering or semantic search as it needs to evaluate combinatorially many sentence pairs which is very time-consuming. Sentence BERT (SBERT) attempted to solve this challenge by learning…

Computation and Language · Computer Science 2021-02-08 Yan Zhang , Ruidan He , Zuozhu Liu , Kwan Hui Lim , Lidong Bing

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction…

Dialogue topic segmentation is critical in several dialogue modeling problems. However, popular unsupervised approaches only exploit surface features in assessing topical coherence among utterances. In this work, we address this limitation…

Computation and Language · Computer Science 2021-06-15 Linzi Xing , Giuseppe Carenini

We introduce a large and diverse Czech corpus annotated for grammatical error correction (GEC) with the aim to contribute to the still scarce data resources in this domain for languages other than English. The Grammar Error Correction…

Computation and Language · Computer Science 2022-04-22 Jakub Náplava , Milan Straka , Jana Straková , Alexandr Rosen

The prevalent use of too few references for evaluating text-to-text generation is known to bias estimates of their quality ({\it low coverage bias} or LCB). This paper shows that overcoming LCB in Grammatical Error Correction (GEC)…

Computation and Language · Computer Science 2019-09-19 Leshem Choshen , Omri Abend

The paper focuses on the interpretability of Grammatical Error Correction (GEC) evaluation metrics, which received little attention in previous studies. To bridge the gap, we introduce **CLEME2.0**, a reference-based metric describing four…

Computation and Language · Computer Science 2025-05-30 Jingheng Ye , Zishan Xu , Yinghui Li , Linlin Song , Qingyu Zhou , Hai-Tao Zheng , Ying Shen , Wenhao Jiang , Hong-Gee Kim , Ruitong Liu , Xin Su , Zifei Shan

The text editing tasks, including sentence fusion, sentence splitting and rephrasing, text simplification, and Grammatical Error Correction (GEC), share a common trait of dealing with highly similar input and output sequences. This area of…

Computation and Language · Computer Science 2023-09-21 Bohdan Didenko , Andrii Sameliuk

We present a new parallel corpus, JHU FLuency-Extended GUG corpus (JFLEG) for developing and evaluating grammatical error correction (GEC). Unlike other corpora, it represents a broad range of language proficiency levels and uses holistic…

Computation and Language · Computer Science 2017-02-15 Courtney Napoles , Keisuke Sakaguchi , Joel Tetreault

Existing studies explore the explainability of Grammatical Error Correction (GEC) in a limited scenario, where they ignore the interaction between corrections and explanations and have not established a corresponding comprehensive…

Computation and Language · Computer Science 2025-02-18 Jingheng Ye , Shang Qin , Yinghui Li , Xuxin Cheng , Libo Qin , Hai-Tao Zheng , Ying Shen , Peng Xing , Zishan Xu , Guo Cheng , Wenhao Jiang

Automatic evaluation metrics are indispensable for evaluating generated text. To date, these metrics have focused almost exclusively on the content selection aspect of the system output, ignoring the linguistic quality aspect altogether. We…

Computation and Language · Computer Science 2020-10-07 Wanzheng Zhu , Suma Bhat

Grammatical Error Correction (GEC) relies on accurate error annotation and evaluation, yet existing frameworks, such as $\texttt{errant}$, face limitations when extended to typologically diverse languages. In this paper, we introduce a…

Computation and Language · Computer Science 2025-06-10 Mengyang Qiu , Tran Minh Nguyen , Zihao Huang , Zelong Li , Yang Gu , Qingyu Gao , Siliang Liu , Jungyeul Park

Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can be utilized to…

Computation and Language · Computer Science 2023-10-24 Muhammad Reza Qorib , Hwee Tou Ng

Grammatical error correction (GEC) is one of the areas in natural language processing in which purely neural models have not yet superseded more traditional symbolic models. Hybrid systems combining phrase-based statistical machine…

Computation and Language · Computer Science 2019-04-08 Felix Stahlberg , Christopher Bryant , Bill Byrne