English
Related papers

Related papers: Grammatical Error Correction Evaluation by Optimal…

200 papers

One of the goals of automatic evaluation metrics in grammatical error correction (GEC) is to rank GEC systems such that it matches human preferences. However, current automatic evaluations are based on procedures that diverge from human…

Computation and Language · Computer Science 2025-06-04 Takumi Goto , Yusuke Sakai , Taro Watanabe

Grammatical error correction (GEC) is the task of detecting and correcting grammatical errors in texts written by second language learners. The statistical machine translation (SMT) approach to GEC, in which sentences written by second…

Computation and Language · Computer Science 2016-06-02 Duc Tam Hoang , Shamil Chollampatt , Hwee Tou Ng

Metrics are the foundation for automatic evaluation in grammatical error correction (GEC), with their evaluation of the metrics (meta-evaluation) relying on their correlation with human judgments. However, conventional meta-evaluations in…

Computation and Language · Computer Science 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

Pretraining-based (PT-based) automatic evaluation metrics (e.g., BERTScore and BARTScore) have been widely used in several sentence generation tasks (e.g., machine translation and text summarization) due to their better correlation with…

Computation and Language · Computer Science 2022-11-04 Peiyuan Gong , Xuebo Liu , Heyan Huang , Min Zhang

A Grammatical Error Correction (GEC) system produces a sequence of edits to correct an erroneous sentence. The quality of these edits is typically evaluated against human annotations. However, a sentence may admit multiple valid…

Computation and Language · Computer Science 2026-05-06 Qiyuan Xiao , Xiaoman Wang , Yunshi Lan

Although rarely stated, in practice, Grammatical Error Correction (GEC) encompasses various models with distinct objectives, ranging from grammatical error detection to improving fluency. Traditional evaluation methods fail to fully capture…

Computation and Language · Computer Science 2023-08-21 Robert Östling , Katarina Gillholm , Murathan Kurfalı , Marie Mattson , Mats Wirén

Various evaluation metrics have been proposed for Grammatical Error Correction (GEC), but many, particularly reference-free metrics, lack explainability. This lack of explainability hinders researchers from analyzing the strengths and…

Computation and Language · Computer Science 2024-12-18 Takumi Goto , Justin Vasselli , Taro Watanabe

Currently available grammatical error correction (GEC) datasets are compiled using well-formed written text, limiting the applicability of these datasets to other domains such as informal writing and dialog. In this paper, we present a…

Computation and Language · Computer Science 2025-08-27 Xun Yuan , Derek Pham , Sam Davidson , Zhou Yu

Current grammatical error correction (GEC) models typically consider the task as sequence generation, which requires large amounts of annotated data and limit the applications in data-limited settings. We try to incorporate contextual…

Computation and Language · Computer Science 2020-01-13 Yiyuan Li , Antonios Anastasopoulos , Alan W Black

Grammar Error Correction(GEC) mainly relies on the availability of high quality of large amount of synthetic parallel data of grammatically correct and erroneous sentence pairs. The quality of the synthetic data is evaluated on how well the…

Computation and Language · Computer Science 2022-11-01 Vanya Bannihatti Kumar

Grammatical error correction (GEC) is one of the areas in natural language processing in which purely neural models have not yet superseded more traditional symbolic models. Hybrid systems combining phrase-based statistical machine…

Computation and Language · Computer Science 2019-04-08 Felix Stahlberg , Christopher Bryant , Bill Byrne

Grammatical Error Correction (GEC) should not focus only on high accuracy of corrections but also on interpretability for language learning. However, existing neural-based GEC models mainly aim at improving accuracy, and their…

Computation and Language · Computer Science 2022-03-15 Masahiro Kaneko , Sho Takase , Ayana Niwa , Naoaki Okazaki

We combine two of the most popular approaches to automated Grammatical Error Correction (GEC): GEC based on Statistical Machine Translation (SMT) and GEC based on Neural Machine Translation (NMT). The hybrid system achieves new…

Computation and Language · Computer Science 2018-04-18 Roman Grundkiewicz , Marcin Junczys-Dowmunt

Grammatical Error Correction (GEC) is a task of detecting and correcting grammatical errors in sentences. Recently, neural machine translation systems have become popular approaches for this task. However, these methods lack the use of…

Computation and Language · Computer Science 2021-11-08 Zhaohong Wan , Xiaojun Wan

We introduce gec-metrics, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface. Our library enables fair system comparisons by ensuring that everyone conducts evaluations using…

Computation and Language · Computer Science 2025-05-27 Takumi Goto , Yusuke Sakai , Taro Watanabe

Neural machine translation systems have become state-of-the-art approaches for Grammatical Error Correction (GEC) task. In this paper, we propose a copy-augmented architecture for the GEC task by copying the unchanged words from the source…

Computation and Language · Computer Science 2019-06-12 Wei Zhao , Liang Wang , Kewei Shen , Ruoyu Jia , Jingming Liu

This paper investigates the application of GPT-3.5 for Grammatical Error Correction (GEC) in multiple languages in several settings: zero-shot GEC, fine-tuning for GEC, and using GPT-3.5 to re-rank correction hypotheses generated by other…

Computation and Language · Computer Science 2024-05-15 Anisia Katinskaia , Roman Yangarber

Grammatical Error Correction (GEC) systems perform a sequence-to-sequence task, where an input word sequence containing grammatical errors, is corrected for these errors by the GEC system to output a grammatically correct word sequence.…

Computation and Language · Computer Science 2022-08-22 Vyas Raina , Mark Gales

Synthetic data generation is widely known to boost the accuracy of neural grammatical error correction (GEC) systems, but existing methods often lack diversity or are too simplistic to generate the broad range of grammatical errors made by…

Computation and Language · Computer Science 2021-05-28 Felix Stahlberg , Shankar Kumar

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi
‹ Prev 1 2 3 10 Next ›