English
Related papers

Related papers: Proficiency Matters Quality Estimation in Grammati…

200 papers

Neural machine translation systems have become state-of-the-art approaches for Grammatical Error Correction (GEC) task. In this paper, we propose a copy-augmented architecture for the GEC task by copying the unchanged words from the source…

Computation and Language · Computer Science 2019-06-12 Wei Zhao , Liang Wang , Kewei Shen , Ruoyu Jia , Jingming Liu

Grammatical Error Correction (GEC) systems perform a sequence-to-sequence task, where an input word sequence containing grammatical errors, is corrected for these errors by the GEC system to output a grammatically correct word sequence.…

Computation and Language · Computer Science 2022-08-22 Vyas Raina , Mark Gales

Grammatical error correction (GEC) systems strive to correct both global errors in word order and usage, and local errors in spelling and inflection. Further developing upon recent work on neural machine translation, we propose a new hybrid…

Computation and Language · Computer Science 2017-07-11 Jianshu Ji , Qinlong Wang , Kristina Toutanova , Yongen Gong , Steven Truong , Jianfeng Gao

Previously, neural methods in grammatical error correction (GEC) did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) baselines. We demonstrate parallels between neural GEC and low-resource…

Computation and Language · Computer Science 2018-04-18 Marcin Junczys-Dowmunt , Roman Grundkiewicz , Shubha Guha , Kenneth Heafield

Large Language Models (LLMs) have been reported to outperform existing automatic evaluation metrics in some tasks, such as text summarization and machine translation. However, there has been a lack of research on LLMs as evaluators in…

Computation and Language · Computer Science 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

Pretraining-based (PT-based) automatic evaluation metrics (e.g., BERTScore and BARTScore) have been widely used in several sentence generation tasks (e.g., machine translation and text summarization) due to their better correlation with…

Computation and Language · Computer Science 2022-11-04 Peiyuan Gong , Xuebo Liu , Heyan Huang , Min Zhang

Word-level quality estimation (WQE) aims to automatically identify fine-grained error spans in machine-translated outputs and has found many uses, including assisting translators during post-editing. Modern WQE techniques are often…

Computation and Language · Computer Science 2025-11-18 Gabriele Sarti , Vilém Zouhar , Malvina Nissim , Arianna Bisazza

Currently available grammatical error correction (GEC) datasets are compiled using well-formed written text, limiting the applicability of these datasets to other domains such as informal writing and dialog. In this paper, we present a…

Computation and Language · Computer Science 2025-08-27 Xun Yuan , Derek Pham , Sam Davidson , Zhou Yu

To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non-autoregressive or…

Computation and Language · Computer Science 2024-10-23 Kamal Al-Sabahi , Kang Yang , Wangwang Liu , Guanyu Jiang , Xian Li , Ming Yang

While large-scale language models (LLMs) have demonstrated remarkable capabilities in specific natural language processing (NLP) tasks, they may still lack proficiency compared to specialized models in certain domains, such as grammatical…

Computation and Language · Computer Science 2024-12-18 Tao Fang , Derek F. Wong , Lusheng Zhang , Keyan Jin , Qiang Zhang , Tianjiao Li , Jinlong Hou , Lidia S. Chao

Various evaluation metrics have been proposed for Grammatical Error Correction (GEC), but many, particularly reference-free metrics, lack explainability. This lack of explainability hinders researchers from analyzing the strengths and…

Computation and Language · Computer Science 2024-12-18 Takumi Goto , Justin Vasselli , Taro Watanabe

The sequence-to-sequence (Seq2Seq) approach has recently been widely used in grammatical error correction (GEC) and shows promising performance. However, the Seq2Seq GEC approach still suffers from two issues. First, a Seq2Seq GEC model can…

Computation and Language · Computer Science 2023-10-24 Houquan Zhou , Yumeng Liu , Zhenghua Li , Min Zhang , Bo Zhang , Chen Li , Ji Zhang , Fei Huang

Quality Estimation (QE) is an important component of the machine translation workflow as it assesses the quality of the translated output without consulting reference translations. In this paper, we discuss our submission to the WMT 2021 QE…

Computation and Language · Computer Science 2021-09-10 Shaika Chowdhury , Naouel Baili , Brian Vannah

This study explores the necessity of performing cross-corpora evaluation for grammatical error correction (GEC) models. GEC models have been previously evaluated based on a single commonly applied corpus: the CoNLL-2014 benchmark. However,…

Computation and Language · Computer Science 2019-04-08 Masato Mita , Tomoya Mizumoto , Masahiro Kaneko , Ryo Nagata , Kentaro Inui

Quality Estimation (QE) is estimating quality of the model output during inference when the ground truth is not available. Deriving output quality from the models' output probability is the most trivial and low-effort way. However, we show…

Computation and Language · Computer Science 2025-09-16 Tu Anh Dinh , Jan Niehues

Quality estimation (QE)-the automatic assessment of translation quality-has recently become crucial across several stages of the translation pipeline, from data curation to training and decoding. While QE metrics have been optimized to…

Computation and Language · Computer Science 2025-06-04 Emmanouil Zaranis , Giuseppe Attanasio , Sweta Agrawal , André F. T. Martins

This paper presents a simple recipe to train state-of-the-art multilingual Grammatical Error Correction (GEC) models. We achieve this by first proposing a language-agnostic method to generate a large number of synthetic examples. The second…

Computation and Language · Computer Science 2022-08-10 Sascha Rothe , Jonathan Mallinson , Eric Malmi , Sebastian Krause , Aliaksei Severyn

This work presents a novel approach to Automatic Post-Editing (APE) and Word-Level Quality Estimation (QE) using ensembles of specialized Neural Machine Translation (NMT) systems. Word-level features that have proven effective for QE are…

Computation and Language · Computer Science 2017-07-18 Chris Hokamp

Neural sequence-to-sequence (seq2seq) approaches have proven to be successful in grammatical error correction (GEC). Based on the seq2seq framework, we propose a novel fluency boost learning and inference mechanism. Fluency boosting…

Computation and Language · Computer Science 2018-07-12 Tao Ge , Furu Wei , Ming Zhou

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi