English
Related papers

Related papers: Improving Grammatical Error Correction via Pre-Tra…

200 papers

With the rise of globalisation, code-switching (CSW) has become a ubiquitous part of multilingual conversation, posing new challenges for natural language processing (NLP), especially in Grammatical Error Correction (GEC). This work…

Computation and Language · Computer Science 2024-10-15 Tom Potter , Zheng Yuan

Evaluation of grammatical error correction (GEC) systems has primarily focused on essays written by non-native learners of English, which however is only part of the full spectrum of GEC applications. We aim to broaden the target domain of…

Computation and Language · Computer Science 2020-10-16 Simon Flachs , Ophélie Lacroix , Helen Yannakoudakis , Marek Rei , Anders Søgaard

Automatic evaluation in grammatical error correction (GEC) is crucial for selecting the best-performing systems. Currently, reference-based metrics are a popular choice, which basically measure the similarity between hypothesis and…

Computation and Language · Computer Science 2026-02-06 Takumi Goto , Yusuke Sakai , Taro Watanabe

Various evaluation metrics have been proposed for Grammatical Error Correction (GEC), but many, particularly reference-free metrics, lack explainability. This lack of explainability hinders researchers from analyzing the strengths and…

Computation and Language · Computer Science 2024-12-18 Takumi Goto , Justin Vasselli , Taro Watanabe

The field of Grammatical Error Correction (GEC) has produced various systems to deal with focused phenomena or general text editing. We propose an automatic way to combine black-box systems. Our method automatically detects the strength of…

Computation and Language · Computer Science 2019-06-11 Yoav Kantor , Yoav Katz , Leshem Choshen , Edo Cohen-Karlik , Naftali Liberman , Assaf Toledo , Amir Menczel , Noam Slonim

Chinese Grammatical Error Correction (CGEC) aims to generate a correct sentence from an erroneous sequence, where different kinds of errors are mixed. This paper divides the CGEC task into two steps, namely spelling error correction and…

Computation and Language · Computer Science 2022-11-04 Xiuyu Wu , Yunfang Wu

We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e., poor and good). The…

Computation and Language · Computer Science 2020-11-03 Wangchunshu Zhou , Tao Ge , Chang Mu , Ke Xu , Furu Wei , Ming Zhou

Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can be utilized to…

Computation and Language · Computer Science 2023-10-24 Muhammad Reza Qorib , Hwee Tou Ng

Text editing frames grammatical error correction (GEC) as a sequence tagging problem, where edit tags are assigned to input tokens, and applying these edits results in the corrected text. This approach has gained attention for its…

Computation and Language · Computer Science 2025-06-03 Bashar Alhafni , Nizar Habash

The cross-lingual language models are typically pretrained with masked language modeling on multilingual text or parallel sentences. In this paper, we introduce denoising word alignment as a new cross-lingual pre-training task.…

Computation and Language · Computer Science 2021-09-14 Zewen Chi , Li Dong , Bo Zheng , Shaohan Huang , Xian-Ling Mao , Heyan Huang , Furu Wei

Existing approaches for grammatical error correction (GEC) largely rely on supervised learning with manually created GEC datasets. However, there has been little focus on verifying and ensuring the quality of the datasets, and on how…

Computation and Language · Computer Science 2020-10-08 Masato Mita , Shun Kiyono , Masahiro Kaneko , Jun Suzuki , Kentaro Inui

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi

Training a model for grammatical error correction (GEC) requires a set of labeled ungrammatical / grammatical sentence pairs, but manually annotating such pairs can be expensive. Recently, the Break-It-Fix-It (BIFI) framework has…

Computation and Language · Computer Science 2021-10-11 Michihiro Yasunaga , Jure Leskovec , Percy Liang

There has been an increased interest in data generation approaches to grammatical error correction (GEC) using pseudo data. However, these approaches suffer from several issues that make them inconvenient for real-world deployment including…

Computation and Language · Computer Science 2021-06-08 Masato Mita , Hitomi Yanaka

Grammatical error correction (GEC) is a task dedicated to rectifying texts with minimal edits, which can be decoupled into two components: detection and correction. However, previous works have predominantly focused on direct correction,…

Computation and Language · Computer Science 2024-05-29 Wei Li , Houfeng Wang

The task of Grammatical Error Correction (GEC) has received remarkable attention with wide applications in Natural Language Processing (NLP) in recent years. While one of the key principles of GEC is to keep the correct parts unchanged and…

Computation and Language · Computer Science 2022-05-24 Jiquan Li , Junliang Guo , Yongxin Zhu , Xin Sheng , Deqiang Jiang , Bo Ren , Linli Xu

Building large-scale datasets for training code-switching language models is challenging and very expensive. To alleviate this problem using parallel corpus has been a major workaround. However, existing solutions use linguistic constraints…

Computation and Language · Computer Science 2018-10-31 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Large Language Models (LLMs) have been reported to outperform existing automatic evaluation metrics in some tasks, such as text summarization and machine translation. However, there has been a lack of research on LLMs as evaluators in…

Computation and Language · Computer Science 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

This research introduces KoGEC, a Korean Grammatical Error Correction system using pre\--trained translation models. We fine-tuned NLLB (No Language Left Behind) models for Korean GEC, comparing their performance against large language…

Computation and Language · Computer Science 2025-06-16 Taeeun Kim , Semin Jeong , Youngsook Song

Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical…

Computation and Language · Computer Science 2021-04-19 Aomi Koyama , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi