English
Related papers

Related papers: LM-Combiner: A Contextual Rewriting Model for Chin…

200 papers

Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn…

Computation and Language · Computer Science 2016-06-02 Shamil Chollampatt , Kaveh Taghipour , Hwee Tou Ng

This paper investigates how to effectively incorporate a pre-trained masked language model (MLM), such as BERT, into an encoder-decoder (EncDec) model for grammatical error correction (GEC). The answer to this question is not as…

Computation and Language · Computer Science 2020-06-02 Masahiro Kaneko , Masato Mita , Shun Kiyono , Jun Suzuki , Kentaro Inui

This paper investigates how to correct Chinese text errors with types of mistaken, missing and redundant characters, which is common for Chinese native speakers. Most existing models based on detect-correct framework can correct mistaken…

Computation and Language · Computer Science 2021-09-21 Liying Zheng , Yue Deng , Weishun Song , Liang Xu , Jing Xiao

Ensemble approaches are commonly used techniques to improving a system by combining multiple model predictions. Additionally these schemes allow the uncertainty, as well as the source of the uncertainty, to be derived for the prediction.…

Computation and Language · Computer Science 2020-12-16 Yassir Fathullah , Mark Gales , Andrey Malinin

To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non-autoregressive or…

Computation and Language · Computer Science 2024-10-23 Kamal Al-Sabahi , Kang Yang , Wangwang Liu , Guanyu Jiang , Xian Li , Ming Yang

Large-scale cross-lingual language models (LM), such as mBERT, Unicoder and XLM, have achieved great success in cross-lingual representation learning. However, when applied to zero-shot cross-lingual transfer tasks, most existing methods…

Computation and Language · Computer Science 2020-12-16 Yuwei Fang , Shuohang Wang , Zhe Gan , Siqi Sun , Jingjing Liu

This paper describes our system at NLPTEA-2020 Task: Chinese Grammatical Error Diagnosis (CGED). The goal of CGED is to diagnose four types of grammatical errors: word selection (S), redundant words (R), missing words (M), and disordered…

Computation and Language · Computer Science 2021-07-13 Jinhong Zhang

We treat grammatical error correction (GEC) as a classification problem in this study, where for different types of errors, a target word is identified, and the classifier predicts the correct word form from a set of possible choices. We…

Computation and Language · Computer Science 2018-07-03 Zhu Kaili , Chuan Wang , Ruobing Li , Yang Liu , Tianlei Hu , Hui Lin

Grammatical Error Correction (GEC) has been broadly applied in automatic correction and proofreading system recently. However, it is still immature in Chinese GEC due to limited high-quality data from native speakers in terms of category…

Computation and Language · Computer Science 2023-08-08 Lvxiaowei Xu , Jianwang Wu , Jiawei Peng , Jiayu Fu , Ming Cai

ChatGPT and other general large language models (LLMs) have achieved remarkable success, but they have also raised concerns about the misuse of AI-generated texts. Existing AI-generated text detection models, such as based on BERT and…

Computation and Language · Computer Science 2024-02-05 Rongsheng Wang , Haoming Chen , Ruizhe Zhou , Han Ma , Yaofei Duan , Yanlan Kang , Songhua Yang , Baoyu Fan , Tao Tan

This paper presents MuCGEC, a multi-reference multi-source evaluation dataset for Chinese Grammatical Error Correction (CGEC), consisting of 7,063 sentences collected from three Chinese-as-a-Second-Language (CSL) learner sources. Each…

Computation and Language · Computer Science 2022-05-05 Yue Zhang , Zhenghua Li , Zuyi Bao , Jiacheng Li , Bo Zhang , Chen Li , Fei Huang , Min Zhang

Grammatical error correction aims to correct ungrammatical sentences automatically. Recently, some work has demonstrated the excellent capabilities of closed-source Large Language Models (LLMs, e.g., ChatGPT) in grammatical error…

Computation and Language · Computer Science 2023-08-21 Yaxin Fan , Feng Jiang , Peifeng Li , Haizhou Li

System combination is an important technique for combining the hypotheses of different machine translation systems to improve translation performance. Although early statistical approaches to system combination have been proven effective in…

Computation and Language · Computer Science 2020-07-15 Xuancheng Huang , Jiacheng Zhang , Zhixing Tan , Derek F. Wong , Huanbo Luan , Jingfang Xu , Maosong Sun , Yang Liu

Previously, neural methods in grammatical error correction (GEC) did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) baselines. We demonstrate parallels between neural GEC and low-resource…

Computation and Language · Computer Science 2018-04-18 Marcin Junczys-Dowmunt , Roman Grundkiewicz , Shubha Guha , Kenneth Heafield

Although rarely stated, in practice, Grammatical Error Correction (GEC) encompasses various models with distinct objectives, ranging from grammatical error detection to improving fluency. Traditional evaluation methods fail to fully capture…

Computation and Language · Computer Science 2023-08-21 Robert Östling , Katarina Gillholm , Murathan Kurfalı , Marie Mattson , Mats Wirén

We present a grammar error correction (GEC) system that achieves state of the art for the Czech language. Our system is based on a neural network translation approach with the Transformer architecture, and its key feature is its real-time…

Computation and Language · Computer Science 2025-08-28 Petr Pechman , Milan Straka , Jana Straková , Jakub Náplava

We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e., poor and good). The…

Computation and Language · Computer Science 2020-11-03 Wangchunshu Zhou , Tao Ge , Chang Mu , Ke Xu , Furu Wei , Ming Zhou

Robust supervised fine-tuned small Language Models (sLMs) often show high reliability but tend to undercorrect. They achieve high precision at the cost of low recall. Conversely, Large Language Models (LLMs) often show the opposite…

Computation and Language · Computer Science 2025-09-26 Taehee Park , Heejin Do , Gary Geunbae Lee

As a fundamental task in natural language processing, Chinese Grammatical Error Correction (CGEC) has gradually received widespread attention and become a research hotspot. However, one obvious deficiency for the existing CGEC evaluation…

Computation and Language · Computer Science 2022-05-03 Nankai Lin , Nankai Lin , Xiaotian Lin , Ziyu Yang , Shengyi Jiang

Grammatical Error Correction (GEC) aims to automatically detect and correct grammatical errors. In this aspect, dominant models are trained by one-iteration learning while performing multiple iterations of corrections during inference.…

Computation and Language · Computer Science 2022-03-18 Shaopeng Lai , Qingyu Zhou , Jiali Zeng , Zhongli Li , Chao Li , Yunbo Cao , Jinsong Su