English
Related papers

Related papers: To Err Is Human, but Llamas Can Learn It Too

200 papers

In Grammatical Error Correction (GEC), it is crucial to ensure the user's comprehension of a reason for correction. Existing studies present tokens, examples, and hints as to the basis for correction but do not directly explain the reasons…

Computation and Language · Computer Science 2023-09-21 Masahiro Kaneko , Naoaki Okazaki

While large-scale language models (LLMs) have demonstrated remarkable capabilities in specific natural language processing (NLP) tasks, they may still lack proficiency compared to specialized models in certain domains, such as grammatical…

Computation and Language · Computer Science 2024-12-18 Tao Fang , Derek F. Wong , Lusheng Zhang , Keyan Jin , Qiang Zhang , Tianjiao Li , Jinlong Hou , Lidia S. Chao

Grammatical error correction (GEC) is one of the areas in natural language processing in which purely neural models have not yet superseded more traditional symbolic models. Hybrid systems combining phrase-based statistical machine…

Computation and Language · Computer Science 2019-04-08 Felix Stahlberg , Christopher Bryant , Bill Byrne

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are passed to the model…

Computation and Language · Computer Science 2021-06-01 Kevin Parnow , Zuchao Li , Hai Zhao

Shortage of available training data is holding back progress in the area of automated error detection. This paper investigates two alternative methods for artificially generating writing errors, in order to create additional resources. We…

Computation and Language · Computer Science 2017-07-18 Marek Rei , Mariano Felice , Zheng Yuan , Ted Briscoe

Grammatical error correction (GEC) is the task of correcting typos, spelling, punctuation and grammatical issues in text. Approaching the problem as a sequence-to-sequence task, we compare the use of a common subword unit vocabulary and…

Grammatical Error Correction (GEC) is the task of automatically detecting and correcting errors in text. The task not only includes the correction of grammatical errors, such as missing prepositions and mismatched subject-verb agreement,…

Computation and Language · Computer Science 2023-12-05 Christopher Bryant , Zheng Yuan , Muhammad Reza Qorib , Hannan Cao , Hwee Tou Ng , Ted Briscoe

Large-scale language models (LLMs) has shown remarkable capability in various of Natural Language Processing (NLP) tasks and attracted lots of attention recently. However, some studies indicated that large language models fail to achieve…

Computation and Language · Computer Science 2025-03-18 Fanyi Qu , Chenming Tang , Yunfang Wu

Grammar error correction (GEC) is an important application aspect of natural language processing techniques. The past decade has witnessed significant progress achieved in GEC for the sake of increasing popularity of machine learning and…

Computation and Language · Computer Science 2020-05-15 Yu Wang , Yuelin Wang , Jie Liu , Zhuo Liu

Large language models (LLMs) finetuned to follow human instruction have recently exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC), especially on languages…

Computation and Language · Computer Science 2023-12-15 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e., poor and good). The…

Computation and Language · Computer Science 2020-11-03 Wangchunshu Zhou , Tao Ge , Chang Mu , Ke Xu , Furu Wei , Ming Zhou

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction…

Recently, large language models (LLMs) fine-tuned to follow human instruction have exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC) tasks, particularly in…

Artificial Intelligence · Computer Science 2023-08-10 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoud , Muhammad Abdul-Mageed

Generative error correction (GER) with large language models (LLMs) has emerged as an effective post-processing approach to improve automatic speech recognition (ASR) performance. However, it often struggles with rare or domain-specific…

Sound · Computer Science 2025-05-26 Natsuo Yamashita , Masaaki Yamamoto , Hiroaki Kokubo , Yohei Kawaguchi

In this paper, we carry out experimental research on Grammatical Error Correction, delving into the nuances of single-model systems, comparing the efficiency of ensembling and ranking methods, and exploring the application of large language…

Computation and Language · Computer Science 2024-04-24 Kostiantyn Omelianchuk , Andrii Liubonko , Oleksandr Skurzhanskyi , Artem Chernodub , Oleksandr Korniienko , Igor Samokhin

Grammatical Error Correction (GEC) is the task of correcting errorful sentences into grammatically correct, semantically consistent, and coherent sentences. Popular GEC models either use large-scale synthetic corpora or use a large number…

Computation and Language · Computer Science 2023-07-06 Hejing Cao , Dongyan Zhao

Grammatical error correction systems improve written communication by detecting and correcting language mistakes. To help language learners better understand why the GEC system makes a certain correction, the causes of errors (evidence…

Computation and Language · Computer Science 2023-06-13 Yuejiao Fei , Leyang Cui , Sen Yang , Wai Lam , Zhenzhong Lan , Shuming Shi

Grammatical error correction in English is a long studied problem with many existing systems and datasets. However, there has been only a limited research on error correction of other languages. In this paper, we present a new dataset…

Computation and Language · Computer Science 2019-10-17 Jakub Náplava , Milan Straka

Metrics are the foundation for automatic evaluation in grammatical error correction (GEC), with their evaluation of the metrics (meta-evaluation) relying on their correlation with human judgments. However, conventional meta-evaluations in…

Computation and Language · Computer Science 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che