English
Related papers

Related papers: Grammatical Error Correction via Mixed-Grained Wei…

200 papers

In the era of large language models (LLMs), in-context learning (ICL) stands out as an effective prompting strategy that explores LLMs' potency across various tasks. However, applying LLMs to grammatical error correction (GEC) is still a…

Computation and Language · Computer Science 2024-03-29 Chenming Tang , Fanyi Qu , Yunfang Wu

Ensemble approaches are commonly used techniques to improving a system by combining multiple model predictions. Additionally these schemes allow the uncertainty, as well as the source of the uncertainty, to be derived for the prediction.…

Computation and Language · Computer Science 2020-12-16 Yassir Fathullah , Mark Gales , Andrey Malinin

Grammatical error correction can be viewed as a low-resource sequence-to-sequence task, because publicly available parallel corpora are limited. To tackle this challenge, we first generate erroneous versions of large unannotated corpora…

Computation and Language · Computer Science 2019-07-03 Yo Joong Choe , Jiyeon Ham , Kyubyong Park , Yeoil Yoon

The writing examples of English language learners may be different from those of native speakers. Given that there is a significant differences in second language (L2) learners' error types by their proficiency levels, this paper attempts…

Computation and Language · Computer Science 2024-02-27 Min Zeng , Jiexin Kuang , Mengyang Qiu , Jayoung Song , Jungyeul Park

Large language models can enhance automatic speech recognition systems through generative error correction. In this paper, we propose Pinyin-enhanced GEC, which leverages Pinyi, the phonetic representation of Mandarin Chinese, as…

Computation and Language · Computer Science 2024-09-23 Yuang Li , Xiaosong Qiao , Xiaofeng Zhao , Huan Zhao , Wei Tang , Min Zhang , Hao Yang

We propose a novel data synthesis method to generate diverse error-corrected sentence pairs for improving grammatical error correction, which is based on a pair of machine translation models of different qualities (i.e., poor and good). The…

Computation and Language · Computer Science 2020-11-03 Wangchunshu Zhou , Tao Ge , Chang Mu , Ke Xu , Furu Wei , Ming Zhou

We describe the AGReE system, which takes user-submitted passages as input and automatically generates grammar practice exercises that can be completed while reading. Multiple-choice practice items are generated for a variety of different…

Computation and Language · Computer Science 2022-11-07 Sophia Chan , Swapna Somasundaran , Debanjan Ghosh , Mengxuan Zhao

The incorporation of pseudo data in the training of grammatical error correction models has been one of the main factors in improving the performance of such models. However, consensus is lacking on experimental configurations, namely,…

Computation and Language · Computer Science 2019-09-04 Shun Kiyono , Jun Suzuki , Masato Mita , Tomoya Mizumoto , Kentaro Inui

Large-scale language models (LLMs) has shown remarkable capability in various of Natural Language Processing (NLP) tasks and attracted lots of attention recently. However, some studies indicated that large language models fail to achieve…

Computation and Language · Computer Science 2025-03-18 Fanyi Qu , Chenming Tang , Yunfang Wu

Is it possible to train a general metric for evaluating text generation quality without human annotated ratings? Existing learned metrics either perform unsatisfactorily across text generation tasks or require human ratings for training on…

Computation and Language · Computer Science 2023-07-10 Wenda Xu , Xian Qian , Mingxuan Wang , Lei Li , William Yang Wang

Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is…

Computation and Language · Computer Science 2024-06-18 Zhipeng Chen , Kun Zhou , Wayne Xin Zhao , Junchen Wan , Fuzheng Zhang , Di Zhang , Ji-Rong Wen

Grammatical Error Correction has seen significant progress with the recent advancements in deep learning. As those methods require huge amounts of data, synthetic datasets are being built to fill this gap. Unfortunately, synthetic datasets…

Computation and Language · Computer Science 2024-05-27 Asım Ersoy , Olcay Taner Yıldız

Large language models (LLMs) finetuned to follow human instruction have recently exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC), especially on languages…

Computation and Language · Computer Science 2023-12-15 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in Chinese sentences caused by phonetic or visual similarities. While current CSC models integrate pinyin or glyph features and have shown significant…

Computation and Language · Computer Science 2024-09-10 Lei Sheng , Shuai-Shuai Xu

Grammar checking is the task of detection and correction of grammatical errors in the text. English is the dominating language in the field of science and technology. Therefore, the non-native English speakers must be able to use correct…

Computation and Language · Computer Science 2018-04-03 Madhvi Soni , Jitendra Singh Thakur

Modern large language models demonstrate impressive capabilities in text generation and generalization. However, they often struggle with solving text editing tasks, particularly when it comes to correcting spelling errors and mistypings.…

Computation and Language · Computer Science 2023-09-14 Nikita Martynov , Mark Baushenko , Anastasia Kozlova , Katerina Kolomeytseva , Aleksandr Abramov , Alena Fenogenova

Machine translation (MT) of user-generated content (UGC) poses unique challenges, including handling slang, emotion, and literary devices like irony and sarcasm. Evaluating the quality of these translations is challenging as current metrics…

Computation and Language · Computer Science 2024-10-07 Shenbin Qian , Constantin Orăsan , Diptesh Kanojia , Félix do Carmo

Machine learning models for graphs in real-world applications are prone to two primary types of uncertainty: (1) those that arise from incomplete and noisy data and (2) those that arise from uncertainty of the model in its output. These…

Machine Learning · Computer Science 2024-12-10 Zohair Shafi , Germans Savcisens , Tina Eliassi-Rad

Fine-grained annotations---e.g. dense image labels, image segmentation and text tagging---are useful in many ML applications but they are labor-intensive to generate. Moreover there are often systematic, structured errors in these…

Machine Learning · Computer Science 2020-03-26 Abubakar Abid , James Zou

Grammatical error correction (GEC) and explanation (GEE) have made rapid progress, but real teaching scenarios also require \emph{learner-friendly pedagogical feedback} that is actionable, level-appropriate, and encouraging. We introduce…

Computation and Language · Computer Science 2026-04-17 Junhong Liang , Yifan Lu , Ekaterina Kochmar , Fajri Koto