English
Related papers

Related papers: GPT-3.5 for Grammatical Error Correction

200 papers

In recent years, sequence-to-sequence models have been very effective for end-to-end grammatical error correction (GEC). As creating human-annotated parallel corpus for GEC is expensive and time-consuming, there has been work on artificial…

Computation and Language · Computer Science 2019-07-23 Phu Mon Htut , Joel Tetreault

Negation is a fundamental aspect of natural language, playing a critical role in communication and comprehension. Our study assesses the negation detection performance of Generative Pre-trained Transformer (GPT) models, specifically GPT-2,…

Computation and Language · Computer Science 2023-06-30 Ha Thanh Nguyen , Randy Goebel , Francesca Toni , Kostas Stathis , Ken Satoh

Grammatical Error Correction (GEC) has been broadly applied in automatic correction and proofreading system recently. However, it is still immature in Chinese GEC due to limited high-quality data from native speakers in terms of category…

Computation and Language · Computer Science 2023-08-08 Lvxiaowei Xu , Jianwang Wu , Jiawei Peng , Jiayu Fu , Ming Cai

The development of large and super-large language models, such as GPT-3, T5, Switch Transformer, ERNIE, etc., has significantly improved the performance of text generation. One of the important research directions in this area is the…

Computation and Language · Computer Science 2022-06-22 Valeriya Goloviznina , Evgeny Kotelnikov

The increasing demand for programming language education and growing class sizes require immediate and personalized feedback. However, traditional code review methods have limitations in providing this level of feedback. As the capabilities…

Software Engineering · Computer Science 2025-06-23 Lee Dong-Kyu

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Currently, the majority of research in grammatical error correction (GEC) is concentrated on universal languages, such as English and Chinese. Many low-resource languages lack accessible evaluation corpora. How to efficiently construct…

Computation and Language · Computer Science 2024-10-29 Nankai Lin , Meiyu Zeng , Wentao Huang , Shengyi Jiang , Lixian Xiao , Aimin Yang

Language learners should regularly engage in reading challenging materials as part of their study routine. Nevertheless, constantly referring to dictionaries is time-consuming and distracting. This paper presents a novel gaze-driven…

Computation and Language · Computer Science 2023-10-03 Taichi Higasa , Keitaro Tanaka , Qi Feng , Shigeo Morishima

In the era of large language models (LLMs), in-context learning (ICL) stands out as an effective prompting strategy that explores LLMs' potency across various tasks. However, applying LLMs to grammatical error correction (GEC) is still a…

Computation and Language · Computer Science 2024-03-29 Chenming Tang , Fanyi Qu , Yunfang Wu

The challenge of improving translation accuracy in GPT-4 is being addressed by harnessing a method known as in-context learning. This paper introduces a strategic approach to utilize in-context learning specifically for machine translation,…

Computation and Language · Computer Science 2024-01-11 Yufeng Chen

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learners, and produces a…

Computation and Language · Computer Science 2021-04-21 Eetu Sjöblom , Mathias Creutz , Teemu Vahtola

The incorporation of pseudo data in the training of grammatical error correction models has been one of the main factors in improving the performance of such models. However, consensus is lacking on experimental configurations, namely,…

Computation and Language · Computer Science 2019-09-04 Shun Kiyono , Jun Suzuki , Masato Mita , Tomoya Mizumoto , Kentaro Inui

We propose IMPARA-GED, a novel reference-free automatic grammatical error correction (GEC) evaluation method with grammatical error detection (GED) capabilities. We focus on the quality estimator of IMPARA, an existing automatic GEC…

Computation and Language · Computer Science 2025-06-04 Yusuke Sakai , Takumi Goto , Taro Watanabe

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all…

Computation and Language · Computer Science 2024-09-20 Yinghui Li , Shang Qin , Haojing Huang , Yangning Li , Libo Qin , Xuming Hu , Wenhao Jiang , Hai-Tao Zheng , Philip S. Yu

Larger language models, such as GPT-3, have shown to be excellent in many tasks. However, we demonstrate that out-of-ordinary questions can throw the model off guard. This work focuses on finding answers to negated complementary questions…

Computation and Language · Computer Science 2023-07-14 Navid Rezaei , Marek Z. Reformat

Both grammatical error correction and text style transfer can be viewed as monolingual sequence-to-sequence transformation tasks, but the scarcity of directly annotated data for either task makes them unfeasible for most languages. We…

Computation and Language · Computer Science 2019-10-23 Elizaveta Korotkova , Agnes Luhtaru , Maksym Del , Krista Liin , Daiga Deksne , Mark Fishel

GPT-3 can perform numerous tasks when provided a natural language prompt that contains a few training examples. We show that this type of few-shot learning can be unstable: the choice of prompt format, training examples, and even the order…

Computation and Language · Computer Science 2021-06-14 Tony Z. Zhao , Eric Wallace , Shi Feng , Dan Klein , Sameer Singh

Objective: To investigate GPT-3.5 in generating and coding medical documents with ICD-10 codes for data augmentation on low-resources labels. Materials and Methods: Employing GPT-3.5 we generated and coded 9,606 discharge summaries based on…

Grammar checking is the task of detection and correction of grammatical errors in the text. English is the dominating language in the field of science and technology. Therefore, the non-native English speakers must be able to use correct…

Computation and Language · Computer Science 2018-04-03 Madhvi Soni , Jitendra Singh Thakur

Recent progress in large language models (LLMs) like GPT-4 and PaLM-2 has brought significant advancements in addressing math reasoning problems. In particular, OpenAI's latest version of GPT-4, known as GPT-4 Code Interpreter, shows…

Computation and Language · Computer Science 2023-08-16 Aojun Zhou , Ke Wang , Zimu Lu , Weikang Shi , Sichun Luo , Zipeng Qin , Shaoqing Lu , Anya Jia , Linqi Song , Mingjie Zhan , Hongsheng Li