中文
相关论文

相关论文: How Ready Are Generative Pre-trained Large Languag…

200 篇论文

Evaluating the performance of Grammatical Error Correction (GEC) models has become increasingly challenging, as large language model (LLM)-based GEC systems often produce corrections that diverge from provided gold references. This…

计算与语言 · 计算机科学 2025-06-24 Jinxiang Xie , Yilin Li , Xunjian Yin , Xiaojun Wan

Metrics are the foundation for automatic evaluation in grammatical error correction (GEC), with their evaluation of the metrics (meta-evaluation) relying on their correlation with human judgments. However, conventional meta-evaluations in…

计算与语言 · 计算机科学 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

The task of Grammatical Error Correction (GEC) aims to automatically correct grammatical errors in natural texts. Almost all previous works treat annotated training data equally, but inherent discrepancies in data are neglected. In this…

计算与语言 · 计算机科学 2023-11-27 Jiahao Li , Quan Wang , Chiwei Zhu , Zhendong Mao , Yongdong Zhang

Chinese Grammatical Error Correction (CGEC) is a critical task in Natural Language Processing, addressing the growing demand for automated writing assistance in both second-language (L2) and native (L1) Chinese writing. While L2 learners…

计算与语言 · 计算机科学 2025-04-02 Mengyang Qiu , Qingyu Gao , Linxuan Yang , Yang Gu , Tran Minh Nguyen , Zihao Huang , Jungyeul Park

Decoder-only large language models have shown superior performance in the fluency-edit English Grammatical Error Correction, but their adaptation for minimal-edit English GEC is still underexplored. To improve their effectiveness in the…

计算与语言 · 计算机科学 2025-06-17 Ryszard Staruch , Filip Graliński , Daniel Dzienisiewicz

Grammatical error correction (GEC) is the task of detecting and correcting errors in a written text. The idea of combining multiple system outputs has been successfully used in GEC. To achieve successful system combination, multiple…

计算与语言 · 计算机科学 2021-10-29 Wenjuan Han , Hwee Tou Ng

Previously, neural methods in grammatical error correction (GEC) did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) baselines. We demonstrate parallels between neural GEC and low-resource…

计算与语言 · 计算机科学 2018-04-18 Marcin Junczys-Dowmunt , Roman Grundkiewicz , Shubha Guha , Kenneth Heafield

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

软件工程 · 计算机科学 2025-03-20 Priscylla Silva , Evandro Costa

The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential…

Grammatical Error Correction (GEC) and grammatical acceptability judgment (COLA) are core tasks in natural language processing, sharing foundational grammatical knowledge yet typically evolving independently. This paper introduces COLA-GEC,…

计算与语言 · 计算机科学 2025-07-17 Xiangyu Yang , Xinying Qiu

Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical…

计算与语言 · 计算机科学 2021-04-19 Aomi Koyama , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Grammatical error correction (GEC) is a challenging task of natural language processing techniques. While more attempts are being made in this approach for universal languages like English or Chinese, relatively little work has been done…

计算与语言 · 计算机科学 2023-03-31 Nankai Lin , Hongbin Zhang , Menglan Shen , Yu Wang , Shengyi Jiang , Aimin Yang

We introduce GECKO, a bilingual large language model (LLM) optimized for Korean and English, along with programming languages. GECKO is pretrained on the balanced, high-quality corpus of Korean and English employing LLaMA architecture. In…

计算与语言 · 计算机科学 2024-05-27 Sungwoo Oh , Donggyu Kim

Existing studies explore the explainability of Grammatical Error Correction (GEC) in a limited scenario, where they ignore the interaction between corrections and explanations and have not established a corresponding comprehensive…

计算与语言 · 计算机科学 2025-02-18 Jingheng Ye , Shang Qin , Yinghui Li , Xuxin Cheng , Libo Qin , Hai-Tao Zheng , Ying Shen , Peng Xing , Zishan Xu , Guo Cheng , Wenhao Jiang

Generative Language Models (LMs) such as ChatGPT have exhibited remarkable performance across various downstream tasks. Nevertheless, one of their most prominent drawbacks is generating inaccurate or false information with a confident tone.…

计算与语言 · 计算机科学 2024-05-14 Haixia Han , Jiaqing Liang , Jie Shi , Qianyu He , Yanghua Xiao

Progress in neural grammatical error correction (GEC) is hindered by the lack of annotated training data. Sufficient amounts of high-quality manually annotated data are not available, so recent research has relied on generating synthetic…

计算与语言 · 计算机科学 2023-11-21 Andrey Bout , Alexander Podolskiy , Sergey Nikolenko , Irina Piontkovskaya

The primary objective of Chinese grammatical error correction (CGEC) is to detect and correct errors in Chinese sentences. Recent research shows that large language models (LLMs) have been applied to CGEC with significant results. For LLMs,…

计算与语言 · 计算机科学 2025-10-01 Baoxin Wang , Yumeng Luo , Yixuan Wang , Dayong Wu , Wanxiang Che , Shijin Wang

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

计算与语言 · 计算机科学 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

Bengali social media platforms have witnessed a sharp increase in hate speech, disproportionately affecting women and adolescents. While datasets such as BD-SHS provide a basis for structured evaluation, most prior approaches rely on either…

计算与语言 · 计算机科学 2026-02-24 Akif Islam , Mohd Ruhul Ameen

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

计算与语言 · 计算机科学 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng