English
Related papers

Related papers: LLM-based Code-Switched Text Generation for Gramma…

200 papers

Large Language Models (LLMs) have been reported to outperform existing automatic evaluation metrics in some tasks, such as text summarization and machine translation. However, there has been a lack of research on LLMs as evaluators in…

Computation and Language · Computer Science 2024-05-28 Masamune Kobayashi , Masato Mita , Mamoru Komachi

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Grammatical error correction (GEC) aims to improve text quality and readability. Previous work on the task focused primarily on high-resource languages, while low-resource languages lack robust tools. To address this shortcoming, we present…

Computation and Language · Computer Science 2026-02-05 Mamadou K. Keita , Adwoa Bremang , Huy Le , Dennis Owusu , Christopher Homan , Marcos Zampieri

Building upon the strength of modern large language models (LLMs), generative error correction (GEC) has emerged as a promising paradigm that can elevate the performance of modern automatic speech recognition (ASR) systems. One…

Computation and Language · Computer Science 2024-07-24 Rithik Sachdev , Zhong-Qiu Wang , Chao-Han Huck Yang

Grammatical Error Correction (GEC) and feedback play a vital role in supporting second language (L2) learners, educators, and examiners. While written GEC is well-established, spoken GEC (SGEC), aiming to provide feedback based on learners'…

Computation and Language · Computer Science 2025-06-25 Mengjie Qian , Rao Ma , Stefano Bannò , Mark J. F. Gales , Kate M. Knill

Dual-encoder structure successfully utilizes two language-specific encoders (LSEs) for code-switching speech recognition. Because LSEs are initialized by two pre-trained language-specific models (LSMs), the dual-encoder structure can…

Computation and Language · Computer Science 2022-07-13 Tongtong Song , Qiang Xu , Meng Ge , Longbiao Wang , Hao Shi , Yongjie Lv , Yuqin Lin , Jianwu Dang

Contextualized embeddings are the preferred tool for modeling Lexical Semantic Change (LSC). Current evaluations typically focus on a specific task known as Graded Change Detection (GCD). However, performance comparison across work are…

Computation and Language · Computer Science 2024-10-31 Francesco Periti , Nina Tahmasebi

Grammatical error correction (GEC) is a task dedicated to rectifying texts with minimal edits, which can be decoupled into two components: detection and correction. However, previous works have predominantly focused on direct correction,…

Computation and Language · Computer Science 2024-05-29 Wei Li , Houfeng Wang

We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transformer sequence-to-sequence model on 4B tokens of Wikipedia…

Computation and Language · Computer Science 2018-11-06 Jared Lichtarge , Christopher Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar

Large pre-trained language models have been used to generate code,providing a flexible interface for synthesizing programs from natural language specifications. However, they often violate syntactic and semantic rules of their output…

Machine Learning · Computer Science 2022-01-28 Gabriel Poesia , Oleksandr Polozov , Vu Le , Ashish Tiwari , Gustavo Soares , Christopher Meek , Sumit Gulwani

Grammatical Error Correction (GEC) aims to automatically detect and correct grammatical errors. In this aspect, dominant models are trained by one-iteration learning while performing multiple iterations of corrections during inference.…

Computation and Language · Computer Science 2022-03-18 Shaopeng Lai , Qingyu Zhou , Jiali Zeng , Zhongli Li , Chao Li , Yunbo Cao , Jinsong Su

Spoken code-switching (CSW) challenges syntactic parsing in ways not observed in written text. Disfluencies, repetition, ellipsis, and discourse-driven structure routinely violate standard Universal Dependencies (UD) assumptions, causing…

Linguistic Code-switching (CS) is still an understudied phenomenon in natural language processing. The NLP community has mostly focused on monolingual and multi-lingual scenarios, but little attention has been given to CS in particular.…

Computation and Language · Computer Science 2020-05-05 Gustavo Aguilar , Thamar Solorio

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che

Lack of text data has been the major issue on code-switching language modeling. In this paper, we introduce multi-task learning based language model which shares syntax representation of languages to leverage linguistic information and…

Computation and Language · Computer Science 2018-10-05 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Progress in neural grammatical error correction (GEC) is hindered by the lack of annotated training data. Sufficient amounts of high-quality manually annotated data are not available, so recent research has relied on generating synthetic…

Computation and Language · Computer Science 2023-11-21 Andrey Bout , Alexander Podolskiy , Sergey Nikolenko , Irina Piontkovskaya

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this paper uses…

Computation and Language · Computer Science 2021-10-08 Liang-Hsuan Tseng , Yu-Kuan Fu , Heng-Jui Chang , Hung-yi Lee

Grammar error correction (GEC) systems have become ubiquitous in a variety of software applications, and have started to approach human-level performance for some datasets. However, very little is known about how to efficiently personalize…

Computation and Language · Computer Science 2020-06-05 Maria Nadejde , Joel Tetreault

The growing demand for automated writing assistance in diverse academic domains highlights the need for robust Chinese Grammatical Error Correction (CGEC) systems that can adapt across disciplines. However, existing CGEC research largely…

Computation and Language · Computer Science 2025-09-18 Shang Qin , Jingheng Ye , Yinghui Li , Hai-Tao Zheng , Qi Li , Jinxiao Shan , Zhixing Li , Hong-Gee Kim

Code-switching (CS) is the alternating use of two or more languages within a conversation or utterance, often influenced by social context and speaker identity. This linguistic phenomenon poses challenges for Automatic Speech Recognition…

Computation and Language · Computer Science 2025-06-03 Peng Xie , Xingyuan Liu , Tsz Wai Chan , Yequan Bie , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen