English
Related papers

Related papers: Time Is Effort: Estimating Human Post-Editing Time…

200 papers

Grammatical error correction (GEC) is one of the areas in natural language processing in which purely neural models have not yet superseded more traditional symbolic models. Hybrid systems combining phrase-based statistical machine…

Computation and Language · Computer Science 2019-04-08 Felix Stahlberg , Christopher Bryant , Bill Byrne

Spoken Grammatical Error Correction (SGEC) and Feedback (SGECF) are crucial for second language learners, teachers and test takers. Traditional SGEC systems rely on a cascaded pipeline consisting of an ASR, a module for disfluency detection…

Computation and Language · Computer Science 2025-05-28 Mengjie Qian , Rao Ma , Stefano Bannò , Kate M. Knill , Mark J. F. Gales

With the advent of neural machine translation, there has been a marked shift towards leveraging and consuming the machine translation results. However, the gap between machine translation systems and human translators needs to be manually…

Computation and Language · Computer Science 2020-09-29 Jiayi Wang , Ke Wang , Niyu Ge , Yangbing Shi , Yu Zhao , Kai Fan

Statement autoformalization, the automated translation of statements from natural language into formal languages, has become a subject of extensive research, yet the development of robust automated evaluation metrics remains limited.…

Machine Learning · Computer Science 2025-08-25 Yuntian Liu , Tao Zhu , Xiaoyang Liu , Yu Chen , Zhaoxuan Liu , Qingfeng Guo , Jiashuo Zhang , Kangjie Bao , Tao Luo

As MT quality increases, interest in enhanced post-editing features such as QE-derived error highlights is growing, yet evidence for their usefulness remains limited. In this work, we explore the usefulness of LLM-derived error highlights…

Computation and Language · Computer Science 2026-05-21 Fleur V. J. van Tellingen , Gautam Ranka , Dora Žugčić , Joyce van der Wal , Andrea Camasta , Livio Guerra , Alina Karakanta

Recommendation systems play a pivotal role in suggesting items to users based on their preferences. However, in online platforms, these systems inevitably offer unsuitable recommendations due to limited model capacity, poor data quality, or…

Information Retrieval · Computer Science 2024-10-29 Chengyu Lai , Sheng Zhou , Zhimeng Jiang , Qiaoyu Tan , Yuanchen Bei , Jiawei Chen , Ningyu Zhang , Jiajun Bu

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

This study explores the necessity of performing cross-corpora evaluation for grammatical error correction (GEC) models. GEC models have been previously evaluated based on a single commonly applied corpus: the CoNLL-2014 benchmark. However,…

Computation and Language · Computer Science 2019-04-08 Masato Mita , Tomoya Mizumoto , Masahiro Kaneko , Ryo Nagata , Kentaro Inui

Existing Grammatical Error Correction (GEC) systems suffer from limited reference diversity, leading to underestimated evaluation and restricted model generalization. To address this issue, we introduce the Judge of Edit-Level Validity…

Computation and Language · Computer Science 2025-12-09 Yuhao Zhan , Yuqing Zhang , Jing Yuan , Qixiang Ma , Zhiqi Yang , Yu Gu , Zemin Liu , Fei Wu

As a fundamental task in natural language processing, Chinese Grammatical Error Correction (CGEC) has gradually received widespread attention and become a research hotspot. However, one obvious deficiency for the existing CGEC evaluation…

Computation and Language · Computer Science 2022-05-03 Nankai Lin , Nankai Lin , Xiaotian Lin , Ziyu Yang , Shengyi Jiang

Automatic summarization methods are efficient but can suffer from low quality. In comparison, manual summarization is expensive but produces higher quality. Can humans and AI collaborate to improve summarization performance? In similar text…

Computation and Language · Computer Science 2022-06-15 Vivian Lai , Alison Smith-Renner , Ke Zhang , Ruijia Cheng , Wenjuan Zhang , Joel Tetreault , Alejandro Jaimes

While there exist strong benchmark datasets for grammatical error correction (GEC), high-quality annotated spoken datasets for Spoken GEC (SGEC) are still under-resourced. In this paper, we propose a fully automated method to generate…

Computation and Language · Computer Science 2025-07-28 Penny Karanasou , Mengjie Qian , Stefano Bannò , Mark J. F. Gales , Kate M. Knill

Grammatical Error Correction (GEC) is an important aspect of natural language processing. Arabic has a complicated morphological and syntactic structure, posing a greater challenge than other languages. Even though modern neural models have…

Computation and Language · Computer Science 2025-11-19 Ahlam Alrehili , Areej Alhothali

Sentence level quality estimation (QE) for machine translation (MT) attempts to predict the translation edit rate (TER) cost of post-editing work required to correct MT output. We describe our view on sentence-level QE as dictated by…

Computation and Language · Computer Science 2020-05-08 Junpei Zhou , Ciprian Chelba , Yuezhang , Li

Natural language processing technology has rapidly improved automated grammatical error correction tasks, and the community begins to explore document-level revision as one of the next challenges. To go beyond sentence-level automated…

Computation and Language · Computer Science 2022-05-24 Masato Mita , Keisuke Sakaguchi , Masato Hagiwara , Tomoya Mizumoto , Jun Suzuki , Kentaro Inui

Automatic post-editing (APE), which aims to correct errors in the output of machine translation systems in a post-processing step, is an important task in natural language processing. While recent work has achieved considerable performance…

Computation and Language · Computer Science 2019-11-12 Xuancheng Huang , Yang Liu , Huanbo Luan , Jingfang Xu , Maosong Sun

Grammatical error correction (GEC) is the task of detecting and correcting errors in a written text. The idea of combining multiple system outputs has been successfully used in GEC. To achieve successful system combination, multiple…

Computation and Language · Computer Science 2021-10-29 Wenjuan Han , Hwee Tou Ng

In this paper, we present a simple and efficient GEC sequence tagger using a Transformer encoder. Our system is pre-trained on synthetic data and then fine-tuned in two stages: first on errorful corpora, and second on a combination of…

Computation and Language · Computer Science 2020-06-01 Kostiantyn Omelianchuk , Vitaliy Atrasevych , Artem Chernodub , Oleksandr Skurzhanskyi

This paper presents an improved LLM based model for Grammatical Error Detection (GED), which is a very challenging and equally important problem for many applications. The traditional approach to GED involved hand-designed features, but…

Computation and Language · Computer Science 2024-11-26 Rahul Nihalani , Kushal Shah

Recent studies have revealed that grammatical error correction methods in the sequence-to-sequence paradigm are vulnerable to adversarial attack, and simply utilizing adversarial examples in the pre-training or post-training process can…

Computation and Language · Computer Science 2023-10-24 Zecheng Tang , Kaifeng Qi , Juntao Li , Min Zhang