English
Related papers

Related papers: Minimum Bayes' Risk Decoding for System Combinatio…

200 papers

We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transformer sequence-to-sequence model on 4B tokens of Wikipedia…

Computation and Language · Computer Science 2018-11-06 Jared Lichtarge , Christopher Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar

Inference methods play an important role in eliciting the performance of large language models (LLMs). Currently, LLMs use inference methods utilizing generated multiple samples, which can be derived from Minimum Bayes Risk (MBR) Decoding.…

Computation and Language · Computer Science 2025-06-10 Hidetaka Kamigaito , Hiroyuki Deguchi , Yusuke Sakai , Katsuhiko Hayashi , Taro Watanabe

Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated…

Computation and Language · Computer Science 2026-05-29 Riza Setiawan Soetedjo , Yusuke Sakai , Hidetaka Kamigaito , Jingun Kwon , Manabu Okumura , Taro Watanabe

To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non-autoregressive or…

Computation and Language · Computer Science 2024-10-23 Kamal Al-Sabahi , Kang Yang , Wangwang Liu , Guanyu Jiang , Xian Li , Ming Yang

Minimum Bayesian Risk Decoding (MBR) emerges as a promising decoding algorithm in Neural Machine Translation. However, MBR performs poorly with label smoothing, which is surprising as label smoothing provides decent improvement with beam…

Computation and Language · Computer Science 2023-05-19 Jianhao Yan , Jin Xu , Fandong Meng , Jie Zhou , Yue Zhang

Pretraining-based (PT-based) automatic evaluation metrics (e.g., BERTScore and BARTScore) have been widely used in several sentence generation tasks (e.g., machine translation and text summarization) due to their better correlation with…

Computation and Language · Computer Science 2022-11-04 Peiyuan Gong , Xuebo Liu , Heyan Huang , Min Zhang

This paper investigates how to effectively incorporate a pre-trained masked language model (MLM), such as BERT, into an encoder-decoder (EncDec) model for grammatical error correction (GEC). The answer to this question is not as…

Computation and Language · Computer Science 2020-06-02 Masahiro Kaneko , Masato Mita , Shun Kiyono , Jun Suzuki , Kentaro Inui

Grammatical Error Correction (GEC) is an important aspect of natural language processing. Arabic has a complicated morphological and syntactic structure, posing a greater challenge than other languages. Even though modern neural models have…

Computation and Language · Computer Science 2025-11-19 Ahlam Alrehili , Areej Alhothali

Grammar error correction (GEC) is an important application aspect of natural language processing techniques. The past decade has witnessed significant progress achieved in GEC for the sake of increasing popularity of machine learning and…

Computation and Language · Computer Science 2020-05-15 Yu Wang , Yuelin Wang , Jie Liu , Zhuo Liu

Grammatical error correction (GEC) is one of the areas in natural language processing in which purely neural models have not yet superseded more traditional symbolic models. Hybrid systems combining phrase-based statistical machine…

Computation and Language · Computer Science 2019-04-08 Felix Stahlberg , Christopher Bryant , Bill Byrne

Grammatical error correction (GEC) is the task of detecting and correcting grammatical errors in texts written by second language learners. The statistical machine translation (SMT) approach to GEC, in which sentences written by second…

Computation and Language · Computer Science 2016-06-02 Duc Tam Hoang , Shamil Chollampatt , Hwee Tou Ng

The task of Grammatical Error Correction (GEC) aims to automatically correct grammatical errors in natural texts. Almost all previous works treat annotated training data equally, but inherent discrepancies in data are neglected. In this…

Computation and Language · Computer Science 2023-11-27 Jiahao Li , Quan Wang , Chiwei Zhu , Zhendong Mao , Yongdong Zhang

In most error correction coding (ECC) frameworks, the typical error metric is the bit error rate (BER) which measures the number of bit errors. For this metric, the positions of the bits are not relevant to the decoding, and in many noise…

Signal Processing · Electrical Eng. & Systems 2021-10-11 Chai Wah Wu

Recent research in decoding methods for Natural Language Generation (NLG) tasks has shown that MAP decoding is not optimal, because model probabilities do not always align with human preferences. Stronger decoding methods, including Quality…

Computation and Language · Computer Science 2024-03-27 Mara Finkelstein , Subhajit Naskar , Mehdi Mirzazadeh , Apurva Shah , Markus Freitag

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2014-06-26 Yunghsiang Han , Hung-Ta Pai , Rong Zheng , Pramod K. Varshney

Error type information has been widely used to improve the performance of grammatical error correction (GEC) models, whether for generating corrections, re-ranking them, or combining GEC models. Combining GEC models that have complementary…

Computation and Language · Computer Science 2024-11-01 Muhammad Reza Qorib , Alham Fikri Aji , Hwee Tou Ng

We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC system through…

Computation and Language · Computer Science 2019-07-24 Satoru Katsumata , Mamoru Komachi

Metric validation in Grammatical Error Correction (GEC) is currently done by observing the correlation between human and metric-induced rankings. However, such correlation studies are costly, methodologically troublesome, and suffer from…

Computation and Language · Computer Science 2018-05-08 Leshem Choshen , Omri Abend

Previously, neural methods in grammatical error correction (GEC) did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) baselines. We demonstrate parallels between neural GEC and low-resource…

Computation and Language · Computer Science 2018-04-18 Marcin Junczys-Dowmunt , Roman Grundkiewicz , Shubha Guha , Kenneth Heafield

Evaluating the performance of Grammatical Error Correction (GEC) systems is a challenging task due to its subjectivity. Designing an evaluation metric that is as objective as possible is crucial to the development of GEC task. However,…

Computation and Language · Computer Science 2023-10-18 Jingheng Ye , Yinghui Li , Qingyu Zhou , Yangning Li , Shirong Ma , Hai-Tao Zheng , Ying Shen