中文
相关论文

相关论文: CLEME2.0: Towards Interpretable Evaluation by Dise…

200 篇论文

Evaluation metrics are a key ingredient for progress of text generation systems. In recent years, several BERT-based evaluation metrics have been proposed (including BERTScore, MoverScore, BLEURT, etc.) which correlate much better with…

计算与语言 · 计算机科学 2021-11-02 Marvin Kaster , Wei Zhao , Steffen Eger

Human evaluation of machine translation normally uses sentence-level measures such as relative ranking or adequacy scales. However, these provide no insight into possible errors, and do not scale well with sentence length. We argue for a…

计算与语言 · 计算机科学 2016-09-28 Alexandra Birch , Omri Abend , Ondrej Bojar , Barry Haddow

Machine Learning (ML) systems are a building part of the modern tools which impact our daily life in several application domains. Due to their black-box nature, those systems are hardly adopted in application domains (e.g. health, finance)…

机器学习 · 计算机科学 2022-10-24 Mario Alfonso Prado-Romero , Giovanni Stilo

We propose a neural encoder-decoder model with reinforcement learning (NRL) for grammatical error correction (GEC). Unlike conventional maximum likelihood estimation (MLE), the model directly optimizes towards an objective that considers a…

计算与语言 · 计算机科学 2017-07-04 Keisuke Sakaguchi , Matt Post , Benjamin Van Durme

Widely used learned metrics for machine translation evaluation, such as COMET and BLEURT, estimate the quality of a translation hypothesis by providing a single sentence-level score. As such, they offer little insight into translation…

计算与语言 · 计算机科学 2023-10-17 Nuno M. Guerreiro , Ricardo Rei , Daan van Stigt , Luisa Coheur , Pierre Colombo , André F. T. Martins

Grammatical error correction (GEC) is a well-explored problem in English with many existing models and datasets. However, research on GEC in morphologically rich languages has been limited due to challenges such as data scarcity and…

计算与语言 · 计算机科学 2023-11-10 Bashar Alhafni , Go Inoue , Christian Khairallah , Nizar Habash

We introduce a large and diverse Czech corpus annotated for grammatical error correction (GEC) with the aim to contribute to the still scarce data resources in this domain for languages other than English. The Grammar Error Correction…

计算与语言 · 计算机科学 2022-04-22 Jakub Náplava , Milan Straka , Jana Straková , Alexandr Rosen

Grammatical feedback is crucial for L2 learners, teachers, and testers. Spoken grammatical error correction (GEC) aims to supply feedback to L2 learners on their use of grammar when speaking. This process usually relies on a cascaded…

计算与语言 · 计算机科学 2024-07-22 Stefano Bannò , Rao Ma , Mengjie Qian , Kate M. Knill , Mark J. F. Gales

Grammatical Error Correction (GEC) and feedback play a vital role in supporting second language (L2) learners, educators, and examiners. While written GEC is well-established, spoken GEC (SGEC), aiming to provide feedback based on learners'…

计算与语言 · 计算机科学 2025-06-25 Mengjie Qian , Rao Ma , Stefano Bannò , Mark J. F. Gales , Kate M. Knill

Currently available grammatical error correction (GEC) datasets are compiled using well-formed written text, limiting the applicability of these datasets to other domains such as informal writing and dialog. In this paper, we present a…

计算与语言 · 计算机科学 2025-08-27 Xun Yuan , Derek Pham , Sam Davidson , Zhou Yu

Grammatical Error Correction (GEC) relies on accurate error annotation and evaluation, yet existing frameworks, such as $\texttt{errant}$, face limitations when extended to typologically diverse languages. In this paper, we introduce a…

计算与语言 · 计算机科学 2025-06-10 Mengyang Qiu , Tran Minh Nguyen , Zihao Huang , Zelong Li , Yang Gu , Qingyu Gao , Siliang Liu , Jungyeul Park

Chinese Grammatical Error Correction (CGEC) aims to automatically detect and correct grammatical errors contained in Chinese text. In the long term, researchers regard CGEC as a task with a certain degree of uncertainty, that is, an…

计算与语言 · 计算机科学 2022-10-28 Jingheng Ye , Yinghui Li , Shirong Ma , Rui Xie , Wei Wu , Hai-Tao Zheng

We describe an approach to Grammatical Error Correction (GEC) that is effective at making use of models trained on large amounts of weakly supervised bitext. We train the Transformer sequence-to-sequence model on 4B tokens of Wikipedia…

计算与语言 · 计算机科学 2018-11-06 Jared Lichtarge , Christopher Alberti , Shankar Kumar , Noam Shazeer , Niki Parmar

Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn…

计算与语言 · 计算机科学 2016-06-02 Shamil Chollampatt , Kaveh Taghipour , Hwee Tou Ng

Medical imaging diagnosis increasingly relies on Machine Learning (ML) models. This is a task that is often hampered by severely imbalanced datasets, where positive cases can be quite rare. Their use is further compromised by their limited…

Clinical language processing has received a lot of attention in recent years, resulting in new models or methods for disease phenotyping, mortality prediction, and other tasks. Unfortunately, many of these approaches are tested under…

计算与语言 · 计算机科学 2022-09-30 Travis R. Goodwin , Dina Demner-Fushman

Model ensemble has been in widespread use for Grammatical Error Correction (GEC), boosting model performance. We hypothesize that model ensemble based on the perplexity (PPL) computed by pre-trained language models (PLMs) should benefit the…

计算与语言 · 计算机科学 2023-05-25 Chenming Tang , Xiuyu Wu , Yunfang Wu

Evaluating grammatical error correction requires metrics that reflect the diversity of valid human corrections rather than privileging a single reference. Existing frameworks, largely edit-based and English-centric, rely on rigid alignments…

Grammatical Error Correction (GEC) has been broadly applied in automatic correction and proofreading system recently. However, it is still immature in Chinese GEC due to limited high-quality data from native speakers in terms of category…

计算与语言 · 计算机科学 2023-08-08 Lvxiaowei Xu , Jianwang Wu , Jiawei Peng , Jiayu Fu , Ming Cai

Chinese Grammatical Error Correction (CGEC) aims to generate a correct sentence from an erroneous sequence, where different kinds of errors are mixed. This paper divides the CGEC task into two steps, namely spelling error correction and…

计算与语言 · 计算机科学 2022-11-04 Xiuyu Wu , Yunfang Wu