English
Related papers

Related papers: MuCGEC: a Multi-Reference Multi-Source Evaluation …

200 papers

In this paper, we carry out experimental research on Grammatical Error Correction, delving into the nuances of single-model systems, comparing the efficiency of ensembling and ranking methods, and exploring the application of large language…

Computation and Language · Computer Science 2024-04-24 Kostiantyn Omelianchuk , Andrii Liubonko , Oleksandr Skurzhanskyi , Artem Chernodub , Oleksandr Korniienko , Igor Samokhin

Despite major advances in machine translation (MT) in recent years, progress remains limited for many low-resource languages that lack large-scale training data and linguistic resources. In this paper, we introduce \dsname, a novel…

We introduce new methods for estimating and evaluating embeddings of words in more than fifty languages in a single shared embedding space. Our estimation methods, multiCluster and multiCCA, use dictionaries and monolingual data; they do…

Computation and Language · Computer Science 2016-05-24 Waleed Ammar , George Mulcaire , Yulia Tsvetkov , Guillaume Lample , Chris Dyer , Noah A. Smith

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction capabilities of…

Computation and Language · Computer Science 2023-07-07 Nankai Lin , Hongyan Wu , Sihui Fu , Shengyi Jiang , Aimin Yang

Existing approaches for grammatical error correction (GEC) largely rely on supervised learning with manually created GEC datasets. However, there has been little focus on verifying and ensuring the quality of the datasets, and on how…

Computation and Language · Computer Science 2020-10-08 Masato Mita , Shun Kiyono , Masahiro Kaneko , Jun Suzuki , Kentaro Inui

Reference resolution on extended texts (several thousand references) cannot be evaluated manually. An evaluation algorithm has been proposed for the MUC tests, using equivalence classes for the coreference relation. However, we show here…

Computation and Language · Computer Science 2007-05-23 Andrei Popescu-Belis , Isabelle Robba

Word embedding is a modern distributed word representations approach widely used in many natural language processing tasks. Converting the vocabulary in a legal document into a word embedding model facilitates subjecting legal documents to…

Computation and Language · Computer Science 2022-04-01 Chun-Hsien Lin , Pu-Jen Cheng

Large Language Models (LLMs) perform exceedingly well in Natural Language Understanding (NLU) tasks for many languages including English. However, despite being the fifth most-spoken language globally, Grammatical Error Correction (GEC) in…

Computation and Language · Computer Science 2025-06-06 Pramit Bhattacharyya , Arnab Bhattacharya

Grammatical Error Correction (GEC) and grammatical acceptability judgment (COLA) are core tasks in natural language processing, sharing foundational grammatical knowledge yet typically evolving independently. This paper introduces COLA-GEC,…

Computation and Language · Computer Science 2025-07-17 Xiangyu Yang , Xinying Qiu

Generative chat models, such as ChatGPT and GPT-4, have revolutionized natural language generation (NLG) by incorporating instructions and human feedback to achieve significant performance improvements. However, the lack of standardized…

Computation and Language · Computer Science 2023-05-25 Xuanyu Zhang , Bingbing Li , Qing Yang

Recent progress in the task of Grammatical Error Correction (GEC) has been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining data and through the publication of small and higher-quality…

Computation and Language · Computer Science 2020-09-10 Jared Lichtarge , Chris Alberti , Shankar Kumar

Developing Large Language Models (LLMs) with robust long-context capabilities has been the recent research focus, resulting in the emergence of long-context LLMs proficient in Chinese. However, the evaluation of these models remains…

Computation and Language · Computer Science 2024-10-17 Zexuan Qiu , Jingjing Li , Shijue Huang , Xiaoqi Jiao , Wanjun Zhong , Irwin King

Passage ranking involves two stages: passage retrieval and passage re-ranking, which are important and challenging topics for both academics and industries in the area of Information Retrieval (IR). However, the commonly-used datasets for…

Information Retrieval · Computer Science 2023-04-10 Xiaohui Xie , Qian Dong , Bingning Wang , Feiyang Lv , Ting Yao , Weinan Gan , Zhijing Wu , Xiangsheng Li , Haitao Li , Yiqun Liu , Jin Ma

Word similarity computation is a widely recognized task in the field of lexical semantics. Most proposed tasks test on similarity of word pairs of single morpheme, while few works focus on words of two morphemes or more morphemes. In this…

Computation and Language · Computer Science 2019-07-02 Junjie Huang , Fanchao Qi , Chenghao Yang , Zhiyuan Liu , Maosong Sun

Lexical analysis is believed to be a crucial step towards natural language understanding and has been widely studied. Recent years, end-to-end lexical analysis models with recurrent neural networks have gained increasing attention. In this…

Computation and Language · Computer Science 2018-07-06 Zhenyu Jiao , Shuqi Sun , Ke Sun

Metric validation in Grammatical Error Correction (GEC) is currently done by observing the correlation between human and metric-induced rankings. However, such correlation studies are costly, methodologically troublesome, and suffer from…

Computation and Language · Computer Science 2018-05-08 Leshem Choshen , Omri Abend

We introduce gec-metrics, a library for using and developing grammatical error correction (GEC) evaluation metrics through a unified interface. Our library enables fair system comparisons by ensuring that everyone conducts evaluations using…

Computation and Language · Computer Science 2025-05-27 Takumi Goto , Yusuke Sakai , Taro Watanabe

Metaphor is a prominent linguistic device in human language and literature, as they add color, imagery, and emphasis to enhance effective communication. This paper introduces a large-scale high quality annotated Chinese Metaphor Corpus,…

Computation and Language · Computer Science 2024-02-22 Yujie Shao , Xinrong Yao , Xingwei Qu , Chenghua Lin , Shi Wang , Stephen W. Huang , Ge Zhang , Jie Fu

The importance of clear and correct text in legal documents cannot be understated, and, consequently, a grammatical error correction tool meant to assist a professional in the law must have the ability to understand the possible errors in…

Computation and Language · Computer Science 2026-04-23 Mircea Timpuriu , Mihaela-Claudia Cercel , Dumitru-Clementin Cercel

Lexical simplification has attracted much attention in many languages, which is the process of replacing complex words in a given sentence with simpler alternatives of equivalent meaning. Although the richness of vocabulary in Chinese makes…

Computation and Language · Computer Science 2020-10-15 Jipeng Qiang , Xinyu Lu , Yun Li , Yunhao Yuan , Yang Shi , Xindong Wu