English
Related papers

Related papers: CJRC: A Reliable Human-Annotated Benchmark DataSet…

200 papers

Machine reading comprehension is a challenging task and hot topic in natural language processing. Its goal is to develop systems to answer the questions regarding a given context. In this paper, we present a comprehensive survey on…

Computation and Language · Computer Science 2020-10-22 Razieh Baradaran , Razieh Ghiasi , Hossein Amirkhani

Machine reading comprehension (MRC) is the task that asks a machine to answer questions based on a given context. For Chinese MRC, due to the non-literal and non-compositional semantic characteristics, Chinese idioms pose unique challenges…

Computation and Language · Computer Science 2020-11-10 Siyu Long , Ran Wang , Kun Tao , Jiali Zeng , Xin-Yu Dai

A previous similar case in common law systems can be used as a reference with respect to the current case such that identical situations can be treated similarly in every case. However, current approaches for judgment document similarity…

Artificial Intelligence · Computer Science 2018-08-07 Yinglong Ma , Peng Zhang , Jiangang Ma

Machine comprehension of texts longer than a single sentence often requires coreference resolution. However, most current reading comprehension benchmarks do not contain complex coreferential phenomena and hence fail to evaluate the ability…

Computation and Language · Computer Science 2019-09-06 Pradeep Dasigi , Nelson F. Liu , Ana Marasović , Noah A. Smith , Matt Gardner

We introduce a large scale MAchine Reading COmprehension dataset, which we name MS MARCO. The dataset comprises of 1,010,916 anonymized questions---sampled from Bing's search query logs---each with a human generated answer and 182,669…

Named entity recognition (NER) plays an essential role in natural language processing systems. Judicial NER is a fundamental component of judicial information retrieval, entity relation extraction, and knowledge map building. However,…

Computation and Language · Computer Science 2020-12-30 Pin Tang , Pinli Yang , Yuang Shi , Yi Zhou , Feng Lin , Yan Wang

Citation faithfulness detection is critical for enhancing retrieval-augmented generation (RAG) systems, yet large-scale Chinese datasets for this task are scarce. Existing methods face prohibitive costs due to the need for manually…

Computation and Language · Computer Science 2025-02-18 Ziyao Xu , Shaohang Wei , Zhuoheng Han , Jing Jin , Zhe Yang , Xiaoguang Li , Haochen Tan , Zhijiang Guo , Houfeng Wang

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale…

Computation and Language · Computer Science 2015-11-20 Karl Moritz Hermann , Tomáš Kočiský , Edward Grefenstette , Lasse Espeholt , Will Kay , Mustafa Suleyman , Phil Blunsom

Machine Reading Comprehension (MRC) is an essential task in evaluating natural language understanding. Existing MRC datasets primarily assess specific aspects of reading comprehension (RC), lacking a comprehensive MRC benchmark. To fill…

Computation and Language · Computer Science 2025-03-11 Shengkun Ma , Hao Peng , Lei Hou , Juanzi Li

Scientific document understanding is challenging as the data is highly domain specific and diverse. However, datasets for tasks with scientific text require expensive manual annotation and tend to be small and limited to only one or a few…

Computation and Language · Computer Science 2021-05-26 Dustin Wright , Isabelle Augenstein

The conversational machine reading comprehension (CMRC) task aims to answer questions in conversations, which has been a hot research topic in recent years because of its wide applications. However, existing CMRC benchmarks in which each…

Computation and Language · Computer Science 2023-10-16 Nuo Chen , Hongguang Li , Junqing He , Yinan Bao , Xinshi Lin , Qi Yang , Jianfeng Liu , Ruyi Gan , Jiaxing Zhang , Baoyuan Wang , Jia Li

Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the overall efficiency and accuracy of content review. However,…

Computation and Language · Computer Science 2025-08-14 Kangwei Liu , Siyuan Cheng , Bozhong Tian , Xiaozhuan Liang , Yuyang Yin , Meng Han , Ningyu Zhang , Bryan Hooi , Xi Chen , Shumin Deng

Word embedding is a modern distributed word representations approach widely used in many natural language processing tasks. Converting the vocabulary in a legal document into a word embedding model facilitates subjecting legal documents to…

Computation and Language · Computer Science 2022-04-01 Chun-Hsien Lin , Pu-Jen Cheng

Legal judgment prediction suffers from the problem of long case documents exceeding tens of thousands of words, in general, and having a non-uniform structure. Predicting judgments from such documents becomes a challenging task, more so on…

Computation and Language · Computer Science 2024-03-12 Nishchal Prasad , Mohand Boughanem , Taoufiq Dkaki

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce…

Computation and Language · Computer Science 2024-06-24 Zhiwei Fei , Songyang Zhang , Xiaoyu Shen , Dawei Zhu , Xiao Wang , Maosong Cao , Fengzhe Zhou , Yining Li , Wenwei Zhang , Dahua Lin , Kai Chen , Jidong Ge

Online education platforms have significantly transformed the dissemination of educational resources by providing a dynamic and digital infrastructure. With the further enhancement of this transformation, the advent of Large Language Models…

Artificial Intelligence · Computer Science 2024-09-26 Qian-Wen Zhang , Haochen Wang , Fang Li , Siyu An , Lingfeng Qiao , Liangcai Gao , Di Yin , Xing Sun

When training and evaluating machine reading comprehension models, it is very important to work with high-quality datasets that are also representative of real-world reading comprehension tasks. This requirement includes, for instance,…

Computation and Language · Computer Science 2023-05-16 Mariia Zyrianova , Dmytro Kalpakchi , Johan Boye

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this…

Computation and Language · Computer Science 2019-10-16 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou , Zhiyuan Liu

Existing Chinese text error detection mainly focuses on spelling and simple grammatical errors. These errors have been studied extensively and are relatively simple for humans. On the contrary, Chinese semantic errors are understudied and…

Computation and Language · Computer Science 2022-04-18 Bo Sun , Baoxin Wang , Wanxiang Che , Dayong Wu , Zhigang Chen , Ting Liu