English
Related papers

Related papers: CJRC: A Reliable Human-Annotated Benchmark DataSet…

200 papers

Every lawsuit document contains the information about the party's claim, court's analysis, decision and others, and all of this information are helpful to understand the case better and predict the judge's decision on similar case in the…

Computation and Language · Computer Science 2018-04-26 Xi Rao , Zhenxing Ke

Machine Reading Comprehension (MRC) is a challenging Natural Language Processing(NLP) research field with wide real-world applications. The great progress of this field in recent years is mainly due to the emergence of large-scale datasets…

Computation and Language · Computer Science 2020-10-22 Changchang Zeng , Shaobo Li , Qin Li , Jie Hu , Jianjun Hu

Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the contexts provide all the information required to answer them,…

Computation and Language · Computer Science 2020-11-17 James Ferguson , Matt Gardner , Hannaneh Hajishirzi , Tushar Khot , Pradeep Dasigi

We present a new dataset for machine comprehension in the medical domain. Our dataset uses clinical case reports with around 100,000 gap-filling queries about these cases. We apply several baselines and state-of-the-art neural readers to…

Computation and Language · Computer Science 2018-03-28 Simon Šuster , Walter Daelemans

A challenge in creating a dataset for machine reading comprehension (MRC) is to collect questions that require a sophisticated understanding of language to answer beyond using superficial cues. In this work, we investigate what makes…

Computation and Language · Computer Science 2018-08-29 Saku Sugawara , Kentaro Inui , Satoshi Sekine , Akiko Aizawa

Pre-trained language models achieves high performance on machine reading comprehension (MRC) tasks but the results are hard to explain. An appealing approach to make models explainable is to provide rationales for its decision. To…

Computation and Language · Computer Science 2022-03-25 Jiajie Zou , Yuran Zhang , Peiqing Jin , Cheng Luo , Xunyi Pan , Nai Ding

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise required for annotation.…

Computation and Language · Computer Science 2020-05-05 Xiang Yue , Bernal Jimenez Gutierrez , Huan Sun

Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, it is necessary to provide both answer prediction and…

Computation and Language · Computer Science 2022-04-29 Yiming Cui , Ting Liu , Wanxiang Che , Zhigang Chen , Shijin Wang

Chinese ancient documents, invaluable carriers of millennia of Chinese history and culture, hold rich knowledge across diverse fields but face challenges in digitization and understanding, i.e., traditional methods only scan images, while…

Reading comprehension is one of the crucial tasks for furthering research in natural language understanding. A lot of diverse reading comprehension datasets have recently been introduced to study various phenomena in natural language,…

Computation and Language · Computer Science 2020-01-01 Dheeru Dua , Ananth Gottumukkala , Alon Talmor , Sameer Singh , Matt Gardner

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

With the rapid advancement of natural language processing (NLP) technologies, the demand for high-quality Chinese document question-answering datasets is steadily growing. To address this issue, we present the Chinese Multi-Document…

Computation and Language · Computer Science 2025-11-06 Jing Gao , Shutiao Luo , Yumeng Liu , Yuanming Li , Hongji Zeng

We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the answer choices and…

Computation and Language · Computer Science 2020-05-01 Yevgeni Berzak , Jonathan Malmaud , Roger Levy

We present an accurate and interpretable method for answer extraction in machine reading comprehension that is reminiscent of case-based reasoning (CBR) from classical AI. Our method (CBR-MRC) builds upon the hypothesis that contextualized…

Computation and Language · Computer Science 2025-11-27 Dung Thai , Dhruv Agarwal , Mudit Chaudhary , Wenlong Zhao , Rajarshi Das , Manzil Zaheer , Jay-Yoon Lee , Hannaneh Hajishirzi , Andrew McCallum

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

Legal systems worldwide continue to struggle with overwhelming caseloads, limited judicial resources, and growing complexities in legal proceedings. Artificial intelligence (AI) offers a promising solution, with Legal Judgment Prediction…

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address…

Computation and Language · Computer Science 2023-10-24 Junling Liu , Peilin Zhou , Yining Hua , Dading Chong , Zhongyu Tian , Andrew Liu , Helin Wang , Chenyu You , Zhenhua Guo , Lei Zhu , Michael Lingzhi Li

Text simplification aims to make the text easier to understand by applying rewriting transformations. There has been very little research on Chinese text simplification for a long time. The lack of generic evaluation data is an essential…

Computation and Language · Computer Science 2024-06-06 Ruining Chong , Luming Lu , Liner Yang , Jinran Nie , Zhenghao Liu , Shuo Wang , Shuhan Zhou , Yaoxin Li , Erhong Yang

A fundamental trade-off between effectiveness and efficiency needs to be balanced when designing an online question answering system. Effectiveness comes from sophisticated functions such as extractive machine reading comprehension (MRC),…

Computation and Language · Computer Science 2019-08-14 Ming Yan , Jiangnan Xia , Chen Wu , Bin Bi , Zhongzhou Zhao , Ji Zhang , Luo Si , Rui Wang , Wei Wang , Haiqing Chen

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao