English
Related papers

Related papers: Orca: A Few-shot Benchmark for Chinese Conversatio…

200 papers

Machine reading comprehension (MRC), which requires a machine to answer questions based on a given context, has attracted increasing attention with the incorporation of various deep-learning techniques over the past few years. Although…

Computation and Language · Computer Science 2019-11-06 Shanshan Liu , Xin Zhang , Sheng Zhang , Hui Wang , Weiming Zhang

Recent research has focused on enhancing the capability of smaller models through imitation learning, drawing on the outputs generated by large foundation models (LFMs). A number of issues impact the quality of these models, ranging from…

Computation and Language · Computer Science 2023-06-06 Subhabrata Mukherjee , Arindam Mitra , Ganesh Jawahar , Sahaj Agarwal , Hamid Palangi , Ahmed Awadallah

Practical dialog systems need to deal with various knowledge sources, noisy user expressions, and the shortage of annotated data. To better solve the above problems, we propose CGoDial, new challenging and comprehensive Chinese benchmark…

Computation and Language · Computer Science 2022-11-22 Yinpei Dai , Wanwei He , Bowen Li , Yuchuan Wu , Zheng Cao , Zhongqi An , Jian Sun , Yongbin Li

Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversational interaction scenes. Machines are required to make a decision of "Yes/No/Inquire" or generate a follow-up question when the decision is…

Computation and Language · Computer Science 2022-12-20 Xiao Zhang , Heyan Huang , Zewen Chi , Xian-Ling Mao

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

Machine reading comprehension (MRC) is a long-standing topic in natural language processing (NLP). The MRC task aims to answer a question based on the given context. Recently studies focus on multi-hop MRC which is a more challenging…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Machine Reading Comprehension (MRC) is a task that requires machine to understand natural language and answer questions by reading a document. It is the core of automatic response technology such as chatbots and automatized customer…

Computation and Language · Computer Science 2019-09-18 Seungyoung Lim , Myungji Kim , Jooyoul Lee

Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper, we propose a novel approach called Convolutional Spatial…

Computation and Language · Computer Science 2019-11-05 Zhipeng Chen , Yiming Cui , Wentao Ma , Shijin Wang , Guoping Hu

Machine Reading Comprehension (MRC) is the task of answering a question over a paragraph of text. While neural MRC systems gain popularity and achieve noticeable performance, issues are being raised with the methodology used to establish…

Computation and Language · Computer Science 2020-03-11 Viktor Schlegel , Marco Valentino , André Freitas , Goran Nenadic , Riza Batista-Navarro

Reading comprehension is one of the crucial tasks for furthering research in natural language understanding. A lot of diverse reading comprehension datasets have recently been introduced to study various phenomena in natural language,…

Computation and Language · Computer Science 2020-01-01 Dheeru Dua , Ananth Gottumukkala , Alon Talmor , Sameer Singh , Matt Gardner

Machine reading comprehension (MRC) aims to teach machines to read and comprehend human languages, which is a long-standing goal of natural language processing (NLP). With the burst of deep neural networks and the evolution of…

Computation and Language · Computer Science 2020-05-14 Zhuosheng Zhang , Hai Zhao , Rui Wang

We present Native Chinese Reader (NCR), a new machine reading comprehension (MRC) dataset with particularly long articles in both modern and classical Chinese. NCR is collected from the exam questions for the Chinese course in China's high…

Computation and Language · Computer Science 2021-12-15 Shusheng Xu , Yichen Liu , Xiaoyu Yi , Siyuan Zhou , Huizi Li , Yi Wu

Multiple-choice reading comprehension (MCRC) is the task of selecting the correct answer from multiple options given a question and an article. Existing MCRC models typically either read each option independently or compute a fixed-length…

Computation and Language · Computer Science 2019-03-08 Qiu Ran , Peng Li , Weiwei Hu , Jie Zhou

Machine reading comprehension tasks require a machine reader to answer questions relevant to the given document. In this paper, we present the first free-form multiple-Choice Chinese machine reading Comprehension dataset (C^3), containing…

Computation and Language · Computer Science 2019-12-18 Kai Sun , Dian Yu , Dong Yu , Claire Cardie

This paper presents the development process of a Vietnamese spoken language corpus for machine reading comprehension (MRC) tasks and provides insights into the challenges and opportunities associated with using real-world data for machine…

Computation and Language · Computer Science 2025-07-22 Thinh Phuoc Ngo , Khoa Tran Anh Dang , Son T. Luu , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

We present an accurate and interpretable method for answer extraction in machine reading comprehension that is reminiscent of case-based reasoning (CBR) from classical AI. Our method (CBR-MRC) builds upon the hypothesis that contextualized…

Computation and Language · Computer Science 2025-11-27 Dung Thai , Dhruv Agarwal , Mudit Chaudhary , Wenlong Zhao , Rajarshi Das , Manzil Zaheer , Jay-Yoon Lee , Hannaneh Hajishirzi , Andrew McCallum

This paper presents the ReCO, a human-curated ChineseReading Comprehension dataset on Opinion. The questions in ReCO are opinion based queries issued to the commercial search engine. The passages are provided by the crowdworkers who extract…

Computation and Language · Computer Science 2020-06-23 BingningWang , Ting Yao , Qi Zhang , Jingfang Xu , Xiaochuan Wang

As an indispensable ingredient of intelligence, commonsense reasoning is crucial for large language models (LLMs) in real-world scenarios. In this paper, we propose CORECODE, a dataset that contains abundant commonsense knowledge manually…

Computation and Language · Computer Science 2023-12-21 Dan Shi , Chaobin You , Jiantao Huang , Taihao Li , Deyi Xiong

We present FRMT, a new dataset and evaluation benchmark for Few-shot Region-aware Machine Translation, a type of style-targeted translation. The dataset consists of professional translations from English into two regional variants each of…

Computation and Language · Computer Science 2023-10-04 Parker Riley , Timothy Dozat , Jan A. Botha , Xavier Garcia , Dan Garrette , Jason Riesa , Orhan Firat , Noah Constant