English
Related papers

Related papers: A Framework for Evaluation of Machine Reading Comp…

200 papers

We present XCMRC, the first public cross-lingual language understanding (XLU) benchmark which aims to test machines on their cross-lingual reading comprehension ability. To be specific, XCMRC is a Cross-lingual Cloze-style Machine Reading…

Computation and Language · Computer Science 2019-08-16 Pengyuan Liu , Yuning Deng , Chenghao Zhu , Han Hu

Conversational machine reading comprehension (CMRC) aims to assist computers to understand an natural language text and thereafter engage in a multi-turn conversation to answer questions related to the text. Existing methods typically…

Computation and Language · Computer Science 2022-09-26 Xiao Zhang , Heyan Huang , Zewen Chi , Xian-Ling Mao

Reading Comprehension (RC) is a task of answering a question from a given passage or a set of passages. In the case of multiple passages, the task is to find the best possible answer to the question. Recent trials and experiments in the…

Computation and Language · Computer Science 2022-01-06 Avi Chawla

Machine reading comprehension (MRC) poses new challenges over logical reasoning, which aims to understand the implicit logical relations entailed in the given contexts and perform inference over them. Due to the complexity of logic, logical…

Computation and Language · Computer Science 2023-06-22 Jialin Chen , Zhuosheng Zhang , Hai Zhao

A fundamental trade-off between effectiveness and efficiency needs to be balanced when designing an online question answering system. Effectiveness comes from sophisticated functions such as extractive machine reading comprehension (MRC),…

Computation and Language · Computer Science 2019-08-14 Ming Yan , Jiangnan Xia , Chen Wu , Bin Bi , Zhongzhou Zhao , Ji Zhang , Luo Si , Rui Wang , Wei Wang , Haiqing Chen

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this…

Computation and Language · Computer Science 2019-10-16 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou , Zhiyuan Liu

Machine Reading Comprehension (MRC) for question answering (QA), which aims to answer a question given the relevant context passages, is an important way to test the ability of intelligence systems to understand human language.…

Computation and Language · Computer Science 2019-11-20 Di Jin , Shuyang Gao , Jiun-Yu Kao , Tagyoung Chung , Dilek Hakkani-tur

Multiple-choice Machine Reading Comprehension (MRC) is an important and challenging Natural Language Understanding (NLU) task, in which a machine must choose the answer to a question from a set of choices, with the question placed in…

Computation and Language · Computer Science 2020-03-12 Hui Wan

Evaluating multimodal large language models (MLLMs) is fundamentally challenged by the absence of structured, interpretable, and theoretically grounded benchmarks; current heuristically-grouped tasks have vague cognitive targets,…

Computation and Language · Computer Science 2025-11-14 Shengwu. Xiong , Tianyu. Zou , Cong. Wang , Xuelong Li

Advances in NLP have yielded impressive results for the task of machine reading comprehension (MRC), with approaches having been reported to achieve performance comparable to that of humans. In this paper, we investigate whether…

Computation and Language · Computer Science 2021-06-16 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements. However, most of the neural MRC models are still far from robust and fail to generalize well in real-world…

Computation and Language · Computer Science 2021-07-22 Hongxuan Tang , Hongyu Li , Jing Liu , Yu Hong , Hua Wu , Haifeng Wang

Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few efforts on other languages mainly due to the lack of large-scale…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

Web question answering (QA) has become an indispensable component in modern search systems, which can significantly improve users' search experience by providing a direct answer to users' information need. This could be achieved by applying…

Information Retrieval · Computer Science 2019-07-12 Lixin Su , Jiafeng Guo , Yixing Fan , Yanyan Lan , Xueqi Cheng

Multi-hop Machine reading comprehension is a challenging task with aim of answering a question based on disjoint pieces of information across the different passages. The evaluation metrics and datasets are a vital part of multi-hop MRC…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Machine reading comprehension (MRC) is a sub-field in natural language processing that aims to assist computers understand unstructured texts and then answer questions related to them. In practice, the conversation is an essential way to…

Computation and Language · Computer Science 2021-10-01 Son T. Luu , Mao Nguyen Bui , Loi Duc Nguyen , Khiem Vinh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Although existing machine reading comprehension models are making rapid progress on many datasets, they are far from robust. In this paper, we propose an understanding-oriented machine reading comprehension model to address three kinds of…

Computation and Language · Computer Science 2022-07-04 Feiliang Ren , Yongkang Liu , Bochao Li , Shilei Liu , Bingchao Wang , Jiaqi Wang , Chunchao Liu , Qi Ma

Multimedia or spoken content presents more attractive information than plain text content, but it's more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much more…

Computation and Language · Computer Science 2016-08-24 Bo-Hsiang Tseng , Sheng-Syun Shen , Hung-Yi Lee , Lin-Shan Lee

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

Coreference resolution is essential for natural language understanding and has been long studied in NLP. In recent years, as the format of Question Answering (QA) became a standard for machine reading comprehension (MRC), there have been…

Computation and Language · Computer Science 2021-06-10 Mingzhu Wu , Nafise Sadat Moosavi , Dan Roth , Iryna Gurevych

Modern Code Review (MCR) is a standard in all kinds of organizations that develop software. MCR pays for itself through perceived and proven benefits in quality assurance and knowledge transfer. However, the time invest in MCR is generally…

Software Engineering · Computer Science 2021-04-20 Robert Heumüller