English
Related papers

Related papers: Analyzing Multiple-Choice Reading and Listening Co…

200 papers

Recently it has been shown that without any access to the contextual passage, multiple choice reading comprehension (MCRC) systems are able to answer questions significantly better than random on average. These systems use their accumulated…

Computation and Language · Computer Science 2023-05-31 Adian Liusie , Vatsal Raina , Mark Gales

Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-turn dialogues. It…

Computation and Language · Computer Science 2020-09-11 Junlong Li , Zhuosheng Zhang , Hai Zhao

For a natural language understanding benchmark to be useful in research, it has to consist of examples that are diverse and difficult enough to discriminate among current and near-future state-of-the-art systems. However, we do not yet know…

Computation and Language · Computer Science 2022-03-15 Saku Sugawara , Nikita Nangia , Alex Warstadt , Samuel R. Bowman

Multiple-choice tests are a common approach for assessing candidates' comprehension skills. Standard multiple-choice reading comprehension exams require candidates to select the correct answer option from a discrete set based on a question…

Computation and Language · Computer Science 2023-11-09 Vatsal Raina , Adian Liusie , Mark Gales

Multi-choice reading comprehension is a challenging task to select an answer from a set of candidate options when given passage and question. Previous approaches usually only calculate question-aware passage representation and ignore…

Computation and Language · Computer Science 2020-01-17 Shuailiang Zhang , Hai Zhao , Yuwei Wu , Zhuosheng Zhang , Xi Zhou , Xiang Zhou

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale…

Computation and Language · Computer Science 2015-11-20 Karl Moritz Hermann , Tomáš Kočiský , Edward Grefenstette , Lasse Espeholt , Will Kay , Mustafa Suleyman , Phil Blunsom

Multiple choice exams are widely used to assess candidates across a diverse range of domains and tasks. To moderate question quality, newly proposed questions often pass through pre-test evaluation stages before being deployed into…

Computation and Language · Computer Science 2023-10-17 Adian Liusie , Vatsal Raina , Andrew Mullooly , Kate Knill , Mark J. F. Gales

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

In this paper, we aim to extract commonsense knowledge to improve machine reading comprehension. We propose to represent relations implicitly by situating structured knowledge in a context instead of relying on a pre-defined set of…

Computation and Language · Computer Science 2020-10-20 Kai Sun , Dian Yu , Jianshu Chen , Dong Yu , Claire Cardie

Multi-choice reading comprehension is a challenging task, which involves the matching between a passage and a question-answer pair. This paper proposes a new co-matching approach to this problem, which jointly models whether a passage can…

Computation and Language · Computer Science 2018-06-12 Shuohang Wang , Mo Yu , Shiyu Chang , Jing Jiang

Machine Reading Comprehension (MRC) for question answering (QA), which aims to answer a question given the relevant context passages, is an important way to test the ability of intelligence systems to understand human language.…

Computation and Language · Computer Science 2019-11-20 Di Jin , Shuyang Gao , Jiun-Yu Kao , Tagyoung Chung , Dilek Hakkani-tur

Multimedia or spoken content presents more attractive information than plain text content, but it's more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much more…

Computation and Language · Computer Science 2016-08-24 Bo-Hsiang Tseng , Sheng-Syun Shen , Hung-Yi Lee , Lin-Shan Lee

Reading a document and extracting an answer to a question about its content has attracted substantial attention recently. While most work has focused on the interaction between the question and the document, in this work we evaluate the…

Computation and Language · Computer Science 2018-09-05 Shimi Salant , Jonathan Berant

This paper focuses on how to take advantage of external relational knowledge to improve machine reading comprehension (MRC) with multi-task learning. Most of the traditional methods in MRC assume that the knowledge used to get the correct…

Computation and Language · Computer Science 2019-09-06 Jiangnan Xia , Chen Wu , Ming Yan

Reading Comprehension (RC) is a task of answering a question from a given passage or a set of passages. In the case of multiple passages, the task is to find the best possible answer to the question. Recent trials and experiments in the…

Computation and Language · Computer Science 2022-01-06 Avi Chawla

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging,…

Computation and Language · Computer Science 2018-05-11 Yizhong Wang , Kai Liu , Jing Liu , Wei He , Yajuan Lyu , Hua Wu , Sujian Li , Haifeng Wang

Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Daya Guo , Duyu Tang , Nan Duan , Zhao Yan , Xiaocheng Feng , Bing Qin

To precisely evaluate a language model's capability for logical reading comprehension, we present a dataset for testing the understanding of the rationale behind critical reasoning. For questions taken from an existing multiplechoice…

Computation and Language · Computer Science 2023-12-01 Akira Kawabata , Saku Sugawara

Machine reading comprehension is a challenging task and hot topic in natural language processing. Its goal is to develop systems to answer the questions regarding a given context. In this paper, we present a comprehensive survey on…

Computation and Language · Computer Science 2020-10-22 Razieh Baradaran , Razieh Ghiasi , Hossein Amirkhani
‹ Prev 1 2 3 10 Next ›