English
Related papers

Related papers: TORQUE: A Reading Comprehension Dataset of Tempora…

200 papers

Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the contexts provide all the information required to answer them,…

Computation and Language · Computer Science 2020-11-17 James Ferguson , Matt Gardner , Hannaneh Hajishirzi , Tushar Khot , Pradeep Dasigi

Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Daya Guo , Duyu Tang , Nan Duan , Zhao Yan , Xiaocheng Feng , Bing Qin

Accurately understanding temporal relations between events is a critical building block of diverse tasks, such as temporal reading comprehension (TRC) and relation extraction (TRE). For example in TRC, we need to understand the temporal…

Computation and Language · Computer Science 2025-06-18 Jongho Kim , Dohyeon Lee , Minsoo Kim , Seung-won Hwang

While large language models now handle million-token contexts, their capacity for reasoning across entire document repositories remains largely untested. Existing benchmarks are inadequate, as they are mostly limited to single long texts or…

Computation and Language · Computer Science 2026-04-28 Zhiyuan Lu , Chenliang Li , Yingcheng Shi , Weizhou Shen , Ming Yan , Fei Huang

Existing question answering systems can only predict answers without explicit reasoning processes, which hinder their explainability and make us overestimate their ability of understanding and reasoning over natural language. In this work,…

Computation and Language · Computer Science 2020-04-06 Ran Wang , Kun Tao , Dingjie Song , Zhilong Zhang , Xiao Ma , Xi'ao Su , Xinyu Dai

We present RACE, a new dataset for benchmark evaluation of methods in the reading comprehension task. Collected from the English exams for middle and high school Chinese students in the age range between 12 to 18, RACE consists of near…

Computation and Language · Computer Science 2017-12-07 Guokun Lai , Qizhe Xie , Hanxiao Liu , Yiming Yang , Eduard Hovy

We present STARC (Structured Annotations for Reading Comprehension), a new annotation framework for assessing reading comprehension with multiple choice questions. Our framework introduces a principled structure for the answer choices and…

Computation and Language · Computer Science 2020-05-01 Yevgeni Berzak , Jonathan Malmaud , Roger Levy

Understanding events necessitates grasping their temporal context, which is often not explicitly stated in natural language. For example, it is not a trivial task for a machine to infer that a museum tour may last for a few hours, but can…

Computation and Language · Computer Science 2025-08-22 Lekshmi R Nair , Arun Sankar , Koninika Pal

In this paper, we propose a neural architecture and a set of training methods for ordering events by predicting temporal relations. Our proposed models receive a pair of events within a span of text as input and they identify temporal…

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in fact comprehend. In this paper we make…

Computation and Language · Computer Science 2020-05-12 Jesse Dunietz , Gregory Burnham , Akash Bharadwaj , Owen Rambow , Jennifer Chu-Carroll , David Ferrucci

This paper focuses on how to take advantage of external relational knowledge to improve machine reading comprehension (MRC) with multi-task learning. Most of the traditional methods in MRC assume that the knowledge used to get the correct…

Computation and Language · Computer Science 2019-09-06 Jiangnan Xia , Chen Wu , Ming Yan

Reasoning about time is of fundamental importance. Many facts are time-dependent. For example, athletes change teams from time to time, and different government officials are elected periodically. Previous time-dependent question answering…

Computation and Language · Computer Science 2023-06-28 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Machine Comprehension (MC) is a challenging task in Natural Language Processing field, which aims to guide the machine to comprehend a passage and answer the given question. Many existing approaches on MC task are suffering the inefficiency…

Computation and Language · Computer Science 2017-10-10 Zheqian Chen , Rongqin Yang , Bin Cao , Zhou Zhao , Deng Cai , Xiaofei He

This study aims at solving the Machine Reading Comprehension problem where questions have to be answered given a context passage. The challenge is to develop a computationally faster model which will have improved inference time. State of…

Computation and Language · Computer Science 2019-04-02 Debajyoti Chatterjee

Temporal common sense (e.g., duration and frequency of events) is crucial for understanding natural language. However, its acquisition is challenging, partly because such information is often not expressed explicitly in text, and human…

Computation and Language · Computer Science 2020-05-12 Ben Zhou , Qiang Ning , Daniel Khashabi , Dan Roth

We present NewsQA, a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of…

Computation and Language · Computer Science 2017-02-08 Adam Trischler , Tong Wang , Xingdi Yuan , Justin Harris , Alessandro Sordoni , Philip Bachman , Kaheer Suleman

Event forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or event-based knowledge graphs, to help…

Machine Learning · Computer Science 2021-06-09 Woojeong Jin , Rahul Khanna , Suji Kim , Dong-Ho Lee , Fred Morstatter , Aram Galstyan , Xiang Ren

Recently, reading comprehension models achieved near-human performance on large-scale datasets such as SQuAD, CoQA, MS Macro, RACE, etc. This is largely due to the release of pre-trained contextualized representations such as BERT and ELMo,…

Computation and Language · Computer Science 2019-09-09 Momchil Hardalov , Ivan Koychev , Preslav Nakov

We introduce ChronoQA, a large-scale benchmark dataset for Chinese question answering, specifically designed to evaluate temporal reasoning in Retrieval-Augmented Generation (RAG) systems. ChronoQA is constructed from over 300,000 news…

Computation and Language · Computer Science 2025-08-19 Ziyang Chen , Erxue Min , Xiang Zhao , Yunxin Li , Xin Jia , Jinzhi Liao , Jichao Li , Shuaiqiang Wang , Baotian Hu , Dawei Yin

The digital landscape is rapidly evolving with an ever-increasing volume of online news, emphasizing the need for swift and precise analysis of complex events. We refer to the complex events composed of many news articles over an extended…

Computation and Language · Computer Science 2024-06-05 Zhihan Zhang , Yixin Cao , Chenchen Ye , Yunshan Ma , Lizi Liao , Tat-Seng Chua