English
Related papers

Related papers: To Test Machine Comprehension, Start by Defining C…

200 papers

Definition Modeling, the task of generating definitions, was first proposed as a means to evaluate the semantic quality of word embeddings-a coherent lexical semantic representations of a word in context should contain all the information…

Computation and Language · Computer Science 2023-06-16 Vincent Segonne , Timothee Mickus

Machine translation quality has steadily improved over the years, achieving near-perfect translations in recent benchmarks. These high-quality outputs make it difficult to distinguish between state-of-the-art models and to identify areas…

Computation and Language · Computer Science 2025-08-29 Lorenzo Proietti , Stefano Perrella , Vilém Zouhar , Roberto Navigli , Tom Kocmi

Despite the great potential of large language models(LLMs) in machine comprehension, it is still disturbing to fully count on them in real-world scenarios. This is probably because there is no rational explanation for whether the…

Computation and Language · Computer Science 2025-09-08 Yongjie Xiao , Hongru Liang , Peixin Qin , Yao Zhang , Wenqiang Lei

Being able to explore an environment and understand the location and type of all objects therein is important for indoor robotic platforms that must interact closely with humans. However, it is difficult to evaluate progress in this area…

Robotics · Computer Science 2020-09-14 David Hall , Ben Talbot , Suman Raj Bista , Haoyang Zhang , Rohan Smith , Feras Dayoub , Niko Sünderhauf

Referring Expression Comprehension (REC) is a popular multimodal task that aims to accurately detect target objects within a single image based on a given textual expression. However, due to the limitations of earlier models, traditional…

Machine Learning · Computer Science 2025-08-21 Guanghao Jin , Jingpei Wu , Tianpei Guo , Yiyi Niu , Weidong Zhou , Guoyang Liu

Remarkable success has been achieved in the last few years on some limited machine reading comprehension (MRC) tasks. However, it is still difficult to interpret the predictions of existing MRC models. In this paper, we focus on extracting…

Computation and Language · Computer Science 2019-09-25 Hai Wang , Dian Yu , Kai Sun , Jianshu Chen , Dong Yu , David McAllester , Dan Roth

A critical part of reading is being able to understand the temporal relationships between events described in a passage of text, even when those relationships are not explicitly stated. However, current machine reading comprehension…

Computation and Language · Computer Science 2020-10-07 Qiang Ning , Hao Wu , Rujun Han , Nanyun Peng , Matt Gardner , Dan Roth

Multi-choice Machine Reading Comprehension (MRC) as a challenge requires models to select the most appropriate answer from a set of candidates with a given passage and question. Most of the existing researches focus on the modeling of…

Computation and Language · Computer Science 2022-03-29 Yilin Zhao , Zhuosheng Zhang , Hai Zhao

Machine learning is usually defined in behaviourist terms, where external validation is the primary mechanism of learning. In this paper, I argue for a more holistic interpretation in which finding more probable, efficient and abstract…

Artificial Intelligence · Computer Science 2017-11-07 Johan Loeckx

We introduce an evaluation methodology for reading comprehension tasks based on the intuition that certain examples, by the virtue of their linguistic complexity, consistently yield lower scores regardless of model size or architecture. We…

Computation and Language · Computer Science 2025-01-30 Elie Antoine , Frédéric Béchet , Géraldine Damnati , Philippe Langlais

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

Text simplification refers to the process of increasing the comprehensibility of texts. Automatic text simplification models are most commonly evaluated by experts or crowdworkers instead of the primary target groups of simplified texts,…

Computation and Language · Computer Science 2024-02-21 Andreas Säuberli , Franz Holzknecht , Patrick Haller , Silvana Deilen , Laura Schiffl , Silvia Hansen-Schirra , Sarah Ebling

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, the existing reading comprehension datasets are mostly in English. In this paper, we introduce a Span-Extraction…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Ting Liu , Wanxiang Che , Li Xiao , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

We introduce a large dataset of narrative texts and questions about these texts, intended to be used in a machine comprehension task that requires reasoning using commonsense knowledge. Our dataset complements similar datasets in that we…

Computation and Language · Computer Science 2018-03-15 Simon Ostermann , Ashutosh Modi , Michael Roth , Stefan Thater , Manfred Pinkal

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this…

Computation and Language · Computer Science 2019-10-16 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou , Zhiyuan Liu

Machine reading comprehension tasks require a machine reader to answer questions relevant to the given document. In this paper, we present the first free-form multiple-Choice Chinese machine reading Comprehension dataset (C^3), containing…

Computation and Language · Computer Science 2019-12-18 Kai Sun , Dian Yu , Dong Yu , Claire Cardie

Open-text (or open-domain) semantic parsers are designed to interpret any statement in natural language by inferring a corresponding meaning representation (MR). Unfortunately, large scale systems cannot be easily machine-learned due to…

Artificial Intelligence · Computer Science 2011-07-20 Antoine Bordes , Xavier Glorot , Jason Weston , Yoshua Bengio

How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text. However, these…

Computation and Language · Computer Science 2021-09-15 Naoya Inoue , Harsh Trivedi , Steven Sinha , Niranjan Balasubramanian , Kentaro Inui

Machine reading comprehension (MRC) is a challenging natural language processing (NLP) task. Recently, the emergence of pre-trained models (PTM) has brought this research field into a new era, in which the training objective plays a key…

Computation and Language · Computer Science 2021-11-01 Changchang. Zeng , Shaobo. Li

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel