English
Related papers

Related papers: Entity Tracking Improves Cloze-style Reading Compr…

200 papers

Entity tracking requires maintaining and updating latent states for entities and attributes over long sequences. Recent task-specific attention operators can compress deep Transformer stacks into a few layers by performing multi-hop state…

Machine Learning · Computer Science 2026-05-22 Hangyue Zhao , Paul Caillon , Erwan Fagnou , Alexandre Allauzen

In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, we collect a new…

Computation and Language · Computer Science 2020-10-16 Jonathan Malmaud , Roger Levy , Yevgeni Berzak

Tracking entities in procedural language requires understanding the transformations arising from actions on entities as well as those entities' interactions. While self-attention-based pre-trained language encoders like GPT and BERT have…

Computation and Language · Computer Science 2019-09-09 Aditya Gupta , Greg Durrett

Entity summarization aims at creating brief but informative descriptions of entities from knowledge graphs. While previous work mostly focused on traditional techniques such as clustering algorithms and graph models, we ask how to apply…

Computation and Language · Computer Science 2020-05-27 Dongjun Wei , Yaxin Liu , Fuqing Zhu , Liangjun Zang , Wei Zhou , Jizhong Han , Songlin Hu

We show how eye-tracking corpora can be used to improve sentence compression models, presenting a novel multi-task learning algorithm based on multi-layer LSTMs. We obtain performance competitive with or better than state-of-the-art…

Computation and Language · Computer Science 2016-04-13 Sigrid Klerke , Yoav Goldberg , Anders Søgaard

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette

Cloze-style reading comprehension has been a popular task for measuring the progress of natural language understanding in recent years. In this paper, we design a novel multi-perspective framework, which can be seen as the joint training of…

Computation and Language · Computer Science 2018-08-21 Liang Wang , Sujian Li , Wei Zhao , Kewei Shen , Meng Sun , Ruoyu Jia , Jingming Liu

In the last years, the consolidation of deep neural network architectures for information extraction in document images has brought big improvements in the performance of each of the tasks involved in this process, consisting of text…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Manuel Carbonell , Alicia Fornés , Mauricio Villegas , Josep Lladós

Progress in text understanding has been driven by large datasets that test particular capabilities, like recent datasets for reading comprehension (Hermann et al., 2015). We focus here on the LAMBADA dataset (Paperno et al., 2016), a word…

Computation and Language · Computer Science 2017-02-20 Zewei Chu , Hai Wang , Kevin Gimpel , David McAllester

Recent years have witnessed an increasing interest in training machines with reasoning ability, which deeply relies on accurately and clearly presented clue forms. The clues are usually modeled as entity-aware knowledge in existing studies.…

Computation and Language · Computer Science 2023-05-29 Siru Ouyang , Zhuosheng Zhang , Hai Zhao

We propose a novel neural attention architecture to tackle machine comprehension tasks, such as answering Cloze-style queries with respect to a document. Unlike previous models, we do not collapse the query into a single vector, instead we…

Computation and Language · Computer Science 2016-11-10 Alessandro Sordoni , Philip Bachman , Adam Trischler , Yoshua Bengio

Multiple people tracking is a key problem for many applications such as surveillance, animation or car navigation, and a key input for tasks such as activity recognition. In crowded environments occlusions and false detections are common,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Laura Leal-Taixé

Reading comprehension is a challenging task in natural language processing and requires a set of skills to be solved. While current approaches focus on solving the task as a whole, in this paper, we propose to use a neural network `skill'…

Computation and Language · Computer Science 2017-11-13 Todor Mihaylov , Zornitsa Kozareva , Anette Frank

Entity extraction is a key technology for obtaining information from massive texts in natural language processing. The further interaction between them does not meet the standards of human reading comprehension, thus limiting the…

Computation and Language · Computer Science 2021-08-23 Xiaobo Jiang , Kun He , Jiajun He , Guangyu Yan

Previous research shows that eye-tracking data contains information about the lexical and syntactic properties of text, which can be used to improve natural language processing models. In this work, we leverage eye movement features from…

Computation and Language · Computer Science 2019-03-29 Nora Hollenstein , Ce Zhang

This paper revisits visual saliency prediction by evaluating the recent advancements in this field such as crowd-sourced mouse tracking-based databases and contextual annotations. We pursue a critical and quantitative approach towards some…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Hamed R. Tavakoli , Fawad Ahmed , Ali Borji , Jorma Laaksonen

Fine-grained entity typing is the task of assigning fine-grained semantic types to entity mentions. We propose a neural architecture which learns a distributional semantic representation that leverages a greater amount of semantic context…

Computation and Language · Computer Science 2018-04-24 Sheng Zhang , Kevin Duh , Benjamin Van Durme

This paper introduces a novel neural network model for question answering, the \emph{entity-based memory network}. It enhances neural networks' ability of representing and calculating information over a long period by keeping records of…

Computation and Language · Computer Science 2024-02-23 Xun Wang , Katsuhito Sudoh , Masaaki Nagata , Tomohide Shibata , Daisuke Kawahara , Sadao Kurohashi

Entity Linking has two main open areas of research: 1) generate candidate entities without using alias tables and 2) generate more contextual representations for both mentions and entities. Recently, a solution has been proposed for the…

Computation and Language · Computer Science 2020-04-08 Oshin Agarwal , Daniel M. Bikel

Several large cloze-style context-question-answer datasets have been introduced recently: the CNN and Daily Mail news data and the Children's Book Test. Thanks to the size of these datasets, the associated text comprehension task is well…

Computation and Language · Computer Science 2016-06-27 Rudolf Kadlec , Martin Schmid , Ondrej Bajgar , Jan Kleindienst