English
Related papers

Related papers: Looking Under the Hood : Tools for Diagnosing your…

200 papers

This paper considers the reading comprehension task in which multiple documents are given as input. Prior work has shown that a pipeline of retriever, reader, and reranker can improve the overall performance. However, the pipeline system is…

Computation and Language · Computer Science 2019-06-12 Minghao Hu , Yuxing Peng , Zhen Huang , Dongsheng Li

To precisely evaluate a language model's capability for logical reading comprehension, we present a dataset for testing the understanding of the rationale behind critical reasoning. For questions taken from an existing multiplechoice…

Computation and Language · Computer Science 2023-12-01 Akira Kawabata , Saku Sugawara

Machine reading comprehension with unanswerable questions aims to abstain from answering when no answer can be inferred. In addition to extract answers, previous works usually predict an additional "no-answer" probability to detect…

Computation and Language · Computer Science 2018-11-16 Minghao Hu , Furu Wei , Yuxing Peng , Zhen Huang , Nan Yang , Dongsheng Li

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

Computation and Language · Computer Science 2007-05-23 Radu Florian , Grace Ngai

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

Most information in our world is organized hierarchically; however, many Deep Learning approaches do not leverage this semantically rich structure. Research suggests that human learning benefits from exploiting the hierarchical structure of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Alexandru Manole , Laura Diosan

Reading comprehension is a challenging task in natural language processing and requires a set of skills to be solved. While current approaches focus on solving the task as a whole, in this paper, we propose to use a neural network `skill'…

Computation and Language · Computer Science 2017-11-13 Todor Mihaylov , Zornitsa Kozareva , Anette Frank

The dependency between an adequate question formulation and correct answer selection is a very intriguing but still underexplored area. In this paper, we show that question rewriting (QR) of the conversational context allows to shed more…

Computation and Language · Computer Science 2022-02-04 Svitlana Vakulenko , Shayne Longpre , Zhucheng Tu , Raviteja Anantha

We investigate a framework for machine reading, inspired by real world information-seeking problems, where a meta question answering system interacts with a black box environment. The environment encapsulates a competitive machine reader…

Despite interest in using cross-lingual knowledge to learn word embeddings for various tasks, a systematic comparison of the possible approaches is lacking in the literature. We perform an extensive evaluation of four popular approaches of…

Computation and Language · Computer Science 2016-06-09 Shyam Upadhyay , Manaal Faruqui , Chris Dyer , Dan Roth

Motivated by the rapid ascent of Large Language Models (LLMs) and debates about the extent to which they possess human-level qualities, we propose a framework for testing whether any agent (be it a machine or a human) understands a subject…

Artificial Intelligence · Computer Science 2024-06-21 Kevin Leyton-Brown , Yoav Shoham

Multi-hop question answering (QA) requires systems to iteratively retrieve evidence and reason across multiple hops. While recent RAG and agentic methods report strong results, the underlying retrieval--reasoning \emph{process} is often…

Computation and Language · Computer Science 2026-01-05 Yuelyu Ji , Zhuochun Li , Rui Meng , Daqing He

Technical support problems are often long and complex. They typically contain user descriptions of the problem, the setup, and steps for attempted resolution. Often they also contain various non-natural language text elements like outputs…

Computation and Language · Computer Science 2020-05-25 Kushal Chauhan , Abhirut Gupta

Multiple-choice machine reading comprehension is difficult task as its required machines to select the correct option from a set of candidate or possible options using the given passage and question.Reading Comprehension with Multiple…

Computation and Language · Computer Science 2020-03-19 Vaishali Ingale , Pushpender Singh

Few-Shot Event Classification (FSEC) aims at developing a model for event prediction, which can generalize to new event types with a limited number of annotated data. Existing FSEC studies have achieved high accuracy on different…

Computation and Language · Computer Science 2021-08-31 Peiyi Wang , Runxin Xu , Tianyu Liu , Damai Dai , Baobao Chang , Zhifang Sui

Machine Comprehension (MC) is a challenging task in Natural Language Processing field, which aims to guide the machine to comprehend a passage and answer the given question. Many existing approaches on MC task are suffering the inefficiency…

Computation and Language · Computer Science 2017-10-10 Zheqian Chen , Rongqin Yang , Bin Cao , Zhou Zhao , Deng Cai , Xiaofei He

Models pre-trained with a language modeling objective possess ample world knowledge and language skills, but are known to struggle in tasks that require reasoning. In this work, we propose to leverage semi-structured tables, and…

Computation and Language · Computer Science 2021-07-16 Ori Yoran , Alon Talmor , Jonathan Berant

Entity Recognition (ER) within a text is a fundamental exercise in Natural Language Processing, enabling further depending tasks such as Knowledge Extraction, Text Summarisation, or Keyphrase Extraction. An entity consists of single words…

Computation and Language · Computer Science 2021-06-14 Andreas Waldis , Luca Mazzola

This paper analyzes challenges in cloze-style reading comprehension on multiparty dialogue and suggests two new tasks for more comprehensive predictions of personal entities in daily conversations. We first demonstrate that there are…

Computation and Language · Computer Science 2021-07-14 Changmao Li , Tianhao Liu , Jinho D. Choi

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten