English
Related papers

Related papers: Understanding Dataset Design Choices for Multi-hop…

200 papers

Recent progress in retrieval-augmented generation (RAG) has led to more accurate and interpretable multi-hop question answering (QA). Yet, challenges persist in integrating iterative reasoning steps with external knowledge retrieval. To…

Computation and Language · Computer Science 2025-10-06 Tengjun Ni , Xin Yuan , Shenghong Li , Kai Wu , Ren Ping Liu , Wei Ni , Wenjie Zhang

Recent advances in reading comprehension have resulted in models that surpass human performance when the answer is contained in a single, continuous passage of text. However, complex Question Answering (QA) typically requires multi-hop…

Artificial Intelligence · Computer Science 2019-10-02 Mokanarangan Thayaparan , Marco Valentino , Viktor Schlegel , Andre Freitas

Time is an important dimension in our physical world. Lots of facts can evolve with respect to time. For example, the U.S. President might change every four years. Therefore, it is important to consider the time dimension and empower the…

Computation and Language · Computer Science 2021-10-26 Wenhu Chen , Xinyi Wang , William Yang Wang

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

Computation and Language · Computer Science 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

Existing datasets for tabular question answering typically focus exclusively on text within cells. However, real-world data is inherently multimodal, often blending images such as symbols, faces, icons, patterns, and charts with textual…

Multi-hop Question Generation is the task of generating questions which require the reader to reason over and combine information spread across multiple passages using several reasoning steps. Chain-of-thought rationale generation has been…

Computation and Language · Computer Science 2022-11-17 Saurabh Kulshreshtha , Anna Rumshisky

In order to simulate human language capacity, natural language processing systems must be able to reason about the dynamics of everyday situations, including their possible causes and effects. Moreover, they should be able to generalise the…

Computation and Language · Computer Science 2020-10-28 Edoardo Maria Ponti , Goran Glavaš , Olga Majewska , Qianchu Liu , Ivan Vulić , Anna Korhonen

Recently, attempting to model texts as graph structure and introducing graph neural networks to deal with it has become a trend in many NLP research areas. In this paper, we investigate whether the graph structure is necessary for multi-hop…

Computation and Language · Computer Science 2020-12-14 Nan Shao , Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Question Answering for complex questions is often modeled as a graph construction or traversal task, where a solver must build or traverse a graph of facts that answer and explain a given question. This "multi-hop" inference has been shown…

Computation and Language · Computer Science 2018-05-30 Peter Jansen

Multi-hop question answering (MHQA) requires a model to retrieve and integrate information from multiple passages to answer a complex question. Recent systems leverage the power of large language models and integrate evidence retrieval with…

Computation and Language · Computer Science 2024-07-08 Zhenyu Bi , Daniel Hajialigol , Zhongkai Sun , Jie Hao , Xuan Wang

Prior work has found that transformers have an inconsistent ability to learn to answer latent two-hop questions -- questions of the form "Who is Bob's mother's boss?" We study why this is the case by examining how transformers' capacity to…

Artificial Intelligence · Computer Science 2025-03-24 David Johnston , Nora Belrose

Multi-hop Knowledge Base Question Answering(KBQA) aims to find the answer entity in a knowledge graph (KG), which requires multiple steps of reasoning. Existing retrieval-based approaches solve this task by concentrating on the specific…

Computation and Language · Computer Science 2023-12-20 Haowei Du , Quzhe Huang , Chen Li , Chen Zhang , Yang Li , Dongyan Zhao

Multi-hop question answering (QA) involves finding multiple relevant passages and performing step-by-step reasoning to answer complex questions. Previous works on multi-hop QA employ specific methods from different modeling perspectives…

Computation and Language · Computer Science 2025-05-20 Taolin Zhang , Dongyang Li , Qizhou Chen , Chengyu Wang , Xiaofeng He

While diverse question answering (QA) datasets have been proposed and contributed significantly to the development of deep learning models for QA tasks, the existing datasets fall short in two aspects. First, we lack QA datasets covering…

Computation and Language · Computer Science 2021-10-15 Qiyuan Zhang , Lei Wang , Sicheng Yu , Shuohang Wang , Yang Wang , Jing Jiang , Ee-Peng Lim

In the question answering(QA) task, multi-hop reasoning framework has been extensively studied in recent years to perform more efficient and interpretable answer reasoning on the Knowledge Graph(KG). However, multi-hop reasoning is…

Artificial Intelligence · Computer Science 2022-03-15 Yao Zhang , Peiyao Li , Hongru Liang , Adam Jatowt , Zhenglu Yang

Numerical reasoning over hybrid data containing both textual and tabular content (e.g., financial reports) has recently attracted much attention in the NLP community. However, existing question answering (QA) benchmarks over hybrid data…

Artificial Intelligence · Computer Science 2022-06-06 Yilun Zhao , Yunxiang Li , Chenying Li , Rui Zhang

Large language models (LLMs) have shown an impressive ability to perform tasks believed to require thought processes. When the model does not document an explicit thought process, it becomes difficult to understand the processes occurring…

Computation and Language · Computer Science 2024-06-21 Yuval Shalev , Amir Feder , Ariel Goldstein

The prevalence of large-scale multimodal datasets presents unique challenges in assessing dataset quality. We propose a two-step method to analyze multimodal datasets, which leverages a small seed of human annotation to map each multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Netta Madvil , Yonatan Bitton , Roy Schwartz

We present a new multimodal question answering challenge, ManyModalQA, in which an agent must answer a question by considering three distinct modalities: text, images, and tables. We collect our data by scraping Wikipedia and then utilize…

Computation and Language · Computer Science 2020-01-23 Darryl Hannan , Akshay Jain , Mohit Bansal