English
Related papers

Related papers: Memory Augmented Sequential Paragraph Retrieval fo…

200 papers

Several multi-hop reading comprehension datasets have been proposed to resolve the issue of reasoning shortcuts by which questions can be answered without performing multi-hop reasoning. However, the ability of multi-hop models to perform…

Computation and Language · Computer Science 2022-10-12 Xanh Ho , Saku Sugawara , Akiko Aizawa

Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential…

Computation and Language · Computer Science 2026-04-28 Yuqing Fu , Yimin Deng , Wanyu Wang , Yuhao Wang , Yejing Wang , Hongshi Liu , Yiqi Wang , Xiao Han , Maolin Wang , Guoshuai Zhao , Yi Chang , Xiangyu Zhao

In this study, we introduced a new benchmark consisting of a curated dataset and a defined evaluation process to assess the compositional reasoning capabilities of large language models within the chemistry domain. We designed and validated…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Nicholas Sherck , Hamidreza Mahyar , Soheila Samiee

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

Computation and Language · Computer Science 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

The conventional paradigm in neural question answering (QA) for narrative content is limited to a two-stage process: first, relevant text passages are retrieved and, subsequently, a neural network for machine comprehension extracts the…

Computation and Language · Computer Science 2019-08-13 Bernhard Kratzwald , Anna Eigenmann , Stefan Feuerriegel

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi

Multi-hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi-hop rule, which corresponds to a chain of relationships. We extend existing works to consider a generalized form of multi-hop…

Computation and Language · Computer Science 2020-10-06 Lu Zhang , Mo Yu , Tian Gao , Yue Yu

In today's fast-paced industry, professionals face the challenge of summarizing a large number of documents and extracting vital information from them on a daily basis. These metrics are frequently hidden away in tables and/or their nested…

Computation and Language · Computer Science 2024-03-29 Che Guan , Mengyu Huang , Peng Zhang

With the widespread adoption of large language models (LLMs) in numerous applications, the challenge of factuality and the propensity for hallucinations has emerged as a significant concern. To address this issue, particularly in…

Artificial Intelligence · Computer Science 2024-07-03 Yihao Fang , Stephen W. Thomas , Xiaodan Zhu

Multi-hop Knowledge Base Question Answering (KBQA) aims to find the answer entities that are multiple hops away in the Knowledge Base (KB) from the entities in the question. A major challenge is the lack of supervision signals at…

Computation and Language · Computer Science 2021-04-08 Gaole He , Yunshi Lan , Jing Jiang , Wayne Xin Zhao , Ji-Rong Wen

Retrieval-Augmented Generation (RAG) systems are widely adopted in knowledge-intensive NLP tasks, but current evaluations often overlook the structural complexity and multi-step reasoning required in real-world scenarios. These benchmarks…

Computation and Language · Computer Science 2025-12-16 Jeongsoo Lee , Daeyong Kwon , Kyohoon Jin

Effective multi-hop question answering (QA) requires reasoning over multiple scattered paragraphs and providing explanations for answers. Most existing approaches cannot provide an interpretable reasoning process to illustrate how these…

Computation and Language · Computer Science 2022-08-29 Zhenyun Deng , Yonghua Zhu , Yang Chen , Michael Witbrock , Patricia Riddle

Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large…

Computation and Language · Computer Science 2020-02-06 Tushar Khot , Peter Clark , Michal Guerquin , Peter Jansen , Ashish Sabharwal

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches…

Computation and Language · Computer Science 2024-09-27 Ziyuan Zhuang , Zhiyang Zhang , Sitao Cheng , Fangkai Yang , Jia Liu , Shujian Huang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

The Retrieval-Augmented Generation (RAG) approach enhances question-answering systems and dialogue generation tasks by integrating information retrieval (IR) technologies with large language models (LLMs). This strategy, which retrieves…

Computation and Language · Computer Science 2025-09-15 Duolin Sun , Dan Yang , Yue Shen , Yihan Jiao , Zhehao Tan , Jie Feng , Lianzhen Zhong , Jian Wang , Peng Wei , Jinjie Gu

In multimodal multi-hop question answering, we focus on the initial retrieval stage via two distinct tasks: (1) evidence set completion, retrieving missing evidence given context, and (2) sequential pool construction, iteratively building…

Information Retrieval · Computer Science 2026-05-28 Sunah O , Jay-Yoon Lee

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

We consider open-domain queston answering (QA) where answers are drawn from either a corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in which a corpus is supplemented with a large but incomplete KB,…

Computation and Language · Computer Science 2019-04-23 Haitian Sun , Tania Bedrax-Weiss , William W. Cohen