English
Related papers

Related papers: How Well Do Multi-hop Reading Comprehension Models…

200 papers

Multi-Hop Question Answering (MHQA) is a significant area in question answering, requiring multiple reasoning components, including document retrieval, supporting sentence prediction, and answer span extraction. In this work, we analyze the…

Computation and Language · Computer Science 2023-12-14 Zhangyue Yin , Yuxin Wang , Xiannian Hu , Yiguang Wu , Hang Yan , Xinyu Zhang , Zhao Cao , Xuanjing Huang , Xipeng Qiu

We carry out a series of experiments to test large language models' multi-hop reasoning ability from three aspects: selecting and combining external knowledge, dealing with non-sequential reasoning tasks and generalising to data samples…

Computation and Language · Computer Science 2024-12-12 Haotong Zhang

Obtaining training data for multi-hop question answering (QA) is time-consuming and resource-intensive. We explore the possibility to train a well-performed multi-hop QA model without referencing any human-labeled multi-hop question-answer…

Computation and Language · Computer Science 2021-04-13 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large…

Computation and Language · Computer Science 2020-02-06 Tushar Khot , Peter Clark , Michal Guerquin , Peter Jansen , Ashish Sabharwal

We propose a new CogQA framework for multi-hop question answering in web-scale documents. Inspired by the dual process theory in cognitive science, the framework gradually builds a \textit{cognitive graph} in an iterative process by…

Computation and Language · Computer Science 2019-06-05 Ming Ding , Chang Zhou , Qibin Chen , Hongxia Yang , Jie Tang

Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its…

Artificial Intelligence · Computer Science 2018-09-13 Xi Victoria Lin , Richard Socher , Caiming Xiong

Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering. To elicit reasoning capabilities from LLMs, recent works propose using the chain-of-thought (CoT) mechanism to generate…

Computation and Language · Computer Science 2023-11-08 Ruosen Li , Xinya Du

Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achieved the human-comparable performance. Due to the dynamics of…

Computation and Language · Computer Science 2024-02-16 Hengrui Gu , Kaixiong Zhou , Xiaotian Han , Ninghao Liu , Ruobing Wang , Xin Wang

This work deals with the challenge of learning and reasoning over multi-modal multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn multi-source reasoning paths and…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal

Effective multi-hop question answering (QA) requires reasoning over multiple scattered paragraphs and providing explanations for answers. Most existing approaches cannot provide an interpretable reasoning process to illustrate how these…

Computation and Language · Computer Science 2022-08-29 Zhenyun Deng , Yonghua Zhu , Yang Chen , Michael Witbrock , Patricia Riddle

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler

Multi-hop Question Answering (MHQA) adds layers of complexity to question answering, making it more challenging. When Language Models (LMs) are prompted with multiple search results, they are tasked not only with retrieving relevant…

Computation and Language · Computer Science 2025-05-20 Wenyu Huang , Pavlos Vougiouklis , Mirella Lapata , Jeff Z. Pan

Multi-Hop Question Answering (MHQA) is crucial for evaluating the model's capability to integrate information from diverse sources. However, creating extensive and high-quality MHQA datasets is challenging: (i) manual annotation is…

Computation and Language · Computer Science 2026-04-21 Zhiyu Shen , Jiyuan Liu , Yunhe Pang , Yanghui Rao , Fu Lee Wang , Jianxing Yu

Multi-hop question answering (QA) requires systems to iteratively retrieve evidence and reason across multiple hops. While recent RAG and agentic methods report strong results, the underlying retrieval--reasoning \emph{process} is often…

Computation and Language · Computer Science 2026-01-05 Yuelyu Ji , Zhuochun Li , Rui Meng , Daqing He

State-of-the-art approaches to reasoning and question answering over knowledge graphs (KGs) usually scale with the number of edges and can only be applied effectively on small instance-dependent subgraphs. In this paper, we address this…

Machine Learning · Computer Science 2021-10-28 Mattia Atzeni , Jasmina Bogojeska , Andreas Loukas

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

Computation and Language · Computer Science 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

Computation and Language · Computer Science 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

Retrieving information from correlative paragraphs or documents to answer open-domain multi-hop questions is very challenging. To deal with this challenge, most of the existing works consider paragraphs as nodes in a graph and propose…

Computation and Language · Computer Science 2021-02-09 Nan Shao , Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Existing question answering datasets focus on dealing with homogeneous information, based either only on text or KB/Table information alone. However, as human knowledge is distributed over heterogeneous forms, using homogeneous information…

Computation and Language · Computer Science 2021-05-13 Wenhu Chen , Hanwen Zha , Zhiyu Chen , Wenhan Xiong , Hong Wang , William Wang

Multi-hop QA (MHQA) involves step-by-step reasoning to answer complex questions and find multiple relevant supporting facts. However, Existing large language models'(LLMs) reasoning ability in multi-hop question answering remains…

Computation and Language · Computer Science 2024-02-20 Jian Wu , Linyi Yang , Yuliang Ji , Wenhao Huang , Börje F. Karlsson , Manabu Okumura