English
Related papers

Related papers: Analyzing the Effectiveness of the Underlying Reas…

200 papers

Learning multi-hop reasoning has been a key challenge for reading comprehension models, leading to the design of datasets that explicitly focus on it. Ideally, a model should not be able to perform well on a multi-hop question answering…

Computation and Language · Computer Science 2019-04-30 Jifan Chen , Greg Durrett

This paper proposes a group deliberation oriented multi-agent conversational model to address the limitations of single large language models in complex reasoning tasks. The model adopts a three-level role division architecture consisting…

Artificial Intelligence · Computer Science 2026-01-01 Zheyu Shi , Dong Qiu , Shanlong Yu

Asking questions from natural language text has attracted increasing attention recently, and several schemes have been proposed with promising results by asking the right question words and copy relevant words from the input to the…

Computation and Language · Computer Science 2020-09-17 Xiyao Ma , Qile Zhu , Yanlin Zhou , Xiaolin Li , Dapeng Wu

Multi-hop Question Answering (MHQA) adds layers of complexity to question answering, making it more challenging. When Language Models (LMs) are prompted with multiple search results, they are tasked not only with retrieving relevant…

Computation and Language · Computer Science 2025-05-20 Wenyu Huang , Pavlos Vougiouklis , Mirella Lapata , Jeff Z. Pan

Our goal is to combine the rich multistep inference of symbolic logical reasoning with the generalization capabilities of neural networks. We are particularly interested in complex reasoning about entities and relations in text and…

Computation and Language · Computer Science 2017-05-02 Rajarshi Das , Arvind Neelakantan , David Belanger , Andrew McCallum

Multi-hop question answering is a challenging task for both large language models (LLMs) and humans, as it requires recognizing when multi-hop reasoning is needed, followed by reading comprehension, logical reasoning, and knowledge…

Human-Computer Interaction · Computer Science 2025-10-07 Jinyan Su , Claire Cardie , Jennifer Healey

Multihop Question Answering (QA) requires systems to identify and synthesize information from multiple text passages. While most prior retrieval methods assist in identifying relevant passages for QA, further assessing the utility of the…

Computation and Language · Computer Science 2025-12-09 Akriti Jain , Aparna Garimella

The emergence of reasoning models and their integration into practical AI chat bots has led to breakthroughs in solving advanced math, deep search, and extractive question answering problems that requires a complex and multi-step thought…

Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its…

Artificial Intelligence · Computer Science 2018-09-13 Xi Victoria Lin , Richard Socher , Caiming Xiong

Multi-Hop Question Answering (MHQA) tasks permeate real-world applications, posing challenges in orchestrating multi-step reasoning across diverse knowledge domains. While existing approaches have been improved with iterative retrieval,…

Machine Learning · Computer Science 2025-10-06 Rong Cheng , Jinyi Liu , Yan Zheng , Fei Ni , Jiazhen Du , Hangyu Mao , Fuzheng Zhang , Bo Wang , Jianye Hao

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

Computation and Language · Computer Science 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Multi-hop question answering (QA) requires an information retrieval (IR) system that can find \emph{multiple} supporting evidence needed to answer the question, making the retrieval process very challenging. This paper introduces an IR…

Computation and Language · Computer Science 2019-09-18 Ameya Godbole , Dilip Kavarthapu , Rajarshi Das , Zhiyu Gong , Abhishek Singhal , Hamed Zamani , Mo Yu , Tian Gao , Xiaoxiao Guo , Manzil Zaheer , Andrew McCallum

Recent advancements in Large Language Models (LLMs) are increasingly focused on "reasoning" ability, a concept with many overlapping definitions in the LLM discourse. We take a more structured approach, distinguishing meta-level reasoning…

Computation and Language · Computer Science 2026-01-13 Nick Ferguson , Alan Bundy , Kwabena Nuamah

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

We study the utility of incorporating entity type abstractions into pre-trained Transformers and test these methods on four NLP tasks requiring different forms of logical reasoning: (1) compositional language understanding with text-based…

Computation and Language · Computer Science 2022-11-22 Nicolas Gontier , Siva Reddy , Christopher Pal

Multi-hop question answering is widely used to evaluate the reasoning capabilities of large language models (LLMs), as it requires integrating multiple pieces of supporting knowledge to arrive at a correct answer. While prior work has…

Computation and Language · Computer Science 2026-01-13 Zhuoyi Yang , Yurun Song , Iftekhar Ahmed , Ian Harris

Most existing multi-hop datasets are extractive answer datasets, where the answers to the questions can be extracted directly from the provided context. This often leads models to use heuristics or shortcuts instead of performing true…

Computation and Language · Computer Science 2024-06-21 Julian Schnitzler , Xanh Ho , Jiahao Huang , Florian Boudin , Saku Sugawara , Akiko Aizawa

Multi-hop Question Answering over Knowledge Graph~(KGQA) aims to find the answer entities that are multiple hops away from the topic entities mentioned in a natural language question on a large-scale Knowledge Graph (KG). To cope with the…

Computation and Language · Computer Science 2023-03-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Ji-Rong Wen

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in…

Computation and Language · Computer Science 2022-11-15 Deepak Gupta

Retriever-augmented instruction-following models are attractive alternatives to fine-tuned approaches for information-seeking tasks such as question answering (QA). By simply prepending retrieved documents in its input along with an…

Computation and Language · Computer Science 2024-04-18 Vaibhav Adlakha , Parishad BehnamGhader , Xing Han Lu , Nicholas Meade , Siva Reddy