English
Related papers

Related papers: Analyzing the Effectiveness of the Underlying Reas…

200 papers

Multi-hop QA requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. The recently proposed HotpotQA (Yang et al., 2018) dataset is comprised of questions embodying four different multi-hop…

Computation and Language · Computer Science 2019-11-01 Yichen Jiang , Mohit Bansal

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases,…

Artificial Intelligence · Computer Science 2024-06-13 Jesmin Jahan Tithi , Fabio Checconi , Fabrizio Petrini

Question answering (QA) over tables and text has gained much popularity over the years. Multi-hop table-text QA requires multiple hops between the table and text, making it a challenging QA task. Although several works have attempted to…

Computation and Language · Computer Science 2024-10-02 Jayetri Bardhan , Bushi Xiao , Daisy Zhe Wang

This work deals with the challenge of learning and reasoning over multi-modal multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn multi-source reasoning paths and…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal

Despite readily memorizing world knowledge about entities, pre-trained language models (LMs) struggle to compose together two or more facts to perform multi-hop reasoning in question-answering tasks. In this work, we propose techniques that…

Computation and Language · Computer Science 2023-06-08 Kanishka Misra , Cicero Nogueira dos Santos , Siamak Shakeri

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, \emph{requires} proper multihop reasoning? To…

Computation and Language · Computer Science 2022-05-06 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Despite the rapid progress in multihop question-answering (QA), models still have trouble explaining why an answer is correct, with limited explanation training data available to learn from. To address this, we introduce three explanation…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Peter Clark

Reasoning language models have set state-of-the-art (SOTA) records on many challenging benchmarks, enabled by multi-step reasoning induced using reinforcement learning. However, like previous language models, reasoning models are prone to…

Artificial Intelligence · Computer Science 2025-07-21 Zhiting Mei , Christina Zhang , Tenny Yin , Justin Lidard , Ola Shorinwa , Anirudha Majumdar

Rule-based models are attractive for various tasks because they inherently lead to interpretable and explainable decisions and can easily incorporate prior knowledge. However, such systems are difficult to apply to problems involving…

Computation and Language · Computer Science 2019-06-17 Leon Weber , Pasquale Minervini , Jannes Münchmeyer , Ulf Leser , Tim Rocktäschel

Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achieved the human-comparable performance. Due to the dynamics of…

Computation and Language · Computer Science 2024-02-16 Hengrui Gu , Kaixiong Zhou , Xiaotian Han , Ninghao Liu , Ruobing Wang , Xin Wang

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

Computation and Language · Computer Science 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Language models (LMs) struggle to perform such reasoning consistently. We propose an approach to pinpoint and rectify multi-hop…

Computation and Language · Computer Science 2024-11-11 Mansi Sakarvadia

Multi-hop question answering (QA) involves finding multiple relevant passages and performing step-by-step reasoning to answer complex questions. Previous works on multi-hop QA employ specific methods from different modeling perspectives…

Computation and Language · Computer Science 2025-05-20 Taolin Zhang , Dongyang Li , Qizhou Chen , Chengyu Wang , Xiaofeng He

Medical Question-Answering (QA) encompasses a broad spectrum of tasks, including multiple choice questions (MCQ), open-ended text generation, and complex computational reasoning. Despite this variety, a unified framework for delivering…

Computation and Language · Computer Science 2025-06-23 Xiaotian Zhang , Yuan Wang , Zhaopeng Feng , Ruizhe Chen , Zhijie Zhou , Yan Zhang , Hongxia Xu , Jian Wu , Zuozhu Liu

As Large Language Models are increasingly deployed in high-stakes domains, their ability to detect false assumptions and reason critically is crucial for ensuring reliable outputs. False-premise questions (FPQs) serve as an important…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

Reasoning post-training improves Large Language Models (LLMs) on complex tasks such as mathematics and coding, but its benefits across diverse multimodal tasks remains uncertain. The trend of releasing parallel "Instruct" and "Thinking"…

Computation and Language · Computer Science 2026-05-12 Ruobing Zheng , Tianqi Li , Jianing Li , Qingpei Guo , Yi Yuan , Jingdong Chen

Modern systems for multi-hop question answering (QA) typically break questions into a sequence of reasoning steps, termed chain-of-thought (CoT), before arriving at a final answer. Often, multiple chains are sampled and aggregated through a…

Computation and Language · Computer Science 2024-08-05 Ori Yoran , Tomer Wolfson , Ben Bogin , Uri Katz , Daniel Deutch , Jonathan Berant

Multi-hop question answering (QA) requires reasoning over multiple documents to answer a complex question and provide interpretable supporting evidence. However, providing supporting evidence is not enough to demonstrate that a model has…

Computation and Language · Computer Science 2022-09-16 Zhenyun Deng , Yonghua Zhu , Yang Chen , Qianqian Qi , Michael Witbrock , Patricia Riddle

Recent work has showcased the powerful capability of large language models (LLMs) in recalling knowledge and reasoning. However, the reliability of LLMs in combining these two capabilities into reasoning through multi-hop facts has not been…

Computation and Language · Computer Science 2024-06-04 Tianjie Ju , Yijin Chen , Xinwei Yuan , Zhuosheng Zhang , Wei Du , Yubin Zheng , Gongshen Liu