English
Related papers

Related papers: Robustifying Multi-hop QA through Pseudo-Evidentia…

200 papers

Question Answering (QA) tasks requiring information from multiple documents often rely on a retrieval model to identify relevant information for reasoning. The retrieval model is typically trained to maximize the likelihood of the labeled…

Computation and Language · Computer Science 2021-09-10 Ansong Ni , Matt Gardner , Pradeep Dasigi

Multi-hop question answering (QA) requires reasoning over multiple documents to answer a complex question and provide interpretable supporting evidence. However, providing supporting evidence is not enough to demonstrate that a model has…

Computation and Language · Computer Science 2022-09-16 Zhenyun Deng , Yonghua Zhu , Yang Chen , Qianqian Qi , Michael Witbrock , Patricia Riddle

We propose an unsupervised strategy for the selection of justification sentences for multi-hop question answering (QA) that (a) maximizes the relevance of the selected sentences, (b) minimizes the overlap between the selected facts, and (c)…

Computation and Language · Computer Science 2020-05-05 Vikas Yadav , Steven Bethard , Mihai Surdeanu

Modern language models fail a fundamental requirement of trustworthy intelligence: knowing when not to answer. Despite achieving impressive accuracy on benchmarks, these models produce confident hallucinations, even when wrong answers carry…

Machine Learning · Computer Science 2025-11-25 Mohamad Amin Mohamadi , Tianhao Wang , Zhiyuan Li

Retrieval-augmented large language models, when optimized with outcome-level rewards, can achieve strong answer accuracy on multi-hop questions. However, under noisy retrieval, models frequently suffer from "right-answer-wrong-reason…

Computation and Language · Computer Science 2026-03-17 Yu Liu , Wenxiao Zhang , Diandian Guo , Cong Cao , Fangfang Yuan , Qiang Sun , Yanbing Liu , Jin B. Hong , Zhiyuan Ma

Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, \emph{requires} proper multihop reasoning? To…

Computation and Language · Computer Science 2022-05-06 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

The success of deep learning models on multi-hop fact verification has prompted researchers to understand the behavior behind their veracity. One possible way is erasure search: obtaining the rationale by entirely removing a subset of input…

Computation and Language · Computer Science 2023-05-17 Jiasheng Si , Yingjie Zhu , Deyu Zhou

Recent advances in Large Language Models (LLMs) and Reinforcement Learning (RL) have led to strong performance in open-domain question answering (QA). However, existing models still struggle with questions that admit multiple valid answers.…

Computation and Language · Computer Science 2025-10-10 Fengji Zhang , Xinyao Niu , Chengyang Ying , Guancheng Lin , Zhongkai Hao , Zhou Fan , Chengen Huang , Jacky Keung , Bei Chen , Junyang Lin

Multi-hop QA requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. The recently proposed HotpotQA (Yang et al., 2018) dataset is comprised of questions embodying four different multi-hop…

Computation and Language · Computer Science 2019-11-01 Yichen Jiang , Mohit Bansal

We investigate the ability of language models to perform compositional reasoning tasks where the overall solution depends on correctly composing the answers to sub-problems. We measure how often models can correctly answer all sub-problems…

Computation and Language · Computer Science 2023-10-19 Ofir Press , Muru Zhang , Sewon Min , Ludwig Schmidt , Noah A. Smith , Mike Lewis

In multi-hop QA, answering complex questions entails iterative document retrieval for finding the missing entity of the question. The main steps of this process are sub-question detection, document retrieval for the sub-question, and…

Computation and Language · Computer Science 2021-06-21 Yeon Seonwoo , Sang-Woo Lee , Ji-Hoon Kim , Jung-Woo Ha , Alice Oh

Multimodal reward models are crucial for aligning multimodal large language models with human preferences. Recent works have incorporated reasoning capabilities into these models, achieving promising results. However, training these models…

Artificial Intelligence · Computer Science 2026-02-03 Shidong Yang , Tongwen Huang , Hao Wen , Yong Wang , Li Chen , Xiangxiang Chu

This work deals with the challenge of learning and reasoning over multi-modal multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn multi-source reasoning paths and…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal

This paper proposes a novel training method to improve the robustness of Extractive Question Answering (EQA) models. Previous research has shown that existing models, when trained on EQA datasets that include unanswerable questions,…

Computation and Language · Computer Science 2024-10-01 Son Quoc Tran , Matt Kretchmar

Multi-Hop Question Answering (MHQA) is a significant area in question answering, requiring multiple reasoning components, including document retrieval, supporting sentence prediction, and answer span extraction. In this work, we analyze the…

Computation and Language · Computer Science 2023-12-14 Zhangyue Yin , Yuxin Wang , Xiannian Hu , Yiguang Wu , Hang Yan , Xinyu Zhang , Zhao Cao , Xuanjing Huang , Xipeng Qiu

Multi-hop question answering (QA) requires a model to retrieve and integrate information from different parts of a long text to answer a question. Humans answer this kind of complex questions via a divide-and-conquer approach. In this…

Computation and Language · Computer Science 2021-01-28 Yixuan Tang , Hwee Tou Ng , Anthony K. H. Tung

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

Computation and Language · Computer Science 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

In the question answering(QA) task, multi-hop reasoning framework has been extensively studied in recent years to perform more efficient and interpretable answer reasoning on the Knowledge Graph(KG). However, multi-hop reasoning is…

Artificial Intelligence · Computer Science 2022-03-15 Yao Zhang , Peiyao Li , Hongru Liang , Adam Jatowt , Zhenglu Yang

Reading comprehension QA tasks have seen a recent surge in popularity, yet most works have focused on fact-finding extractive QA. We instead focus on a more challenging multi-hop generative task (NarrativeQA), which requires the model to…

Computation and Language · Computer Science 2019-06-04 Lisa Bauer , Yicheng Wang , Mohit Bansal

Language-enabled AI systems can answer complex, multi-hop questions to high accuracy, but supporting answers with evidence is a more challenging task which is important for the transparency and trustworthiness to users. Prior work in this…

Computation and Language · Computer Science 2022-01-11 Shane Storks , Qiaozi Gao , Aishwarya Reganti , Govind Thattai