English
Related papers

Related papers: Avoiding Reasoning Shortcuts: Adversarial Evaluati…

200 papers

Question answering (QA) models for reading comprehension tend to learn shortcut solutions rather than the solutions intended by QA datasets. QA models that have learned shortcut solutions can achieve human-level performance in shortcut…

Computation and Language · Computer Science 2022-11-30 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

We investigate the ability of language models to perform compositional reasoning tasks where the overall solution depends on correctly composing the answers to sub-problems. We measure how often models can correctly answer all sub-problems…

Computation and Language · Computer Science 2023-10-19 Ofir Press , Muru Zhang , Sewon Min , Ludwig Schmidt , Noah A. Smith , Mike Lewis

Systems for language understanding have become remarkably strong at overcoming linguistic imperfections in tasks involving phrase matching or simple reasoning. Yet, their accuracy drops dramatically as the number of reasoning steps…

Computation and Language · Computer Science 2020-05-04 Daniel Khashabi , Erfan Sadeqi Azer , Tushar Khot , Ashish Sabharwal , Dan Roth

Multi-hop knowledge based question answering (KBQA) is a complex task for natural language understanding. Many KBQA approaches have been proposed in recent years, and most of them are trained based on labeled reasoning path. This hinders…

Machine Learning · Computer Science 2020-05-25 Kechen Qin , Yu Wang , Cheng Li , Kalpa Gunaratna , Hongxia Jin , Virgil Pavlu , Javed A. Aslam

Language-enabled AI systems can answer complex, multi-hop questions to high accuracy, but supporting answers with evidence is a more challenging task which is important for the transparency and trustworthiness to users. Prior work in this…

Computation and Language · Computer Science 2022-01-11 Shane Storks , Qiaozi Gao , Aishwarya Reganti , Govind Thattai

Multi-hop question answering (MHQA) requires a model to retrieve and integrate information from multiple passages to answer a complex question. Recent systems leverage the power of large language models and integrate evidence retrieval with…

Computation and Language · Computer Science 2024-07-08 Zhenyu Bi , Daniel Hajialigol , Zhongkai Sun , Jie Hao , Xuan Wang

Multi-hop logical reasoning on knowledge graphs is a pivotal task in natural language processing, with numerous approaches aiming to answer First-Order Logic (FOL) queries. Recent geometry (e.g., box, cone) and probability (e.g., beta…

Artificial Intelligence · Computer Science 2024-06-12 Jeonghoon Kim , Heesoo Jung , Hyeju Jang , Hogun Park

State-of-the-art approaches to reasoning and question answering over knowledge graphs (KGs) usually scale with the number of edges and can only be applied effectively on small instance-dependent subgraphs. In this paper, we address this…

Machine Learning · Computer Science 2021-10-28 Mattia Atzeni , Jasmina Bogojeska , Andreas Loukas

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous…

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

The growing complexity of factual claims in real-world scenarios presents significant challenges for automated fact verification systems, particularly in accurately aggregating and reasoning over multi-hop evidence. Existing approaches…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Haoran Jia , Xi Zhang

Multimodal Multi-hop question answering requires integrating information from diverse sources, such as images and texts, to derive answers. Existing methods typically rely on sequential retrieval and reasoning, where each step builds on the…

Artificial Intelligence · Computer Science 2025-09-22 Yiheng Hu , Xiaoyang Wang , Qing Liu , Xiwei Xu , Qian Fu , Wenjie Zhang , Liming Zhu

Multi-hop QA (Question Answering) is the task of finding the answer to a question across multiple documents. In recent years, a number of Deep Learning-based approaches have been proposed to tackle this complex task, as well as a few…

Computation and Language · Computer Science 2023-01-30 Yunjie He , Philip John Gorinski , Ieva Staliunaite , Pontus Stenetorp

As Large Language Models are increasingly deployed in high-stakes domains, their ability to detect false assumptions and reason critically is crucial for ensuring reliable outputs. False-premise questions (FPQs) serve as an important…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

Computation and Language · Computer Science 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

Reinforcement learning has recently shown promise in improving retrieval-augmented generation (RAG). Despite these advances, its effectiveness in multi-hop question answering (QA) remains limited by two fundamental limitations: (i) global…

Computation and Language · Computer Science 2026-03-17 Jinchang Luo , Mingquan Cheng , Fan Wan , Ni Li , Xiaoling Xia , Shuangshuang Tian , Tingcheng Bian , Haiwei Wang , Haohuan Fu , Yan Tao

We carry out a series of experiments to test large language models' multi-hop reasoning ability from three aspects: selecting and combining external knowledge, dealing with non-sequential reasoning tasks and generalising to data samples…

Computation and Language · Computer Science 2024-12-12 Haotong Zhang

Multi-hop reading comprehension requires not only the ability to reason over raw text but also the ability to combine multiple evidence. We propose a novel learning approach that helps language models better understand difficult multi-hop…

Computation and Language · Computer Science 2022-11-08 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Multi-Hop Question Answering (MHQA) is a significant area in question answering, requiring multiple reasoning components, including document retrieval, supporting sentence prediction, and answer span extraction. In this work, we analyze the…

Computation and Language · Computer Science 2023-12-14 Zhangyue Yin , Yuxin Wang , Xiannian Hu , Yiguang Wu , Hang Yan , Xinyu Zhang , Zhao Cao , Xuanjing Huang , Xipeng Qiu