English
Related papers

Related papers: Modeling Contextual Passage Utility for Multihop Q…

200 papers

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating retrieved information. Standard retrieval process prioritized relevance, focusing on topical alignment between queries and passages. In contrast, in…

Information Retrieval · Computer Science 2025-10-10 Hengran Zhang , Keping Bi , Jiafeng Guo , Jiaming Zhang , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

To explain the predicted answers and evaluate the reasoning abilities of models, several studies have utilized underlying reasoning (UR) tasks in multi-hop question answering (QA) datasets. However, it remains an open question as to how…

Computation and Language · Computer Science 2023-02-14 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA. However, the complexity of…

Computation and Language · Computer Science 2022-05-20 Semih Yavuz , Kazuma Hashimoto , Yingbo Zhou , Nitish Shirish Keskar , Caiming Xiong

The dependency between an adequate question formulation and correct answer selection is a very intriguing but still underexplored area. In this paper, we show that question rewriting (QR) of the conversational context allows to shed more…

Computation and Language · Computer Science 2022-02-04 Svitlana Vakulenko , Shayne Longpre , Zhucheng Tu , Raviteja Anantha

Previous work finds that recent long-context language models fail to make equal use of information in the middle of their inputs, preferring pieces of information located at the tail ends which creates an undue bias in situations where we…

Computation and Language · Computer Science 2024-12-16 George Arthur Baker , Ankush Raut , Sagi Shaier , Lawrence E Hunter , Katharina von der Wense

Retrieval-Augmented Generation (RAG) has been used in question answering (QA) systems to improve performance when relevant information is in one (single-hop) or multiple (multi-hop) passages. However, many real life scenarios (e.g. dealing…

Computation and Language · Computer Science 2026-04-02 Mykolas Sveistrys , Richard Kunert

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Extractive QA models have shown very promising performance in predicting the correct answer to a question for a given passage. However, they sometimes result in predicting the correct answer text but in a context irrelevant to the given…

Computation and Language · Computer Science 2020-11-06 Yeon Seonwoo , Ji-Hoon Kim , Jung-Woo Ha , Alice Oh

Conversational passage retrieval is challenging as it often requires the resolution of references to previous utterances and needs to deal with the complexities of natural language, such as coreference and ellipsis. To address these…

Information Retrieval · Computer Science 2024-06-28 Ivica Kostric , Krisztian Balog

While Large Language Models (LLMs) are widely used in open-domain Question Answering (QA), their ability to handle inferential questions-where answers must be derived rather than directly retrieved-remains still underexplored. This study…

Computation and Language · Computer Science 2026-05-13 Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Multi-hop QA requires reasoning over multiple supporting facts to answer the question. However, the existing QA models always rely on shortcuts, e.g., providing the true answer by only one fact, rather than multi-hop reasoning, which is…

Artificial Intelligence · Computer Science 2022-10-14 Wangzhen Guo , Qinkang Gong , Hanjiang Lai

Retrieval-augmented language models have demonstrated performance comparable to much larger models while requiring fewer computational resources. The effectiveness of these models crucially depends on the overlap between query and retrieved…

Computation and Language · Computer Science 2025-05-21 Ehsan Doostmohammadi , Marco Kuhlmann

Recent generative approaches for multi-hop question answering (QA) utilize the fusion-in-decoder method~\cite{izacard-grave-2021-leveraging} to generate a single sequence output which includes both a final answer and a reasoning path taken…

Computation and Language · Computer Science 2023-07-04 Gowtham Ramesh , Makesh Sreedhar , Junjie Hu

Augmenting Large Language Models (LLMs) with information retrieval capabilities (i.e., Retrieval-Augmented Generation (RAG)) has proven beneficial for knowledge-intensive tasks. However, understanding users' contextual search intent when…

Computation and Language · Computer Science 2024-09-25 Nirmal Roy , Leonardo F. R. Ribeiro , Rexhina Blloshmi , Kevin Small

Multi-hop reasoning requires aggregating multiple documents to answer a complex question. Existing methods usually decompose the multi-hop question into simpler single-hop questions to solve the problem for illustrating the explainable…

Computation and Language · Computer Science 2022-08-23 Siyuan Wang , Zhongyu Wei , Zhihao Fan , Qi Zhang , Xuanjing Huang

In the open book question answering (OBQA) task, selecting the relevant passages and sentences from distracting information is crucial to reason the answer to a question. HotpotQA dataset is designed to teach and evaluate systems to do both…

Computation and Language · Computer Science 2022-08-03 Man Luo , Shuguang Chen , Chitta Baral

For knowledge intensive NLP tasks, it has been widely accepted that accessing more information is a contributing factor to improvements in the model's end-to-end performance. However, counter-intuitively, too much context can have a…

Computation and Language · Computer Science 2023-10-30 Philhoon Oh , James Thorne

Multi-hop question answering (QA) is widely used to evaluate the reasoning capabilities of large language models, yet most benchmarks focus on final answer correctness and overlook intermediate reasoning, especially in long multimodal…

Computation and Language · Computer Science 2026-03-10 Biao Xiang , Soyeon Caren Han , Yihao Ding

Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its…

Artificial Intelligence · Computer Science 2018-09-13 Xi Victoria Lin , Richard Socher , Caiming Xiong

Relevance feedback techniques assume that users provide relevance judgments for the top k (usually 10) documents and then re-rank using a new query model based on those judgments. Even though this is effective, there has been little…

Information Retrieval · Computer Science 2018-12-24 Keping Bi , Qingyao Ai , W. Bruce Croft