English
Related papers

Related papers: Simple yet Effective Bridge Reasoning for Open-Dom…

200 papers

Previous work finds that recent long-context language models fail to make equal use of information in the middle of their inputs, preferring pieces of information located at the tail ends which creates an undue bias in situations where we…

Computation and Language · Computer Science 2024-12-16 George Arthur Baker , Ankush Raut , Sagi Shaier , Lawrence E Hunter , Katharina von der Wense

Despite remarkable advances, large language models often fail at compositional reasoning tasks, a phenomenon exemplified by the ``curse of two-hop reasoning''. This paper introduces the Identity Bridge, a simple yet powerful mechanism that…

Machine Learning · Computer Science 2025-09-30 Pengxiao Lin , Zheng-An Chen , Zhi-Qin John Xu

The emergence of reasoning models and their integration into practical AI chat bots has led to breakthroughs in solving advanced math, deep search, and extractive question answering problems that requires a complex and multi-step thought…

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

Computation and Language · Computer Science 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

This work deals with the challenge of learning and reasoning over multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn cross paragraph reasoning paths and find the…

Computation and Language · Computer Science 2020-11-19 Chen Zheng , Parisa Kordjamshidi

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

Recently, end-to-end trained models for multiple-choice commonsense question answering (QA) have delivered promising results. However, such question-answering systems cannot be directly applied in real-world scenarios where answer…

Computation and Language · Computer Science 2023-03-21 Zhen Han , Yue Feng , Mingming Sun

We propose the new problem of learning to recover reasoning chains from weakly supervised signals, i.e., the question-answer pairs. We propose a cooperative game approach to deal with this problem, in which how the evidence passages are…

Computation and Language · Computer Science 2020-04-07 Yufei Feng , Mo Yu , Wenhan Xiong , Xiaoxiao Guo , Junjie Huang , Shiyu Chang , Murray Campbell , Michael Greenspan , Xiaodan Zhu

Open-domain Question Answering (OpenQA) aims at answering factual questions with an external large-scale knowledge corpus. However, real-world knowledge is not static; it updates and evolves continually. Such a dynamic characteristic of…

Computation and Language · Computer Science 2024-04-03 Zixuan Zhang , Revanth Gangi Reddy , Kevin Small , Tong Zhang , Heng Ji

This paper studies the problem of open-domain question answering, with the aim of answering a diverse range of questions leveraging knowledge resources. Two types of sources, QA-pair and document corpora, have been actively leveraged with…

Computation and Language · Computer Science 2023-06-08 Kyungjae Lee , Sang-eun Han , Seung-won Hwang , Moontae Lee

Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decision-making, making…

Computation and Language · Computer Science 2023-10-12 Liangming Pan , Xinyuan Lu , Min-Yen Kan , Preslav Nakov

Multi-hop question answering (MHQA) enables accurate answers to complex queries by retrieving and reasoning over evidence dispersed across multiple documents. Existing MHQA approaches mainly rely on iterative retrieval-augmented generation,…

Artificial Intelligence · Computer Science 2026-04-21 Wei Chen , Lili Zhao , Zhi Zheng , HuiJun Hou , Tong Xu

In open-domain question answering (QA), retrieve-and-read mechanism has the inherent benefit of interpretability and the easiness of adding, removing, or editing knowledge compared to the parametric approaches of closed-book QA models.…

Computation and Language · Computer Science 2021-05-25 Sohee Yang , Minjoon Seo

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

Computation and Language · Computer Science 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

This paper introduces a new framework for open-domain question answering in which the retriever and the reader iteratively interact with each other. The framework is agnostic to the architecture of the machine reading model, only requiring…

Computation and Language · Computer Science 2019-05-15 Rajarshi Das , Shehzaad Dhuliawala , Manzil Zaheer , Andrew McCallum

Open-domain question answering (QA) systems are often built with retrieval modules. However, retrieving passages from a given source is known to suffer from insufficient knowledge coverage. Alternatively, prompting large language models…

Computation and Language · Computer Science 2023-10-24 Yunxiang Zhang , Muhammad Khalifa , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Lu Wang

Visual Question Answering (VQA) often involves diverse reasoning scenarios across Vision and Language (V&L). Most prior VQA studies, however, have merely focused on assessing the model's overall accuracy without evaluating it on different…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jihyung Kil , Farideh Tavazoee , Dongyeop Kang , Joo-Kyung Kim

Multi-hop Question Answering over Knowledge Graph~(KGQA) aims to find the answer entities that are multiple hops away from the topic entities mentioned in a natural language question on a large-scale Knowledge Graph (KG). To cope with the…

Computation and Language · Computer Science 2023-03-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Ji-Rong Wen

To alleviate the data scarcity problem in training question answering systems, recent works propose additional intermediate pre-training for dense passage retrieval (DPR). However, there still remains a large discrepancy between the…

Computation and Language · Computer Science 2022-04-13 Jiawei Zhou , Xiaoguang Li , Lifeng Shang , Lan Luo , Ke Zhan , Enrui Hu , Xinyu Zhang , Hao Jiang , Zhao Cao , Fan Yu , Xin Jiang , Qun Liu , Lei Chen

Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, \emph{requires} proper multihop reasoning? To…

Computation and Language · Computer Science 2022-05-06 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal