English
Related papers

Related papers: Towards Universal Dense Retrieval for Open-domain …

200 papers

Dense retrieval has become a prominent method to obtain relevant context or world knowledge in open-domain NLP tasks. When we use a learned dense retriever on a retrieval corpus at inference time, an often-overlooked design choice is the…

Computation and Language · Computer Science 2024-10-07 Tong Chen , Hongwei Wang , Sihao Chen , Wenhao Yu , Kaixin Ma , Xinran Zhao , Hongming Zhang , Dong Yu

Long-context multiple-choice question answering tasks require robust reasoning over extensive text sources. Since most of the pre-trained transformer models are restricted to processing only a few hundred words at a time, successful…

Information Retrieval · Computer Science 2025-01-28 Manish Singh , Manish Shrivastava

State-of-the-art systems in deep question answering proceed as follows: (1) an initial document retrieval selects relevant documents, which (2) are then processed by a neural network in order to extract the final answer. Yet the exact…

Computation and Language · Computer Science 2018-08-21 Bernhard Kratzwald , Stefan Feuerriegel

The task of information retrieval is an important component of many natural language processing systems, such as open domain question answering. While traditional methods were based on hand-crafted features, continuous representations based…

Computation and Language · Computer Science 2022-08-05 Gautier Izacard , Edouard Grave

A number of learned sparse and dense retrieval approaches have recently been proposed and proven effective in tasks such as passage retrieval and document retrieval. In this paper we analyze with a replicability study if the lessons learned…

Information Retrieval · Computer Science 2023-01-16 Gustavo Penha , Claudia Hauff

Domain specific information retrieval process has been a prominent and ongoing research in the field of natural language processing. Many researchers have incorporated different techniques to overcome the technical and domain specificity…

Dense retrievers have demonstrated significant potential for neural information retrieval; however, they lack robustness to domain shifts, limiting their efficacy in zero-shot settings across diverse domains. In this paper, we set out to…

Information Retrieval · Computer Science 2025-01-27 Goksenin Yuksel , Jaap Kamps

In table-text open-domain question answering, a retriever system retrieves relevant evidence from tables and text to answer questions. Previous studies in table-text open-domain question answering have two common challenges: firstly, their…

Computation and Language · Computer Science 2024-03-27 Deokhyung Kang , Baikjin Jung , Yunsu Kim , Gary Geunbae Lee

Open-domain question answering requires retrieval systems able to cope with the diverse and varied nature of questions, providing accurate answers across a broad spectrum of query types and topics. To deal with such topic heterogeneity…

Information Retrieval · Computer Science 2024-03-21 Pranav Kasela , Gabriella Pasi , Raffaele Perego , Nicola Tonellotto

Providing plausible responses to why questions is a challenging but critical goal for language based human-machine interaction. Explanations are challenging in that they require many different forms of abstract knowledge and reasoning.…

Computation and Language · Computer Science 2019-06-05 Allen Nie , Erin D. Bennett , Noah D. Goodman

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

In this work, we address multi-modal information needs that contain text questions and images by focusing on passage retrieval for outside-knowledge visual question answering. This task requires access to outside knowledge, which in our…

Information Retrieval · Computer Science 2021-05-11 Chen Qu , Hamed Zamani , Liu Yang , W. Bruce Croft , Erik Learned-Miller

In dense retrieval, embedding long texts into dense vectors can result in information loss, leading to inaccurate query-text matching. Additionally, low-quality texts with excessive noise or sparse key information are unlikely to align well…

Computation and Language · Computer Science 2025-03-04 Hongming Tan , Shaoxiong Zhan , Hai Lin , Hai-Tao Zheng , Wai Kin Chan

Large language models have shown unprecedented abilities in generating linguistically coherent and syntactically correct natural language output. However, they often return incorrect and inconsistent answers to input questions. Due to the…

Databases · Computer Science 2023-12-27 Jasmin Mousavi , Arash Termehchy

We present Cross-lingual Open-Retrieval Answer Generation (CORA), the first unified many-to-many question answering (QA) model that can answer questions across many languages, even for ones without language-specific annotated data or…

Computation and Language · Computer Science 2021-10-29 Akari Asai , Xinyan Yu , Jungo Kasai , Hannaneh Hajishirzi

Open-domain Question Answering (OpenQA) aims at answering factual questions with an external large-scale knowledge corpus. However, real-world knowledge is not static; it updates and evolves continually. Such a dynamic characteristic of…

Computation and Language · Computer Science 2024-04-03 Zixuan Zhang , Revanth Gangi Reddy , Kevin Small , Tong Zhang , Heng Ji

We present an end-to-end differentiable training method for retrieval-augmented open-domain question answering systems that combine information from multiple retrieved documents when generating answers. We model retrieval decisions as…

Computation and Language · Computer Science 2021-12-07 Devendra Singh Sachan , Siva Reddy , William Hamilton , Chris Dyer , Dani Yogatama

Open-domain question answering remains a challenging task as it requires models that are capable of understanding questions and answers, collecting useful information, and reasoning over evidence. Previous work typically formulates this…

Computation and Language · Computer Science 2019-05-13 Jianmo Ni , Chenguang Zhu , Weizhu Chen , Julian McAuley

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao