English
Related papers

Related papers: Dense Passage Retrieval for Open-Domain Question A…

200 papers

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

With the recent success of dense retrieval methods based on bi-encoders, studies have applied this approach to various interesting downstream retrieval tasks with good efficiency and in-domain effectiveness. Recently, we have also seen the…

Information Retrieval · Computer Science 2022-10-24 Wei Zhong , Jheng-Hong Yang , Yuqing Xie , Jimmy Lin

Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of…

Computation and Language · Computer Science 2022-08-08 Xiaoyu Shen , Svitlana Vakulenko , Marco del Tredici , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Dialogue systems can benefit from being able to search through a corpus of text to find information relevant to user requests, especially when encountering a request for which no manually curated response is available. The state-of-the-art…

Information Retrieval · Computer Science 2022-06-02 Hui Wan , Siva Sankalp Patel , J. William Murdock , Saloni Potdar , Sachindra Joshi

Dense retrievers for open-domain question answering (ODQA) have been shown to achieve impressive performance by training on large datasets of question-passage pairs. In this work we ask whether this dependence on labeled data can be reduced…

Computation and Language · Computer Science 2022-05-18 Ori Ram , Gal Shachaf , Omer Levy , Jonathan Berant , Amir Globerson

Training dense passage representations via contrastive learning has been shown effective for Open-Domain Passage Retrieval (ODPR). Existing studies focus on further optimizing by improving negative sampling strategy or extra pretraining.…

Computation and Language · Computer Science 2022-03-08 Bohong Wu , Zhuosheng Zhang , Jinyuan Wang , Hai Zhao

Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge. While promising, this approach requires to use models with billions of parameters, which are expensive to train and…

Computation and Language · Computer Science 2021-02-04 Gautier Izacard , Edouard Grave

Extracting dense representations for terms and phrases is a task of great importance for knowledge discovery platforms targeting highly-technical fields. Dense representations are used as features for downstream components and have multiple…

Computation and Language · Computer Science 2023-05-26 Francesco Fusco , Diego Antognini

Open-domain question answering aims at solving the task of locating the answers to user-generated questions in massive collections of documents. There are two families of solutions available: retriever-readers, and knowledge-graph-based…

Computation and Language · Computer Science 2020-10-26 Jinfeng Xiao , Lidan Wang , Franck Dernoncourt , Trung Bui , Tong Sun , Jiawei Han

Information Retrieval using dense low-dimensional representations recently became popular and showed out-performance to traditional sparse-representations like BM25. However, no previous work investigated how dense representations perform…

Information Retrieval · Computer Science 2021-06-10 Nils Reimers , Iryna Gurevych

Conversational dense retrieval has shown to be effective in conversational search. However, a major limitation of conversational dense retrieval is their lack of interpretability, hindering intuitive understanding of model behaviors for…

Information Retrieval · Computer Science 2024-06-04 Yiruo Cheng , Kelong Mao , Zhicheng Dou

A popular recent approach to answering open-domain questions is to first search for question-related passages and then apply reading comprehension models to extract answers. Existing methods usually extract answers from single passages…

Computation and Language · Computer Science 2018-04-27 Shuohang Wang , Mo Yu , Jing Jiang , Wei Zhang , Xiaoxiao Guo , Shiyu Chang , Zhiguo Wang , Tim Klinger , Gerald Tesauro , Murray Campbell

Dense retrieval systems conduct first-stage retrieval using embedded representations and simple similarity metrics to match a query to documents. Its effectiveness depends on encoded embeddings to capture the semantics of queries and…

Information Retrieval · Computer Science 2021-09-01 HongChien Yu , Chenyan Xiong , Jamie Callan

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a…

Information Retrieval · Computer Science 2019-05-03 Tolgahan Cakaloglu , Christian Szegedy , Xiaowei Xu

Recent approaches to Open-domain Question Answering refer to an external knowledge base using a retriever model, optionally rerank passages with a separate reranker model and generate an answer using another reader model. Despite performing…

Computation and Language · Computer Science 2022-10-31 Haejun Lee , Akhil Kedia , Jongwon Lee , Ashwin Paranjape , Christopher D. Manning , Kyoung-Gu Woo

We introduce ART, a new corpus-level autoencoding approach for training dense retrieval models that does not require any labeled training data. Dense retrieval is a central challenge for open-domain tasks, such as Open QA, where…

Computation and Language · Computer Science 2023-04-04 Devendra Singh Sachan , Mike Lewis , Dani Yogatama , Luke Zettlemoyer , Joelle Pineau , Manzil Zaheer

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

Computation and Language · Computer Science 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

The advent of contextualised language models has brought gains in search effectiveness, not just when applied for re-ranking the output of classical weighting models such as BM25, but also when used directly for passage indexing and…

Information Retrieval · Computer Science 2021-08-20 Craig Macdonald , Nicola Tonellotto , Iadh Ounis

Legal passage retrieval is an important task that assists legal practitioners in the time-intensive process of finding relevant precedents to support legal arguments. This study investigates the task of retrieving legal passages or…

Computation and Language · Computer Science 2025-06-17 Larissa Mori , Carlos Sousa de Oliveira , Yuehwern Yih , Mario Ventresca