English
Related papers

Related papers: Learning Dense Representations of Phrases at Scale

200 papers

Spoken Question Answering (SQA) is essential for machines to reply to user's question by finding the answer span within a given spoken passage. SQA has been previously achieved without ASR to avoid recognition errors and Out-of-Vocabulary…

Computation and Language · Computer Science 2024-08-27 Chyi-Jiunn Lin , Guan-Ting Lin , Yung-Sung Chuang , Wei-Lun Wu , Shang-Wen Li , Abdelrahman Mohamed , Hung-yi Lee , Lin-shan Lee

Ranking responses for a given dialogue context is a popular benchmark in which the setup is to re-rank the ground-truth response over a limited set of $n$ responses, where $n$ is typically 10. The predominance of this setup in conversation…

Information Retrieval · Computer Science 2022-04-25 Gustavo Penha , Claudia Hauff

Understanding inferences and answering questions from text requires more than merely recovering surface arguments, adjuncts, or strings associated with the query terms. As humans, we interpret sentences as contextualized components of a…

Computation and Language · Computer Science 2022-10-24 Jingxuan Tu , Kyeongmin Rim , Eben Holderness , James Pustejovsky

Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their…

Information Retrieval · Computer Science 2021-12-10 Sheng-Chieh Lin , Jimmy Lin

We introduce ART, a new corpus-level autoencoding approach for training dense retrieval models that does not require any labeled training data. Dense retrieval is a central challenge for open-domain tasks, such as Open QA, where…

Computation and Language · Computer Science 2023-04-04 Devendra Singh Sachan , Mike Lewis , Dani Yogatama , Luke Zettlemoyer , Joelle Pineau , Manzil Zaheer

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

We introduce SPARTA, a novel neural retrieval method that shows great promise in performance, generalization, and interpretability for open-domain question answering. Unlike many neural ranking methods that use dense vector nearest neighbor…

Computation and Language · Computer Science 2020-09-29 Tiancheng Zhao , Xiaopeng Lu , Kyusong Lee

The dual-encoder has become the de facto architecture for dense retrieval. Typically, it computes the latent representations of the query and document independently, thus failing to fully capture the interactions between the query and…

Computation and Language · Computer Science 2023-10-31 Xingwei He , Yeyun Gong , A-Long Jin , Hang Zhang , Anlei Dong , Jian Jiao , Siu Ming Yiu , Nan Duan

Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of…

Computation and Language · Computer Science 2022-08-08 Xiaoyu Shen , Svitlana Vakulenko , Marco del Tredici , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Open-domain table question answering aims to provide answers to a question by retrieving and extracting information from a large collection of tables. Existing studies of open-domain table QA either directly adopt text retrieval methods or…

Computation and Language · Computer Science 2023-09-20 Nengzheng Jin , Dongfang Li , Junying Chen , Joanna Siebert , Qingcai Chen

Dense retrieval systems conduct first-stage retrieval using embedded representations and simple similarity metrics to match a query to documents. Its effectiveness depends on encoded embeddings to capture the semantics of queries and…

Information Retrieval · Computer Science 2021-09-01 HongChien Yu , Chenyan Xiong , Jamie Callan

As the first step in automated natural language processing, representing words and sentences is of central importance and has attracted significant research attention. Different approaches, from the early one-hot and bag-of-words…

Computation and Language · Computer Science 2019-11-06 Wenye Li , Senyue Hao

Similar question retrieval is a core task in community-based question answering (CQA) services. To balance the effectiveness and efficiency, the question retrieval system is typically implemented as multi-stage rankers: The first-stage…

Information Retrieval · Computer Science 2021-07-20 Yinqiong Cai , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Yanyan Lan , Xueqi Cheng

Recent dense retrievers increasingly leverage the robust text understanding capabilities of Large Language Models (LLMs), encoding queries and documents into a shared embedding space for effective retrieval. However, most existing methods…

Information Retrieval · Computer Science 2025-10-07 Yifan Ji , Zhipeng Xu , Zhenghao Liu , Yukun Yan , Shi Yu , Yishan Li , Zhiyuan Liu , Yu Gu , Ge Yu , Maosong Sun

Pseudo-Relevance Feedback (PRF) utilises the relevance signals from the top-k passages from the first round of retrieval to perform a second round of retrieval aiming to improve search effectiveness. A recent research direction has been the…

Information Retrieval · Computer Science 2023-03-22 Hang Li , Shengyao Zhuang , Ahmed Mourad , Xueguang Ma , Jimmy Lin , Guido Zuccon

Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks by leveraging the fine-grained information that phrases offer. In our work, we propose a new task formulation of dense retrieval, cross-lingual…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Deng Cai , Zhi Qu , Qu Cui , Hidetaka Kamigaito , Lemao Liu , Taro Watanabe

Expansion-enhanced sparse lexical representation improves information retrieval (IR) by minimizing vocabulary mismatch problems during lexical matching. In this paper, we explore the potential of jointly learning dense semantic…

Machine Learning · Computer Science 2024-05-24 Biplob Biswas , Rajiv Ramnath