English
Related papers

Related papers: Typo-Robust Representation Learning for Dense Retr…

200 papers

Dense retrieval is becoming one of the standard approaches for document and passage ranking. The dual-encoder architecture is widely adopted for scoring question-passage pairs due to its efficiency and high performance. Typically, dense…

Information Retrieval · Computer Science 2022-05-06 Georgios Sidiropoulos , Evangelos Kanoulas

Text retrieval is a long-standing research topic on information seeking, where a system is required to return relevant information resources to user's queries in natural language. From classic retrieval methods to learning-based ranking…

Information Retrieval · Computer Science 2022-11-29 Wayne Xin Zhao , Jing Liu , Ruiyang Ren , Ji-Rong Wen

Dense retrieval has become the new paradigm in passage retrieval. Despite its effectiveness on typo-free queries, it is not robust when dealing with queries that contain typos. Current works on improving the typo-robustness of dense…

Information Retrieval · Computer Science 2024-03-19 Georgios Sidiropoulos , Evangelos Kanoulas

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu

In simple open-domain question answering (QA), dense retrieval has become one of the standard approaches for retrieving the relevant passages to infer an answer. Recently, dense retrieval also achieved state-of-the-art results in multi-hop…

Information Retrieval · Computer Science 2021-09-23 Georgios Sidiropoulos , Nikos Voskarides , Svitlana Vakulenko , Evangelos Kanoulas

The dual-encoder has become the de facto architecture for dense retrieval. Typically, it computes the latent representations of the query and document independently, thus failing to fully capture the interactions between the query and…

Computation and Language · Computer Science 2023-10-31 Xingwei He , Yeyun Gong , A-Long Jin , Hang Zhang , Anlei Dong , Jian Jiao , Siu Ming Yiu , Nan Duan

Current dense retrievers (DRs) are limited in their ability to effectively process misspelled queries, which constitute a significant portion of query traffic in commercial search engines. The main issue is that the pre-trained language…

Information Retrieval · Computer Science 2023-11-28 Shengyao Zhuang , Linjun Shou , Jian Pei , Ming Gong , Houxing Ren , Guido Zuccon , Daxin Jiang

Multilingual dense retrieval aims to retrieve relevant documents across different languages based on a unified retriever model. The challenge lies in aligning representations of different languages in a shared vector space. The common…

Information Retrieval · Computer Science 2025-09-12 Chao Huang , Fengran Mo , Yufeng Chen , Changhao Guan , Zhenrui Yue , Xinyu Wang , Jinan Xu , Kaiyu Huang

Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their…

Information Retrieval · Computer Science 2021-12-10 Sheng-Chieh Lin , Jimmy Lin

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

Computation and Language · Computer Science 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

Recent progress in deep learning has continuously improved the accuracy of dialogue response selection. In particular, sophisticated neural network architectures are leveraged to capture the rich interactions between dialogue context and…

Computation and Language · Computer Science 2022-04-26 Tian Lan , Deng Cai , Yan Wang , Yixuan Su , Heyan Huang , Xian-Ling Mao

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Dense Retrieval (DR) reaches state-of-the-art results in first-stage retrieval, but little is known about the mechanisms that contribute to its success. Therefore, in this work, we conduct an interpretation study of recently proposed DR…

Information Retrieval · Computer Science 2021-11-30 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

Open-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019). However, current phrase retrieval models heavily depend on sparse…

Computation and Language · Computer Science 2021-06-03 Jinhyuk Lee , Mujeen Sung , Jaewoo Kang , Danqi Chen

Conversational search supports multi-turn user-system interactions to solve complex information needs. Different from the traditional single-turn ad-hoc search, conversational search encounters a more challenging problem of…

Information Retrieval · Computer Science 2024-07-30 Fengran Mo , Chen Qu , Kelong Mao , Yihong Wu , Zhan Su , Kaiyu Huang , Jian-Yun Nie

Dense retrieval methods have shown great promise over sparse retrieval methods in a range of NLP problems. Among them, dense phrase retrieval-the most fine-grained retrieval unit-is appealing because phrases can be directly used as the…

Computation and Language · Computer Science 2021-09-17 Jinhyuk Lee , Alexander Wettig , Danqi Chen
‹ Prev 1 2 3 10 Next ›