English
Related papers

Related papers: DynamicRetriever: A Pre-training Model-based IR Sy…

200 papers

We introduce and define the novel problem of multi-distribution information retrieval (IR) where given a query, systems need to retrieve passages from within multiple collections, each drawn from a different distribution. Some of these…

Information Retrieval · Computer Science 2023-06-23 Soumya Chatterjee , Omar Khattab , Simran Arora

As a key ingredient of the DBMS, index plays an important role in the query optimization and processing. However, it is a non-trivial task to apply existing indexes or design new indexes for new applications, where both data distribution…

Databases · Computer Science 2020-03-05 Sai Wu , Xinyi Yu , Xiaojie Feng , Feifei Li , Wei Cao , Gang Chen

Deep neural networks often have millions of parameters. This can hinder their deployment to low-end devices, not only due to high memory requirements but also because of increased latency at inference. We propose a novel model compression…

Machine Learning · Computer Science 2020-06-15 Tao Lin , Sebastian U. Stich , Luis Barba , Daniil Dmitriev , Martin Jaggi

The Bing Bang of the Internet in the early 90's increased dramatically the number of images being distributed and shared over the web. As a result, image information retrieval systems were developed to index and retrieve image files spread…

Information Retrieval · Computer Science 2012-04-03 Youssef Bassil

Pre-trained model such as BERT has been proved to be an effective tool for dealing with Information Retrieval (IR) problems. Due to its inspiring performance, it has been widely used to tackle with real-world IR problems such as document…

Information Retrieval · Computer Science 2021-09-15 Ruizhi Pu , Xinyu Zhang , Ruofei Lai , Zikai Guo , Yinxia Zhang , Hao Jiang , Yongkang Wu , Yantao Jia , Zhicheng Dou , Zhao Cao

Instruction-following capabilities in LLMs have progressed significantly, enabling more complex user interactions through detailed prompts. However, retrieval systems have not matched these advances, most of them still relies on traditional…

Information Retrieval · Computer Science 2025-03-06 Jianqun Zhou , Yuanlei Zheng , Wei Chen , Qianqian Zheng , Hui Su , Wei Zhang , Rui Meng , Xiaoyu Shen

Effective information retrieval (IR) from vast datasets relies on advanced techniques to extract relevant information in response to queries. Recent advancements in dense retrieval have showcased remarkable efficacy compared to traditional…

Information Retrieval · Computer Science 2024-10-03 Chao-Wei Huang , Yun-Nung Chen

Cross-modal retrieval relies on accurate models to retrieve relevant results for queries across modalities such as image, text, and video. In this paper, we build upon previous work by tackling the difficulty of evaluating models both…

Multimedia · Computer Science 2020-10-20 Tony Zhao , Jaeyoung Choi , Gerald Friedland

Large language models (LLMs) fine-tuned for text-retrieval have demonstrated state-of-the-art results across several information retrieval (IR) benchmarks. However, supervised training for improving these models requires numerous labeled…

Information Retrieval · Computer Science 2024-06-24 William Fleshman , Benjamin Van Durme

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural representations have shown great success in capturing semantic…

Information Retrieval · Computer Science 2018-07-24 Yan Xiao , Jiafeng Guo , Yixing Fan , Yanyan Lan , Jun Xu , Xueqi Cheng

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

Text retrieval is a long-standing research topic on information seeking, where a system is required to return relevant information resources to user's queries in natural language. From classic retrieval methods to learning-based ranking…

Information Retrieval · Computer Science 2022-11-29 Wayne Xin Zhao , Jing Liu , Ruiyang Ren , Ji-Rong Wen

Recent dense retrievers increasingly leverage the robust text understanding capabilities of Large Language Models (LLMs), encoding queries and documents into a shared embedding space for effective retrieval. However, most existing methods…

Information Retrieval · Computer Science 2025-10-07 Yifan Ji , Zhipeng Xu , Zhenghao Liu , Yukun Yan , Shi Yu , Yishan Li , Zhiyuan Liu , Yu Gu , Ge Yu , Maosong Sun

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Dense retrieval has been shown to be effective for retrieving relevant documents for Open Domain QA, surpassing popular sparse retrieval methods like BM25. REALM (Guu et al., 2020) is an end-to-end dense retrieval system that relies on MLM…

Computation and Language · Computer Science 2021-04-20 Vidhisha Balachandran , Ashish Vaswani , Yulia Tsvetkov , Niki Parmar

Document expansion (DE) via query generation tackles vocabulary mismatch in sparse retrieval, yet faces limitations: uncontrolled generation producing hallucinated or redundant queries with low diversity; poor generalization from in-domain…

Information Retrieval · Computer Science 2025-10-14 Tzu-Lin Kuo , Wei-Ning Chiu , Wei-Yun Ma , Pu-Jen Cheng

Dense retrieval has shown promise in the first-stage retrieval process when trained on in-domain labeled datasets. However, previous studies have found that dense retrieval is hard to generalize to unseen domains due to its weak modeling of…

Information Retrieval · Computer Science 2023-05-19 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

For ambiguous queries, conventional retrieval systems are bound by two conflicting goals. On the one hand, they should diversify and strive to present results for as many query intents as possible. On the other hand, they should provide…

Information Retrieval · Computer Science 2015-03-19 Karthik Raman , Thorsten Joachims , Pannaga Shivaswamy

Generative information retrieval (GenIR) is a promising neural retrieval paradigm that formulates document retrieval as a document identifier (docid) generation task, allowing for end-to-end optimization toward a unified global retrieval…

Information Retrieval · Computer Science 2026-05-26 Kidist Amde Mekonnen , Yubao Tang , Maarten de Rijke

Many Information Retrieval (IR) models make use of offline statistical techniques to score documents for ranking over a single period, rather than use an online, dynamic system that is responsive to users over time. In this paper, we…

Information Retrieval · Computer Science 2013-03-22 Marc Sloan , Jun Wang