English
Related papers

Related papers: Efficiency and Effectiveness of SPLADE Models on B…

200 papers

Augmenting language models with a retrieval mechanism has been shown to significantly improve their performance while keeping the number of parameters low. Retrieval-augmented models commonly rely on a semantic retrieval mechanism based on…

Computation and Language · Computer Science 2023-07-06 Ehsan Doostmohammadi , Tobias Norlund , Marco Kuhlmann , Richard Johansson

In neural Information Retrieval, ongoing research is directed towards improving the first retriever in ranking pipelines. Learning dense embeddings to conduct retrieval using efficient approximate nearest neighbors methods has proven to…

Information Retrieval · Computer Science 2021-07-14 Thibault Formal , Benjamin Piwowarski , Stéphane Clinchant

A companion to the release of the latest version of the SPLADE library. We describe changes to the training structure and present our latest series of models -- SPLADE-v3. We compare this new version to BM25, SPLADE++, as well as…

Information Retrieval · Computer Science 2024-03-12 Carlos Lassance , Hervé Déjean , Thibault Formal , Stéphane Clinchant

This work compares concept models for cross-language retrieval: First, we adapt probabilistic Latent Semantic Analysis (pLSA) for multilingual documents. Experiments with different weighting schemes show that a weighting method favoring…

Information Retrieval · Computer Science 2014-01-13 Benjamin Roth

Despite their recent popularity and well-known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query and to generalize to out-of-domain…

Computation and Language · Computer Science 2022-11-15 Xilun Chen , Kushal Lakhotia , Barlas Oğuz , Anchit Gupta , Patrick Lewis , Stan Peshterliev , Yashar Mehdad , Sonal Gupta , Wen-tau Yih

Legal passage retrieval is an important task that assists legal practitioners in the time-intensive process of finding relevant precedents to support legal arguments. This study investigates the task of retrieving legal passages or…

Computation and Language · Computer Science 2025-06-17 Larissa Mori , Carlos Sousa de Oliveira , Yuehwern Yih , Mario Ventresca

A lot of recent work has focused on sparse learned indexes that use deep neural architectures to significantly improve retrieval quality while keeping the efficiency benefits of the inverted index. While such sparse learned structures…

Information Retrieval · Computer Science 2024-07-09 Soyuj Basnet , Jerry Gou , Antonio Mallia , Torsten Suel

The ever-increasing size of language models curtails their widespread availability to the community, thereby galvanizing many companies into offering access to large language models through APIs. One particular type, suitable for dense…

Information Retrieval · Computer Science 2023-07-10 Ehsan Kamalloo , Xinyu Zhang , Odunayo Ogundepo , Nandan Thakur , David Alfonso-Hermelo , Mehdi Rezagholizadeh , Jimmy Lin

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant

Large Language Models (LLMs) have recently demonstrated strong capabilities in tool use, yet progress in tool retrieval remains hindered by incomplete and heterogeneous tool documentation. To address this challenge, we introduce Tool-DE, a…

Information Retrieval · Computer Science 2025-10-28 Xuan Lu , Haohang Huang , Rui Meng , Yaohui Jin , Wenjun Zeng , Xiaoyu Shen

The late interaction paradigm introduced with ColBERT stands out in the neural Information Retrieval space, offering a compelling effectiveness-efficiency trade-off across many benchmarks. Efficient late interaction retrieval is based on an…

Information Retrieval · Computer Science 2024-04-23 Thibault Formal , Stéphane Clinchant , Hervé Déjean , Carlos Lassance

Learned sparse retrieval (LSR) is a family of neural retrieval methods that transform queries and documents into sparse weight vectors aligned with a vocabulary. While LSR approaches like Splade work well for short passages, it is unclear…

Information Retrieval · Computer Science 2023-05-31 Thong Nguyen , Sean MacAvaney , Andrew Yates

We study retrieval design for code-focused generation tasks under realistic compute budgets. Using two complementary tasks from Long Code Arena -- code completion and bug localization -- we systematically compare retrieval configurations…

Machine Learning · Computer Science 2025-10-24 Timur Galimzyanov , Olga Kolomyttseva , Egor Bogomolov

Empirical scaling laws for language models have encouraged the development of ever-larger LLMs, despite their growing computational and memory costs. Sparse Mixture-of-Experts (MoEs) offer a promising alternative by activating only a subset…

Computation and Language · Computer Science 2026-04-09 Zeliang Zhang , Nikhil Ghosh , Jiani Liu , Bin Yu , Xiaodong Liu

Neural information retrieval architectures based on transformers such as BERT are able to significantly improve system effectiveness over traditional sparse models such as BM25. Though highly effective, these neural approaches are very…

Information Retrieval · Computer Science 2022-04-26 Antonio Mallia , Joel Mackenzie , Torsten Suel , Nicola Tonellotto

Retrieving code functions, classes or files that are relevant in order to solve a given user query, bug report or feature request from large codebases is a fundamental challenge for Large Language Model (LLM)-based coding agents. Agentic…

Software Engineering · Computer Science 2026-02-09 Shravan Chaudhari , Rahul Thomas Jacob , Mononito Goswami , Jiajun Cao , Shihab Rashid , Christian Bock

Query Expansion (QE) enriches queries and Document Expansion (DE) enriches documents, and these two techniques are often applied separately. However, such separate application may lead to semantic misalignment between the expanded queries…

Information Retrieval · Computer Science 2025-12-22 Yu Yang , Feng Tian , Ping Chen

Large Language Models (LLMs) have shown potential in generating hypothetical documents for query expansion, thereby enhancing information retrieval performance. However, the efficacy of this method is highly dependent on the quality of the…

Information Retrieval · Computer Science 2025-06-11 Lingyuan Liu , Mengxiang Zhang

As user content and queries become increasingly multi-modal, the need for effective multi-modal search systems has grown. Traditional search systems often rely on textual and metadata annotations for indexed images, while multi-modal…

Recent advances in dense retrieval techniques have offered the promise of being able not just to re-rank documents using contextualised language models such as BERT, but also to use such models to identify documents from the collection in…

Information Retrieval · Computer Science 2021-08-25 Nicola Tonellotto , Craig Macdonald