English

Generative Retrieval with Few-shot Indexing

Information Retrieval 2025-12-24 v3 Artificial Intelligence Computation and Language Machine Learning

Abstract

Existing generative retrieval (GR) methods rely on training-based indexing, which fine-tunes a model to memorise associations between queries and the document identifiers (docids) of relevant documents. Training-based indexing suffers from high training costs, under-utilisation of pre-trained knowledge in large language models (LLMs), and limited adaptability to dynamic document corpora. To address the issues, we propose a few-shot indexing-based GR framework (Few-Shot GR). It has a few-shot indexing process without any training, where we prompt an LLM to generate docids for all documents in a corpus, ultimately creating a docid bank for the entire corpus. During retrieval, we feed a query to the same LLM and constrain it to generate a docid within the docid bank created during indexing, and then map the generated docid back to its corresponding document. Moreover, we devise few-shot indexing with one-to-many mapping to further enhance Few-Shot GR. Experiments show that Few-Shot GR achieves superior performance to state-of-the-art GR methods requiring heavy training.

Keywords

Cite

@article{arxiv.2408.02152,
  title  = {Generative Retrieval with Few-shot Indexing},
  author = {Arian Askari and Chuan Meng and Mohammad Aliannejadi and Zhaochun Ren and Evangelos Kanoulas and Suzan Verberne},
  journal= {arXiv preprint arXiv:2408.02152},
  year   = {2025}
}

Comments

Accepted for publication at the 48th European Conference on Information Retrieval (ECIR 2026)

R2 v1 2026-06-28T18:03:43.216Z