English
Related papers

Related papers: Scalable and Effective Generative Information Retr…

200 papers

Retrieval-Augmented Generation (RAG) has significantly enhanced Large Language Models' ability to access external knowledge, yet current graph-based RAG approaches face two critical limitations in managing hierarchical information: they…

Artificial Intelligence · Computer Science 2026-01-09 Chunyu Wei , Huaiyu Qin , Siyuan He , Yunhai Wang , Yueguo Chen

Legal document retrieval and judgment prediction are crucial tasks in intelligent legal systems. In practice, determining whether two documents share the same judgments is essential for establishing their relevance in legal retrieval.…

Information Retrieval · Computer Science 2024-04-16 Weicong Qin , Zelin Cao , Weijie Yu , Zihua Si , Sirui Chen , Jun Xu

Recent advances in Retrieval-Augmented Generation (RAG) have revolutionized knowledge-intensive tasks, yet traditional RAG methods struggle when the search space is unknown or when documents are semi-structured or structured. We introduce a…

Information Retrieval · Computer Science 2026-03-25 Manie Tadayon , Mayank Gupta

Retrieval-augmented generation (RAG) has become a cornerstone for knowledge-intensive tasks. However, the efficacy of RAG is often bottlenecked by the ``one-size-fits-all'' retrieval paradigm, as different queries exhibit distinct…

Information Retrieval · Computer Science 2026-04-28 Tong Zhao , Yutao Zhu , Yucheng Tian , Zhicheng Dou

Generative document retrieval, an emerging paradigm in information retrieval, learns to build connections between documents and identifiers within a single model, garnering significant attention. However, there are still two challenges: (1)…

Information Retrieval · Computer Science 2024-05-14 Yong Guan , Dingxiao Liu , Jinchen Ma , Hao Peng , Xiaozhi Wang , Lei Hou , Ru Li

Generative retrieval directly decode a document identifier (i.e., docid) in response to a query, making it impossible to provide users with explanations as an answer for ``why is this document retrieved?''. To address this limitation, we…

Information Retrieval · Computer Science 2026-04-14 Sangam Lee , Ryang Heo , SeongKu Kang , Susik Yoon , Jinyoung Yeo , Dongha Lee

Semantic IDs (SIDs) define the generation space of generative recommendation and directly determine its personalization ceiling. However, existing tokenizers are trained independently with retrieval objectives, leaving personalization…

Information Retrieval · Computer Science 2026-05-25 Shuli Wang

Heavily pre-trained transformers for language modelling, such as BERT, have shown to be remarkably effective for Information Retrieval (IR) tasks, typically applied to re-rank the results of a first-stage retrieval model. IR benchmarks…

Information Retrieval · Computer Science 2022-02-16 Gustavo Penha , Arthur Câmara , Claudia Hauff

Performing automatic reformulations of a user's query is a popular paradigm used in information retrieval (IR) for improving effectiveness -- as exemplified by the pseudo-relevance feedback approaches, which expand the query in order to…

Information Retrieval · Computer Science 2023-08-02 Xiao Wang , Sean MacAvaney , Craig Macdonald , Iadh Ounis

Generative retrieval, which is a new advanced paradigm for document retrieval, has recently attracted research interests, since it encodes all documents into the model and directly generates the retrieved documents. However, its power is…

Information Retrieval · Computer Science 2023-10-31 Tianchi Yang , Minghui Song , Zihan Zhang , Haizhen Huang , Weiwei Deng , Feng Sun , Qi Zhang

Retrieval-augmented code generation utilizes Large Language Models as the generator and significantly expands their code generation capabilities by providing relevant code, documentation, and more via the retriever. The current approach…

Software Engineering · Computer Science 2024-09-25 Xinyu Gao , Yun Xiong , Deze Wang , Zhenhan Guan , Zejian Shi , Haofen Wang , Shanshan Li

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

Retrieval-augmented language models can better adapt to changes in world state and incorporate long-tail knowledge. However, most existing methods retrieve only short contiguous chunks from a retrieval corpus, limiting holistic…

Computation and Language · Computer Science 2024-02-01 Parth Sarthi , Salman Abdullah , Aditi Tuli , Shubh Khanna , Anna Goldie , Christopher D. Manning

Recently, we have witnessed generative retrieval increasingly gaining attention in the information retrieval (IR) field, which retrieves documents by directly generating their identifiers. So far, much effort has been devoted to developing…

Information Retrieval · Computer Science 2023-06-23 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Wei Chen , Xueqi Cheng

Generative retrieval offers a promising alternative by unifying the fragmented multi-stage retrieval process into a single end-to-end model. However, its practical adoption in industrial e-commerce search remains challenging, given the…

Information Retrieval · Computer Science 2026-05-15 Jianbo Zhu , Xing Fang , Jing Wang , Mingmin Jin , Bokang Wang , Guangxin Song , Zhenyu Xie , Junjie Bai

Generative retrieval is a promising new paradigm in text retrieval that generates identifier strings of relevant passages as the retrieval target. This paradigm leverages powerful generative language models, distinct from traditional sparse…

Computation and Language · Computer Science 2024-02-19 Yongqi Li , Zhen Zhang , Wenjie Wang , Liqiang Nie , Wenjie Li , Tat-Seng Chua

Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user through inner product computation between the user and all item…

Generative retrieval models encode pointers to information in a corpus as an index within the model's parameters. These models serve as part of a larger pipeline, where retrieved information conditions generation for knowledge-intensive NLP…

Information Retrieval · Computer Science 2024-02-26 EuiYul Song , Sangryul Kim , Haeju Lee , Joonkee Kim , James Thorne

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu