English
Related papers

Related papers: Planning Ahead in Generative Retrieval: Guiding Au…

200 papers

Generative Retrieval introduces a new approach to Information Retrieval by reframing it as a constrained generation task, leveraging recent advancements in Autoregressive (AR) language models. However, AR-based Generative Retrieval methods…

Computation and Language · Computer Science 2024-06-12 Ravisri Valluri , Akash Kumar Mohankumar , Kushal Dave , Amit Singh , Jian Jiao , Manik Varma , Gaurav Sinha

Information Retrieval (IR) systems are crucial tools for users to access information, which have long been dominated by traditional methods relying on similarity matching. With the advancement of pre-trained language models, generative…

Information Retrieval · Computer Science 2025-03-05 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yuyao Zhang , Peitian Zhang , Yutao Zhu , Zhicheng Dou

Generative retrieval (Wang et al., 2022; Tay et al., 2022) is a popular approach for end-to-end document retrieval that directly generates document identifiers given an input query. We introduce summarization-based document IDs, in which…

Computation and Language · Computer Science 2024-10-31 Haoxin Li , Daniel Cheng , Phillip Keung , Jungo Kasai , Noah A. Smith

Legal document retrieval and judgment prediction are crucial tasks in intelligent legal systems. In practice, determining whether two documents share the same judgments is essential for establishing their relevance in legal retrieval.…

Information Retrieval · Computer Science 2024-04-16 Weicong Qin , Zelin Cao , Weijie Yu , Zihua Si , Sirui Chen , Jun Xu

Generative Information Retrieval is an emerging retrieval paradigm that exhibits remarkable performance in monolingual scenarios.However, applying these methods to multilingual retrieval still encounters two primary challenges,…

Computation and Language · Computer Science 2025-10-10 Yuxin Huang , Simeng Wu , Ran Song , Yan Xiang , Yantuan Xian , Shengxiang Gao , Zhengtao Yu

Retrieval-augmented generation (RAG) improves the response quality of large language models (LLMs) by retrieving knowledge from external databases. Typical RAG approaches split the text database into chunks, organizing them in a flat…

Computation and Language · Computer Science 2025-11-18 Boyu Chen , Zirui Guo , Zidan Yang , Yuluo Chen , Junze Chen , Zhenghao Liu , Chuan Shi , Cheng Yang

Retrieval-Augmented Generation (RAG) has become a pivotal paradigm for Large Language Models (LLMs), yet current approaches struggle with visually rich documents by treating text and images as isolated retrieval targets. Existing methods…

Computation and Language · Computer Science 2026-01-13 Xuan Li , Yining Wang , Haocai Luo , Shengping Liu , Jerry Liang , Ying Fu , Weihuang , Jun Yu , Junnan Zhu

Retrieval in Retrieval-Augmented Generation(RAG) must ensure that retrieved passages are not only individually relevant but also collectively form a comprehensive set. Existing approaches primarily rerank top-k passages based on their…

Computation and Language · Computer Science 2025-07-11 Dahyun Lee , Yongrae Jo , Haeju Park , Moontae Lee

Retrieval-Augmented Generation enhances language models by retrieving external knowledge to support informed and grounded responses. However, traditional RAG methods rely on fragment-level retrieval, limiting their ability to address…

Information Retrieval · Computer Science 2026-05-05 Wenbiao Tao , Xinyuan Li , Yunshi Lan , Weining Qian

Generative recommendation (GR) typically first quantizes continuous item embeddings into multi-level semantic IDs (SIDs), and then generates the next item via autoregressive decoding. Although existing methods are already competitive in…

Information Retrieval · Computer Science 2026-01-30 Lingyu Mu , Hao Deng , Haibo Xing , Jinxin Hu , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Autoregressive models for text sometimes generate repetitive and low-quality output because errors accumulate during the steps of generation. This issue is often attributed to exposure bias - the difference between how a model is trained,…

Computation and Language · Computer Science 2024-03-26 Yizhe Zhang , Jiatao Gu , Zhuofeng Wu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Generative information retrieval, encompassing two major tasks of Generative Document Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention in the area of information retrieval and natural language…

Information Retrieval · Computer Science 2023-12-19 Xiaoxi Li , Yujia Zhou , Zhicheng Dou

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

In the rapidly changing world of smart technology, searching for documents has become more challenging due to the rise of advanced language models. These models sometimes face difficulties, like providing inaccurate information, commonly…

Information Retrieval · Computer Science 2025-03-20 Julien Pierre Edmond Ghali , Kosuke Shima , Koichi Moriyama , Atsuko Mutoh , Nobuhiro Inuzuka

Autoregressive Model (AR) has shown remarkable success in conditional image generation. However, these approaches for multiple reference generation struggle with decoupling different reference identities. In this work, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Haiyue Sun , Qingdong He , Jinlong Peng , Peng Tang , Jiangning Zhang , Junwei Zhu , Xiaobin Hu , Shuicheng Yan

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-Augmented Generation (RAG) has demonstrated strong effectiveness in knowledge-intensive tasks by grounding language generation in external evidence. Despite its success, many existing RAG systems are built based on a…

Computation and Language · Computer Science 2026-04-27 Lichang Song , Ting Long , Yi Chang

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

Generative retrieval, a promising new paradigm in information retrieval, employs a seq2seq model to encode document features into parameters and decode relevant document identifiers (IDs) based on search queries. Existing generative…

Information Retrieval · Computer Science 2024-05-24 Yuxuan Liu , Tianchi Yang , Zihan Zhang , Minghui Song , Haizhen Huang , Weiwei Deng , Feng Sun , Qi Zhang