English
Related papers

Related papers: FORGE: Forming Semantic Identifiers for Generative…

200 papers

Retrieval-Augmented Generation (RAG) improves reliability of large language models by incorporating external knowledge, but the retrieval process can introduce bias that propagates to generated outputs. This issue is particularly…

Databases · Computer Science 2026-05-18 Yingqi Zhao , Vasilis Efthymiou , Jyrki Nummenmaa , Kostas Stefanidis

Retrieval-Augmented Generation (RAG) has been proposed to mitigate hallucinations in large language models (LLMs), where generated outputs may be factually incorrect. However, existing RAG approaches predominantly rely on vector similarity…

Information Retrieval · Computer Science 2026-04-28 Miao Xie , Xiao Zhang , Yi Li , Chunli Lv

Generative retrieval represents a novel approach to information retrieval. It uses an encoder-decoder architecture to directly produce relevant document identifiers (docids) for queries. While this method offers benefits, current approaches…

Information Retrieval · Computer Science 2024-09-30 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Xueqi Cheng

Retrieval-augmented generation (RAG) grounds large language models with external evidence, but under a limited context budget, the key challenge is deciding which retrieved passages should be injected. We show that retrieval relevance…

Computation and Language · Computer Science 2026-01-27 Zhipeng Song , Yizhi Zhou , Xiangyu Kong , Jiulong Jiao , Xinrui Bao , Xu You , Xueqing Shi , Yuhang Zhou , Heng Qi

This paper introduces PAG-a novel optimization and decoding approach that guides autoregressive generation of document identifiers in generative retrieval models through simultaneous decoding. To this aim, PAG constructs a set-based and…

Information Retrieval · Computer Science 2024-04-24 Hansi Zeng , Chen Luo , Hamed Zamani

Binary analysis increasingly relies on large language models (LLMs) to perform semantic reasoning over complex program behaviors. However, existing approaches largely adopt a one-pass execution paradigm, where reasoning operates over a…

Cryptography and Security · Computer Science 2026-04-17 XiangRui Zhang , Qiang Li , Haining Wang

Recent advances in diffusion models have revolutionized generative AI, but their sheer size makes on device personalization, and thus effective federated learning (FL), infeasible. We propose Shared Backbone Personal Identity Representation…

Machine Learning · Computer Science 2025-06-17 Kaan Ozkara , Ruida Zhou , Suhas Diggavi

In multi-stage recommender systems, reranking optimizes overall utility by capturing intra-list contextual dependencies, yet its central challenge lies in exploring optimal sequences within an exponentially large permutation space. Recent…

Information Retrieval · Computer Science 2026-05-26 Chaotian Song , Jingyao Zhang , Chenghao Chen , Zisen Sang , Dehai Zhao , Guodong Cao , Boxi Wu , Deng Cai , Jia Jia

Retrieval-Augmented Generation (RAG) improves the accuracy and relevance of large language model outputs by incorporating knowledge retrieval. However, implementing RAG in enterprises poses challenges around data security, accuracy,…

Software Engineering · Computer Science 2024-06-10 Tilmann Bruckhaus

Large Language Models (LLMs) achieve strong performance across diverse tasks, but their effectiveness often depends on the quality of the provided context. Retrieval-Augmented Generation (RAG) enriches prompts with external information, but…

Computation and Language · Computer Science 2025-10-02 Oussama Gabouj , Kamel Charaf , Ivan Zakazov , Nicolas Baldwin , Robert West

The development of generative large language models (G-LLM) opened up new opportunities for the development of new types of knowledge-based systems similar to ChatGPT, Bing, or Gemini. Fine-tuning (FN) and Retrieval-Augmented Generation…

Computation and Language · Computer Science 2025-05-13 Robert Lakatos , Peter Pollner , Andras Hajdu , Tamas Joo

Despite notable advancements in Retrieval-Augmented Generation (RAG) systems that expand large language model (LLM) capabilities through external retrieval, these systems often struggle to meet the complex and diverse needs of real-world…

Computation and Language · Computer Science 2025-03-13 Jinyu Wang , Jingjing Fu , Rui Wang , Lei Song , Jiang Bian

Retrieval-Augmented Generation (RAG) systems remain brittle under realistic retrieval noise, even when the required evidence appears in the top-K results. A key reason is that retrievers and rerankers optimize solely for relevance, often…

The banking sector faces challenges in using deep learning due to data sensitivity and regulatory constraints, but generative AI may offer a solution. Thus, this study identifies effective algorithms for generating synthetic financial…

Machine Learning · Computer Science 2024-12-20 Fabian Sven Karst , Sook-Yee Chong , Abigail A. Antenor , Enyu Lin , Mahei Manhai Li , Jan Marco Leimeister

High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory and copyright constraints. This scarcity hampers model development--ironically, in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xuemei Jia , Jiawei Du , Hui Wei , Jun Chen , Joey Tianyi Zhou , Zheng Wang

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

Information Retrieval · Computer Science 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

We introduce EncouRAGe, a comprehensive Python framework designed to streamline the development and evaluation of Retrieval-Augmented Generation (RAG) systems using Large Language Models (LLMs) and Embedding Models. EncouRAGe comprises five…

Computation and Language · Computer Science 2025-11-10 Jan Strich , Adeline Scharfenberg , Chris Biemann , Martin Semmann

Retrieval-Augmented Generation (RAG) helps large language models (LLMs) answer knowledge-intensive and time-sensitive questions by conditioning generation on external evidence. However, most RAG systems still retrieve unstructured chunks…

Computation and Language · Computer Science 2026-03-11 Jiashuo Sun , Yixuan Xie , Jimeng Shi , Shaowen Wang , Jiawei Han

Generative Recommendation has revolutionized recommender systems by reformulating retrieval as a sequence generation task over discrete item identifiers. Despite the progress, existing approaches typically rely on static, decoupled…

Information Retrieval · Computer Science 2026-02-10 Huanjie Wang , Xinchen Luo , Honghui Bao , Zhang Zixing , Lejian Ren , Yunfan Wu , Hongwei Zhang , Liwei Guan , Guang Chen

Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user through inner product computation between the user and all item…