English
Related papers

Related papers: Cordon-MAS: Defending RAG against Knowledge Poison…

200 papers

Retrieval-Augmented Generation (RAG) systems deployed over proprietary knowledge bases face growing threats from reconstruction attacks that aggregate model responses to replicate knowledge bases. Such attacks exploit both intra-class and…

Artificial Intelligence · Computer Science 2025-11-14 Qinfeng Li , Miao Pan , Ke Xiong , Ge Su , Zhiqiang Shen , Yan Liu , Bing Sun , Hao Peng , Xuhong Zhang

This study presents Poison-RAG, a framework for adversarial data poisoning attacks targeting retrieval-augmented generation (RAG)-based recommender systems. Poison-RAG manipulates item metadata, such as tags and descriptions, to influence…

Information Retrieval · Computer Science 2025-01-22 Fatemeh Nazary , Yashar Deldjoo , Tommaso di Noia

Stealing attacks pose a persistent threat to the intellectual property of deployed machine-learning systems. Retrieval-augmented generation (RAG) intensifies this risk by extending the attack surface beyond model weights to knowledge base…

Cryptography and Security · Computer Science 2026-02-06 Mengyu Yao , Ziqi Zhang , Ning Luo , Shaofei Li , Yifeng Cai , Xiangqun Chen , Yao Guo , Ding Li

Retrieval-Augmented Generation (RAG) systems remain brittle under realistic retrieval noise, even when the required evidence appears in the top-K results. A key reason is that retrievers and rerankers optimize solely for relevance, often…

The widespread adoption of Retrieval-Augmented Generation (RAG) systems in real-world applications has heightened concerns about the confidentiality and integrity of their proprietary knowledge bases. These knowledge bases, which play a…

Cryptography and Security · Computer Science 2025-03-21 Pengcheng Zhou , Yinglun Feng , Zhongliang Yang

Retrieval Augmented Generation (RAG) is a technique commonly used to equip models with out of distribution knowledge. This process involves collecting, indexing, retrieving, and providing information to an LLM for generating responses.…

Cryptography and Security · Computer Science 2024-08-13 Gianluca De Stefano , Lea Schönherr , Giancarlo Pellegrino

In sensitive domains, Retrieval-Augmented Generation (RAG) must be interpretable and robust because errors do not just mislead, they invite lawsuits, undermine scholarly credibility, and breach compliance. Stakeholders require traceable…

Computation and Language · Computer Science 2026-01-21 Yash Saxena , Ankur Padia , Mandar S Chaudhary , Kalpa Gunaratna , Srinivasan Parthasarathy , Manas Gaur

Retrieval-Augmented Generation (RAG) compensates for the static knowledge limitations of Large Language Models (LLMs) by integrating external knowledge, producing responses with enhanced factual correctness and query-specific…

Computation and Language · Computer Science 2025-05-21 Ruobing Yao , Yifei Zhang , Shuang Song , Neng Gao , Chenyang Tu

Large language models (LLMs) have achieved remarkable success in various domains, primarily due to their strong capabilities in reasoning and generating human-like text. Despite their impressive performance, LLMs are susceptible to…

Cryptography and Security · Computer Science 2025-05-13 Yangguang Shao , Xinjie Lin , Haozheng Luo , Chengshang Hou , Gang Xiong , Jiahao Yu , Junzheng Shi

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user queries. These systems, however, remain…

Computation and Language · Computer Science 2025-05-26 Huichi Zhou , Kin-Hei Lee , Zhonghao Zhan , Yue Chen , Zhenhao Li , Zhaoyang Wang , Hamed Haddadi , Emine Yilmaz

Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by retrieving relevant documents from external corpora before generating responses. This approach significantly expands LLM capabilities by leveraging vast,…

Cryptography and Security · Computer Science 2025-11-13 Haowei Wang , Rupeng Zhang , Junjie Wang , Mingyang Li , Yuekai Huang , Dandan Wang , Qing Wang

Despite significant advancements, large language models (LLMs) still struggle with providing accurate answers when lacking domain-specific or up-to-date knowledge. Retrieval-Augmented Generation (RAG) addresses this limitation by…

Cryptography and Security · Computer Science 2025-04-01 Yuefeng Peng , Junda Wang , Hong Yu , Amir Houmansadr

Retrieval-augmented generation (RAG) is vulnerable to prompt injection attacks, in which an adversary inserts malicious documents containing carefully crafted injected prompts into the knowledge database. When a user issues a question…

Cryptography and Security · Computer Science 2026-05-04 Weifei Jin , Xilong Wang , Wei Zou , Jinyuan Jia , Neil Gong

Presently, with the assistance of advanced LLM application development frameworks, more and more LLM-powered applications can effortlessly augment the LLMs' knowledge with external content using the retrieval augmented generation (RAG)…

Cryptography and Security · Computer Science 2024-04-29 Quan Zhang , Binqi Zeng , Chijin Zhou , Gwihwan Go , Heyuan Shi , Yu Jiang

Retrieval-augmented generation (RAG) systems trained using reinforcement learning (RL) with reasoning are hampered by inefficient context management, where long, noisy retrieved documents increase costs and degrade performance. We introduce…

Computation and Language · Computer Science 2025-10-14 Zhichao Xu , Minheng Wang , Yawei Wang , Wenqian Ye , Yuntao Du , Yunpu Ma , Yijun Tian

Retrieval-augmented generation (RAG) improves large language model reliability by grounding generated responses in external evidence. However, RAG performance depends on the relevance of retrieved passages, the quality of evidence ranking,…

Information Retrieval · Computer Science 2026-05-05 Fariba Afrin Irany , Sampson Akwafuo

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) are constrained by outdated information and a tendency to generate incorrect data, commonly referred to as "hallucinations." Retrieval-Augmented Generation (RAG) addresses these limitations by combining the…

Cryptography and Security · Computer Science 2024-06-07 Jiaqi Xue , Mengxin Zheng , Yebowen Hu , Fei Liu , Xun Chen , Qian Lou

Recent work in open-domain question answering (ODQA) has shown that adversarial poisoning of the search collection can cause large drops in accuracy for production systems. However, little to no work has proposed methods to defend against…

Computation and Language · Computer Science 2024-02-28 Orion Weller , Aleem Khan , Nathaniel Weir , Dawn Lawrie , Benjamin Van Durme

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

Computation and Language · Computer Science 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald