English
Related papers

Related papers: Cordon-MAS: Defending RAG against Knowledge Poison…

200 papers

Retrieval-Augmented Generation (RAG) systems enhance response credibility and traceability by displaying reference contexts, but this transparency simultaneously introduces a novel black-box attack vector. Existing document poisoning…

Computation and Language · Computer Science 2026-01-27 Runqi Sui

Retrieval-augmented generation (RAG) grounds large language models with external evidence, but under a limited context budget, the key challenge is deciding which retrieved passages should be injected. We show that retrieval relevance…

Computation and Language · Computer Science 2026-01-27 Zhipeng Song , Yizhi Zhou , Xiangyu Kong , Jiulong Jiao , Xinrui Bao , Xu You , Xueqing Shi , Yuhang Zhou , Heng Qi

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating their parametric knowledge with external retrieved content. However, knowledge conflicts caused by internal inconsistencies or noisy retrieved content…

Computation and Language · Computer Science 2025-07-03 Juan Chen , Baolong Bi , Wei Zhang , Jingyan Sui , Xiaofei Zhu , Yuanzhuo Wang , Lingrui Mei , Shenghua Liu

Retrieval-augmented generation (RAG) systems are widely deployed in real-world applications in diverse domains such as finance, healthcare, and cybersecurity. However, many studies showed that they are vulnerable to knowledge corruption…

Cryptography and Security · Computer Science 2025-08-27 Runpeng Geng , Yanting Wang , Ying Chen , Jinyuan Jia

Retrieval-augmented generation (RAG) is susceptible to retrieval corruption attacks, where malicious passages injected into retrieval results can lead to inaccurate model responses. We propose RobustRAG, the first defense framework with…

Machine Learning · Computer Science 2026-04-02 Chong Xiang , Tong Wu , Zexuan Zhong , David Wagner , Danqi Chen , Prateek Mittal

Retrieval-augmented generation (RAG) systems respond to queries by retrieving relevant documents from a knowledge database and applying an LLM to the retrieved documents. We demonstrate that RAG systems that operate on databases with…

Cryptography and Security · Computer Science 2025-03-11 Avital Shafran , Roei Schuster , Vitaly Shmatikov

Retrieval-Augmented Generation (RAG) has become a cornerstone of knowledge-intensive applications, including enterprise chatbots, healthcare assistants, and agentic memory management. However, recent studies show that knowledge-extraction…

Cryptography and Security · Computer Science 2026-02-13 Zhisheng Qi , Utkarsh Sahu , Li Ma , Haoyu Han , Ryan Rossi , Franck Dernoncourt , Mahantesh Halappanavar , Nesreen Ahmed , Yushun Dong , Yue Zhao , Yu Zhang , Yu Wang

Retrieval-Augmented Generation (RAG) significantly mitigates the hallucinations and domain knowledge deficiency in large language models by incorporating external knowledge bases. However, the multi-module architecture of RAG introduces…

Cryptography and Security · Computer Science 2026-03-24 Yanming Mu , Hao Hu , Feiyang Li , Qiao Yuan , Jiang Wu , Zichuan Liu , Pengcheng Liu , Mei Wang , Hongwei Zhou , Yuling Liu

Retrieval-augmented generation (RAG) has proven effective for knowledge-intensive tasks, but is widely believed to offer limited benefit for reasoning-intensive problems such as math and code generation. We challenge this assumption by…

Information Retrieval · Computer Science 2026-05-06 Negar Arabzadeh , Wenjie Ma , Sewon Min , Matei Zaharia

Retrieval-Augmented Generation (RAG) systems, widely used to improve the factual grounding of large language models (LLMs), are increasingly vulnerable to poisoning attacks, where adversaries inject manipulated content into the retriever's…

Information Retrieval · Computer Science 2025-06-04 Liuji Chen , Xiaofang Yang , Yuanzhuo Lu , Jinghao Zhang , Xin Sun , Qiang Liu , Shu Wu , Jing Dong , Liang Wang

Retrieval-Augmented Generation (RAG) has become a powerful and widely used approach for improving large language models by grounding generation in retrieved evidence. However, RAG systems still produce incorrect answers in many cases. Why…

Computation and Language · Computer Science 2026-05-15 Kai Guo , Xinnan Dai , Zhibo Zhang , Nuohan Lin , Shenglai Zeng , Jie Ren , Haoyu Han , Jiliang Tang

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of applications, e.g., medical question-answering, mathematical sciences, and code generation. However, they also exhibit inherent limitations, such…

Cryptography and Security · Computer Science 2025-06-23 Yang Jiao , Xiaodong Wang , Kai Yang

Retrieval-Augmented Generation (RAG) mitigates LLM hallucinations but introduces a critical vulnerability: corpus integrity. We present SilentRetrieval, a two-stage data poisoning attack that hijacks RAG systems through adversarially…

Cryptography and Security · Computer Science 2026-05-28 Jiachen Qian

Retrieval-Augmented Generation (RAG) has become a standard approach for improving the reliability of large language models (LLMs). Prior work demonstrates the vulnerability of RAG systems by misleading them into generating attacker-chosen…

Cryptography and Security · Computer Science 2025-08-28 Yanbo Dai , Zhenlan Ji , Zongjie Li , Kuan Li , Shuai Wang

Large language model (LLM) agents are increasingly employing retrieval-augmented generation (RAG) to improve the factuality of their responses. However, in practice, these systems often need to handle ambiguous user queries and potentially…

Computation and Language · Computer Science 2025-08-13 Han Wang , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by providing external knowledge for accurate and up-to-date responses. However, this reliance on external sources exposes a security risk, attackers can inject…

Computation and Language · Computer Science 2025-07-25 San Kim , Jonghwi Kim , Yejin Jeon , Gary Geunbae Lee

Tax authorities and public-sector financial agencies rely on large volumes of unstructured and semi-structured fiscal documents - including tax forms, instructions, publications, and jurisdiction-specific guidance - to support compliance…

Information Retrieval · Computer Science 2026-03-17 Akhil Chandra Shanivendra

The Context-Compliance Regime in Retrieval-Augmented Generation (RAG) occurs when retrieved context dominates the final answer even when it conflicts with the model's parametric knowledge. Accuracy alone does not reveal how retrieved…

Computation and Language · Computer Science 2026-05-27 Yihang Chen , Pin Qian , Su Wang , Sipeng Zhang , Huan Xu , Shuhuai Lin , Xinpeng Wei

Retrieval-Augmented Generation (RAG) has become a core paradigm for enhancing factual grounding and multi-hop reasoning in Large Language Models (LLMs). Traditional text-based RAG often retrieves logically irrelevant pseudo-evidence, while…

Artificial Intelligence · Computer Science 2026-05-08 Jiarui Zhong , Hong Cai Chen

Retrieval-Augmented Generation (RAG) systems based on Large Language Models (LLMs) have become a core technology for tasks such as question-answering (QA) and content generation. RAG poisoning is an attack method to induce LLMs to generate…

Artificial Intelligence · Computer Science 2026-01-13 Meng Xi , Sihan Lv , Yechen Jin , Guanjie Cheng , Naibo Wang , Ying Li , Jianwei Yin