English
Related papers

Related papers: Cordon-MAS: Defending RAG against Knowledge Poison…

200 papers

Large language models (LLMs) are reshaping numerous facets of our daily lives, leading widespread adoption as web-based services. Despite their versatility, LLMs face notable challenges, such as generating hallucinated content and lacking…

Cryptography and Security · Computer Science 2025-11-04 Minseok Kim , Hankook Lee , Hyungjoon Koo

Retrieval-Augmented Generation (RAG) enhances Large Language Models by grounding their outputs in external documents. These systems, however, remain vulnerable to attacks on the retrieval corpus, such as prompt injection. RAG-based search…

Cryptography and Security · Computer Science 2026-02-17 Zeyu Shen , Basileal Imana , Tong Wu , Chong Xiang , Prateek Mittal , Aleksandra Korolova

With the growing adoption of retrieval-augmented generation (RAG) systems, various attack methods have been proposed to degrade their performance. However, most existing approaches rely on unrealistic assumptions in which external attackers…

Cryptography and Security · Computer Science 2025-10-31 Chanwoo Choi , Jinsoo Kim , Sukmin Cho , Soyeong Jeong , Buru Chang

Retrieval-Augmented Generation (RAG) systems extend large language models (LLMs) with external knowledge sources but introduce new attack surfaces through the retrieval pipeline. In particular, adversaries can poison retrieval corpora so…

Cryptography and Security · Computer Science 2026-03-20 Scott Thornton

Multimodal retrieval-augmented generation (RAG) enhances the visual reasoning capability of vision-language models (VLMs) by dynamically accessing information from external knowledge bases. In this work, we introduce \textit{Poisoned-MRAG},…

Cryptography and Security · Computer Science 2025-03-17 Yinuo Liu , Zenghui Yuan , Guiyao Tie , Jiawen Shi , Pan Zhou , Lichao Sun , Neil Zhenqiang Gong

Retrieval Augmented Generation (RAG) is a highly effective paradigm for keeping LLM-based responses up-to-date and reducing the likelihood of hallucinations. Yet, RAG was recently shown to be quite vulnerable to corpus knowledge poisoning:…

Information Retrieval · Computer Science 2026-02-06 Sagie Dekel , Moshe Tennenholtz , Oren Kurland

Retrieval-Augmented Generation (RAG) improves the reliability of large language model applications by grounding generation in retrieved evidence, but it also introduces a new attack surface: corpus poisoning. In this setting, an adversary…

Artificial Intelligence · Computer Science 2026-03-31 Xiangyu Yin , Yi Qi , Chih-Hong Cheng

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs), but simultaneously exposes a critical vulnerability to knowledge poisoning attacks. Existing attack methods like PoisonedRAG remain detectable due to…

Cryptography and Security · Computer Science 2026-04-10 Ziye Wang , Guanyu Wang , Kailong Wang

Standard Retrieval-Augmented Generation (RAG) systems predominantly rely on semantic relevance as a proxy for utility. However, this assumption collapses in realistic decision-making scenarios where user queries are laden with cognitive…

Computation and Language · Computer Science 2026-05-05 Peiyang Liu , Qiang Yan , Ziqiang Cui , Di Liang , Xi Wang , Wei Ye

Retrieval-Augmented Generation RAG systems enhance large language models by grounding responses in external knowledge bases, but conventional RAG architectures operate with static corpora that cannot evolve from user interactions. We…

Artificial Intelligence · Computer Science 2025-12-30 Teja Chinthala

Large language models (LLMs) have transformed natural language processing (NLP), enabling applications from content generation to decision support. Retrieval-Augmented Generation (RAG) improves LLMs by incorporating external knowledge but…

Cryptography and Security · Computer Science 2025-11-11 Zirui Cheng , Jikai Sun , Anjun Gao , Yueyang Quan , Zhuqing Liu , Xiaohua Hu , Minghong Fang

In Large Language Models, Retrieval-Augmented Generation (RAG) systems can significantly enhance the performance of large language models by integrating external knowledge. However, RAG also introduces new security risks. Existing research…

Machine Learning · Computer Science 2025-06-16 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

Retrieval-Augmented Generation (RAG) empowers Large Language Models (LLMs) to dynamically integrate external knowledge during inference, improving their factual accuracy and adaptability. However, adversaries can inject poisoned external…

Artificial Intelligence · Computer Science 2026-01-13 Hanyu Zhu , Lance Fiondella , Jiawei Yuan , Kai Zeng , Long Jiao

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but its openness introduces vulnerabilities that can be exploited by poisoning attacks. Existing poisoning methods for RAG…

Cryptography and Security · Computer Science 2025-05-27 Chunyang Li , Junwei Zhang , Anda Cheng , Zhuo Ma , Xinghua Li , Jianfeng Ma

Introducing reasoning models into Retrieval-Augmented Generation (RAG) systems enhances task performance through step-by-step reasoning, logical consistency, and multi-step self-verification. However, recent studies have shown that…

Cryptography and Security · Computer Science 2026-01-21 Xiaolei Zhang , Xiaojun Jia , Liquan Chen , Songze Li

Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowledge during generation. However, the underlying retrieval databases may naturally contain,…

Cryptography and Security · Computer Science 2026-05-12 Peiru Yang , Haoran Zheng , Tong Ju , Shiting Wang , Wanchun Ni , Jiajun Liu , Shangguang Wang , Yongfeng Huang , Tao Qi

Retrieval-augmented generation (RAG) improves performance on knowledge-intensive tasks but can be derailed by wrong, irrelevant, or conflicting retrieved text, causing models to rely on inaccurate evidence and cascade errors. We propose…

Computation and Language · Computer Science 2026-02-26 Chenyu Lin , Yilin Wen , Du Su , Hexiang Tan , Fei Sun , Muhan Chen , Chenfu Bao , Zhonghou Lyu

Retrieval-augmented generation (RAG) systems are vulnerable to attacks that inject poisoned passages into the retrieved context, even at low corruption rates. We show that existing attacks are not designed to be stealthy, allowing reliable…

Cryptography and Security · Computer Science 2026-05-25 Sarthak Choudhary , Nils Palumbo , Ashish Hooda , Krishnamurthy Dj Dvijotham , Somesh Jha

Retrieval-augmented generation (RAG) enhances large language model (LLM) reasoning by retrieving external documents, but also opens up new attack surfaces. We study knowledge-base poisoning attacks in RAG, where an attacker injects…

Information Retrieval · Computer Science 2026-04-15 Hongru Song , Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Retrieval-augmented generation (RAG) has emerged as a popular solution to mitigate the hallucination issues of large language models. However, existing studies on RAG seldom address the issue of predictive uncertainty, i.e., how likely it…

Computation and Language · Computer Science 2024-12-05 Lu Chen , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng