English
Related papers

Related papers: ADMIT: Few-shot Knowledge Poisoning Attacks on RAG…

200 papers

When answering user queries, LLMs often retrieve knowledge from external sources stored in retrieval-augmented generation (RAG) databases. These are often populated from unvetted sources, e.g. the open web, and can contain maliciously…

Cryptography and Security · Computer Science 2026-03-27 Hao Wu , Prateek Saxena

Retrieval-Augmented Generation (RAG) mitigates LLM hallucinations but introduces a critical vulnerability: corpus integrity. We present SilentRetrieval, a two-stage data poisoning attack that hijacks RAG systems through adversarially…

Cryptography and Security · Computer Science 2026-05-28 Jiachen Qian

The indexing-retrieval-generation paradigm of retrieval-augmented generation (RAG) has been highly successful in solving knowledge-intensive tasks by integrating external knowledge into large language models (LLMs). However, the…

Cryptography and Security · Computer Science 2025-02-25 Xun Liang , Simin Niu , Zhiyu Li , Sensen Zhang , Hanyu Wang , Feiyu Xiong , Jason Zhaoxin Fan , Bo Tang , Shichao Song , Mengwei Wang , Jiawei Yang

Automated fact-checking (AFC) systems are susceptible to adversarial attacks, enabling false claims to evade detection. Existing adversarial frameworks typically rely on injecting noise or altering semantics, yet no existing framework…

Computation and Language · Computer Science 2026-01-26 João A. Leite , Olesya Razuvayevskaya , Kalina Bontcheva , Carolina Scarton

Retrieval-augmented generation (RAG) increasingly underpins high-stakes applications, yet remains vulnerable to Confundo-style poisoning where adversarially optimized documents manipulate generated outputs. Existing defenses assume that…

Cryptography and Security · Computer Science 2026-05-27 Zhe Yu , Wenpeng Xing , Gaolei Li , Shuguang Xiong , Hongzhi Wang , Xuyang Teng , Meng Han

Retrieval-Augmented Generation (RAG) systems based on Large Language Models (LLMs) have become essential for tasks such as question answering and content generation. However, their increasing impact on public opinion and information…

Computation and Language · Computer Science 2025-12-30 Yuyang Gong , Zhuo Chen , Jiawei Liu , Miaokun Chen , Fengchang Yu , Wei Lu , Xiaofeng Wang , Xiaozhong Liu

Retrieval Augmented Generation (RAG) expands the capabilities of modern large language models (LLMs), by anchoring, adapting, and personalizing their responses to the most relevant knowledge sources. It is particularly useful in chatbot…

Graph-based Retrieval-Augmented Generation (GraphRAG) has recently emerged as a promising paradigm for enhancing large language models (LLMs) by converting raw text into structured knowledge graphs, improving both accuracy and…

Computation and Language · Computer Science 2025-08-13 Jiayi Wen , Tianxin Chen , Zhirun Zheng , Cheng Huang

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge, making them adaptable and cost-effective for various applications. However, the growing reliance on these systems also…

Cryptography and Security · Computer Science 2024-10-31 Yucheng Zhang , Qinfeng Li , Tianyu Du , Xuhong Zhang , Xinkui Zhao , Zhengwen Feng , Jianwei Yin

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but its openness introduces vulnerabilities that can be exploited by poisoning attacks. Existing poisoning methods for RAG…

Cryptography and Security · Computer Science 2025-05-27 Chunyang Li , Junwei Zhang , Anda Cheng , Zhuo Ma , Xinghua Li , Jianfeng Ma

Retrieval-Augmented Generation (RAG) integrates external knowledge into large language models to improve response quality. However, recent work has shown that RAG systems are highly vulnerable to poisoning attacks, where malicious texts are…

Cryptography and Security · Computer Science 2025-10-21 Baolei Zhang , Haoran Xin , Yuxi Chen , Zhuqing Liu , Biao Yi , Tong Li , Lihai Nie , Zheli Liu , Minghong Fang

Retrieval-augmented generation (RAG) systems respond to queries by retrieving relevant documents from a knowledge database and applying an LLM to the retrieved documents. We demonstrate that RAG systems that operate on databases with…

Cryptography and Security · Computer Science 2025-03-11 Avital Shafran , Roei Schuster , Vitaly Shmatikov

State-of-the-art (SOTA) fact-checking systems combat misinformation by employing autonomous LLM-based agents to decompose complex claims into smaller sub-claims, verify each sub-claim individually, and aggregate the partial results to…

Cryptography and Security · Computer Science 2025-11-18 Haorui He , Yupeng Li , Bin Benjamin Zhu , Dacheng Wen , Reynold Cheng , Francis C. M. Lau

Large language models (LLMs) have gained widespread adoption across diverse applications due to their impressive generative capabilities. Their plug-and-play nature enables both developers and end users to interact with these models through…

Cryptography and Security · Computer Science 2025-10-21 Zongze Li , Jiawei Guo , Haipeng Cai

Retrieval-augmented generation (RAG) has become a common practice in multimodal large language models (MLLM) to enhance factual grounding and reduce hallucination. Yet, its reliance on retrieval exposes MLLMs to knowledge poisoning attacks,…

Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm to enhance large language models (LLMs) with external knowledge, reducing hallucinations and compensating for outdated information. However, recent studies have…

Information Retrieval · Computer Science 2026-01-01 Pankayaraj Pathmanathan , Michael-Andrei Panaitescu-Liess , Cho-Yu Jason Chiang , Furong Huang

Retrieval-Augmented Generation (RAG) has become a standard approach for improving the reliability of large language models (LLMs). Prior work demonstrates the vulnerability of RAG systems by misleading them into generating attacker-chosen…

Cryptography and Security · Computer Science 2025-08-28 Yanbo Dai , Zhenlan Ji , Zongjie Li , Kuan Li , Shuai Wang

Prompt injection attack, where an attacker injects a prompt into the original one, aiming to make an Large Language Model (LLM) follow the injected prompt to perform an attacker-chosen task, represent a critical security threat. Existing…

Cryptography and Security · Computer Science 2025-09-16 Zedian Shao , Hongbin Liu , Jaden Mu , Neil Zhenqiang Gong

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by retrieving relevant documents from external sources to improve factual accuracy and verifiability. However, this reliance introduces new attack surfaces within…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Saket S. Chaturvedi , Gaurav Bagwe , Lan Zhang , Xiaoyong Yuan