English
Related papers

Related papers: Joint-GCG: Unified Gradient-Based Poisoning Attack…

200 papers

Retrieval-augmented generation (RAG) systems put more and more emphasis on grounding their responses in user-generated content found on the Web, amplifying both their usefulness and their attack surface. Most notably, indirect prompt…

Cryptography and Security · Computer Science 2026-01-22 Haoze Guo , Ziqi Wei

The paradigm of retrieval-augmented generated (RAG) helps mitigate hallucinations of large language models (LLMs). However, RAG also introduces biases contained within the retrieved documents. These biases can be amplified in scenarios…

Computation and Language · Computer Science 2025-06-24 Bryan Li , Fiona Luo , Samar Haider , Adwait Agashe , Tammy Li , Runqi Liu , Muqing Miao , Shriya Ramakrishnan , Yuan Yuan , Chris Callison-Burch

Existing Retrieval-Augmented Generation (RAG) systems face challenges in enterprise settings due to limited retrieval scope and data security risks. When relevant internal documents are unavailable, the system struggles to generate accurate…

Computation and Language · Computer Science 2025-07-18 Grace Byun , Shinsun Lee , Nayoung Choi , Jinho D. Choi

The growing adoption of Retrieval-Augmented Generation (RAG) has led to a rise in adversarial attacks. Existing defenses, relying on semantic analysis or voting, face a trade-off between high computational cost and limited robustness under…

Cryptography and Security · Computer Science 2026-05-20 Chengcai Gao , Zhihong Sun , Xiaochuan Shi , Qiufeng Wang , Chao Liang

The growing ubiquity of Retrieval-Augmented Generation (RAG) systems in several real-world services triggers severe concerns about their security. A RAG system improves the generative capabilities of a Large Language Models (LLM) by a…

Artificial Intelligence · Computer Science 2024-12-31 Christian Di Maio , Cristian Cosci , Marco Maggini , Valentina Poggioni , Stefano Melacci

Retrieval-augmented generation (RAG) is increasingly deployed in real-world applications, where its reference-grounded design makes outputs appear trustworthy. This trust has spurred research on poisoning attacks that craft malicious…

Cryptography and Security · Computer Science 2026-02-09 Haoyang Hu , Zhejun Jiang , Yueming Lyu , Junyuan Zhang , Yi Liu , Ka-Ho Chow

Retrieval-augmented generation (RAG) enhances large language model (LLM) reasoning by retrieving external documents, but also opens up new attack surfaces. We study knowledge-base poisoning attacks in RAG, where an attacker injects…

Information Retrieval · Computer Science 2026-04-15 Hongru Song , Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model with proprietary and private data, where data privacy is a pivotal concern. Whereas extensive research has demonstrated the privacy risks of large…

Cryptography and Security · Computer Science 2024-03-03 Shenglai Zeng , Jiankun Zhang , Pengfei He , Yue Xing , Yiding Liu , Han Xu , Jie Ren , Shuaiqiang Wang , Dawei Yin , Yi Chang , Jiliang Tang

Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information…

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external, domain-specific data into the generative process. While LLMs are highly capable, they often rely on static, pre-trained datasets, limiting…

Artificial Intelligence · Computer Science 2024-12-10 Aniruddha Salve , Saba Attar , Mahesh Deshmukh , Sayali Shivpuje , Arnab Mitra Utsab

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

Computation and Language · Computer Science 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

This paper presents a comprehensive study of Retrieval-Augmented Generation (RAG), tracing its evolution from foundational concepts to the current state of the art. RAG combines retrieval mechanisms with generative language models to…

Computation and Language · Computer Science 2024-10-18 Shailja Gupta , Rajesh Ranjan , Surya Narayan Singh

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu

Retrieval-Augmented Generation (RAG) integrates external knowledge into large language models to improve response quality. However, recent work has shown that RAG systems are highly vulnerable to poisoning attacks, where malicious texts are…

Cryptography and Security · Computer Science 2025-10-21 Baolei Zhang , Haoran Xin , Yuxi Chen , Zhuqing Liu , Biao Yi , Tong Li , Lihai Nie , Zheli Liu , Minghong Fang

Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge bases, but this advancement introduces significant privacy risks. Existing privacy attacks on RAG systems can trigger data…

Cryptography and Security · Computer Science 2025-11-25 Yufei Chen , Yao Wang , Haibin Zhang , Tao Gu

Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines…

Information Retrieval · Computer Science 2025-08-26 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Retrieval-augmented generation (RAG) is instrumental for inhibiting hallucinations in large language models (LLMs) through the use of a factual knowledge base (KB). Although PDF documents are prominent sources of knowledge, text-based RAG…

Computation and Language · Computer Science 2026-04-03 Ezzeldin Shereen , Dan Ristea , Shae McFadden , Burak Hasircioglu , Vasilios Mavroudis , Chris Hicks

Retrieval-augmented generation (RAG) improves factual grounding by conditioning large language models on retrieved evidence, but it also opens a data-layer attack surface: poisoned corpus entries can steer outputs without changing model…

Cryptography and Security · Computer Science 2026-05-05 Huining Cui , Wei Liu

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

Information Retrieval · Computer Science 2024-11-20 Sonal Prabhune , Donald J. Berndt

Retrieval-Augmented Generation (RAG) has emerged as a key paradigm for enhancing large language models (LLMs) by incorporating external knowledge. However, current RAG methods face two limitations: (1) they only cover limited RAG scenarios.…

Computation and Language · Computer Science 2025-01-03 Wanlong Liu , Junying Chen , Ke Ji , Li Zhou , Wenyu Chen , Benyou Wang