English
Related papers

Related papers: Do Multimodal RAG Systems Leak Data? A Comprehensi…

200 papers

The emergence of Multimodal Large Language Models (MLLMs) and the widespread usage of MLLM cloud services such as GPT-4V raised great concerns about privacy leakage in visual data. As these models are typically deployed in cloud services,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaofei Hui , Qian Wu , Haoxuan Qu , Majid Mirmehdi , Hossein Rahmani , Jun Liu

Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge bases, but this advancement introduces significant privacy risks. Existing privacy attacks on RAG systems can trigger data…

Cryptography and Security · Computer Science 2025-11-25 Yufei Chen , Yao Wang , Haibin Zhang , Tao Gu

Retrieval-augmented generation (RAG) has recently emerged as a promising solution for incorporating up-to-date or domain-specific knowledge into large language models (LLMs) and improving LLM factuality, but is predominantly studied in…

Computation and Language · Computer Science 2024-07-02 Nadezhda Chirkova , David Rau , Hervé Déjean , Thibault Formal , Stéphane Clinchant , Vassilina Nikoulina

Federated learning frameworks typically require collaborators to share their local gradient updates of a common model instead of sharing training data to preserve privacy. However, prior works on Gradient Leakage Attacks showed that private…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jiahao Lu , Xi Sheryl Zhang , Tianli Zhao , Xiangyu He , Jian Cheng

Retrieval-Augmented Generation (RAG) technology has been widely applied in recent years. However, despite the emergence of various RAG frameworks, a single RAG framework still cannot adapt well to a broad range of downstream tasks.…

Artificial Intelligence · Computer Science 2025-08-20 Yifei Chen , Guanting Dong , Yutao Zhu , Zhicheng Dou

With the growing prevalence of always-on hardware such as smart glasses, body cameras, and home security systems, life-logging visual sensing is becoming inevitable, forming the backbone of persistent, always-on AI systems. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tianyuan Zou , Liang Yue , Yang Liu , Ya-Qin Zhang , Sijie Cheng

Retrieval-Augmented Generation (RAG) systems, which integrate Large Language Models (LLMs) with external knowledge sources, are vulnerable to a range of adversarial attack vectors. This paper examines the importance of RAG systems through…

Cryptography and Security · Computer Science 2025-06-03 Chris M. Ward , Josh Harguess

Retrieval-Augmented Generation (RAG) improves pre-trained models by incorporating external knowledge at test time to enable customized adaptation. We study the risk of datastore leakage in Retrieval-In-Context RAG Language Models (LMs). We…

Computation and Language · Computer Science 2024-10-08 Zhenting Qi , Hanlin Zhang , Eric Xing , Sham Kakade , Himabindu Lakkaraju

While language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring huge computational costs. Recently,…

Computation and Language · Computer Science 2022-10-21 Wenhu Chen , Hexiang Hu , Xi Chen , Pat Verga , William W. Cohen

Retrieval-Augmented Generation (RAG) systems based on Large Language Models (LLMs) have become essential for tasks such as question answering and content generation. However, their increasing impact on public opinion and information…

Computation and Language · Computer Science 2025-12-30 Yuyang Gong , Zhuo Chen , Jiawei Liu , Miaokun Chen , Fengchang Yu , Wei Lu , Xiaofeng Wang , Xiaozhong Liu

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

RAG has emerged as a key technique for enhancing response quality of LLMs without high computational cost. In traditional architectures, RAG services are provided by a single entity that hosts the dataset within a trusted local environment.…

Cryptography and Security · Computer Science 2026-01-21 Huanyi Ye , Jiale Guo , Ziyao Liu , Kwok-Yan Lam

As Retrieval-Augmented Generation (RAG) evolves into service-oriented platforms (Rag-as-a-Service) with shared knowledge bases, protecting the copyright of contributed data becomes essential. Existing watermarking methods in RAG focus…

Cryptography and Security · Computer Science 2026-03-03 Tianyu Chen , Jian Lou , Wenjie Wang

Retrieval-Augmented Generation (RAG) enhances LLMs by grounding generation in query-relevant external evidence. Beyond unstructured text corpora, Graph RAG integrates knowledge graphs into the retrieval pipeline, enabling LLMs to access…

Cryptography and Security · Computer Science 2026-05-28 Jinze Gu , Qinghua Mao , Xi Lin , Jun Wu

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic

Retrieval-Augmented Generation (RAG) enhances Large Language Models by grounding their outputs in external documents. These systems, however, remain vulnerable to attacks on the retrieval corpus, such as prompt injection. RAG-based search…

Cryptography and Security · Computer Science 2026-02-17 Zeyu Shen , Basileal Imana , Tong Wu , Chong Xiang , Prateek Mittal , Aleksandra Korolova

Large Vision-Language Models (LVLMs) augmented with Retrieval-Augmented Generation (RAG) are increasingly employed in medical AI to enhance factual grounding through external clinical image-text retrieval. However, this reliance creates a…

Machine Learning · Computer Science 2026-01-06 Kaiwen Zuo , Zelin Liu , Raman Dutt , Ziyang Wang , Zhongtian Sun , Fan Mo , Pietro Liò

Retrieval-Augmented Generation (RAG) has become a cornerstone of knowledge-intensive applications, including enterprise chatbots, healthcare assistants, and agentic memory management. However, recent studies show that knowledge-extraction…

Cryptography and Security · Computer Science 2026-02-13 Zhisheng Qi , Utkarsh Sahu , Li Ma , Haoyu Han , Ryan Rossi , Franck Dernoncourt , Mahantesh Halappanavar , Nesreen Ahmed , Yushun Dong , Yue Zhao , Yu Zhang , Yu Wang

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces…

Information Retrieval · Computer Science 2025-08-12 Wenlong Wu , Haofen Wang , Bohan Li , Peixuan Huang , Xinzhe Zhao , Lei Liang

Retrieval augmented generation (RAG) for technical documents creates challenges as embeddings do not often capture domain information. We review prior art for important factors affecting RAG and perform experiments to highlight best…

Machine Learning · Computer Science 2024-04-02 Sumit Soman , Sujoy Roychowdhury