English
Related papers

Related papers: Mitigating the Privacy Issues in Retrieval-Augment…

200 papers

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

Retrieval-Augmented Generation (RAG) enhances the factual accuracy of large language models (LLMs) by conditioning outputs on external knowledge sources. However, when retrieval involves private or sensitive data, RAG systems are…

Computation and Language · Computer Science 2025-08-06 Haoran Wang , Xiongxiao Xu , Baixiang Huang , Kai Shu

Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) with external knowledge but are vulnerable to corpus poisoning and contamination attacks, which can compromise output integrity. Existing defenses often apply…

Computation and Language · Computer Science 2025-10-16 Xiaonan Si , Meilin Zhu , Simeng Qin , Lijia Yu , Lijun Zhang , Shuaitong Liu , Xinfeng Li , Ranjie Duan , Yang Liu , Xiaojun Jia

Synthetic datasets have long been thought of as second-rate, to be used only when "real" data collected directly from the real world is unavailable. But this perspective assumes that raw data is clean, unbiased, and trustworthy, which it…

Databases · Computer Science 2019-05-07 Luke Rodriguez , Bill Howe

Retrieval-Augmented Generation (RAG) represents a major advancement in natural language processing (NLP), combining large language models (LLMs) with information retrieval systems to enhance factual grounding, accuracy, and contextual…

Computation and Language · Computer Science 2025-07-28 Agada Joseph Oche , Ademola Glory Folashade , Tirthankar Ghosal , Arpan Biswas

Smart vehicles produce large amounts of data, much of which is sensitive and at risk of privacy breaches. As attackers increasingly exploit anonymised metadata within these datasets to profile drivers, it's important to find solutions that…

Cryptography and Security · Computer Science 2024-10-14 Krish Parikh

Retrieval-Augmented Generation (RAG) is a promising technique for applying LLMs to proprietary domains. However, retrieved documents may contain sensitive knowledge, posing risks of privacy leakage in generative results. Thus, effectively…

Computation and Language · Computer Science 2025-04-15 Yujing Wang , Hainan Zhang , Liang Pang , Yongxin Tong , Binghui Guo , Hongwei Zheng , Zhiming Zheng

Personal data collected at scale promises to improve decision-making and accelerate innovation. However, sharing and using such data raises serious privacy concerns. A promising solution is to produce synthetic data, artificial records to…

Access to genomic data is highly regulated due to its sensitive nature. While safeguards are essential, cumbersome data access processes pose a significant barrier to the development of AI methods for genomics. Synthetic data generation can…

Cryptography and Security · Computer Science 2026-05-01 Daniil Filienko , Martine De Cock , Sikha Pentyala

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by retrieving documents from an external corpus at inference time. When this corpus contains sensitive information, however, unprotected RAG systems are at risk of…

Machine Learning · Computer Science 2025-11-12 Ruihan Wu , Erchi Wang , Zhiyuan Zhang , Yu-Xiang Wang

Synthetic data is emerging as a cost-effective solution necessary to meet the increasing data demands of AI development, created either from existing knowledge or derived from real data. The traditional classification of synthetic data…

Machine Learning · Computer Science 2025-08-07 Vibeke Binz Vallevik , Serena Elizabeth Marshall , Aleksandar Babic , Jan Franz Nygaard

RAG has emerged as a key technique for enhancing response quality of LLMs without high computational cost. In traditional architectures, RAG services are provided by a single entity that hosts the dataset within a trusted local environment.…

Cryptography and Security · Computer Science 2026-01-21 Huanyi Ye , Jiale Guo , Ziyao Liu , Kwok-Yan Lam

Traditional Retrieval-Augmented Generation (RAG) methods are limited by their reliance on a fixed number of retrieved documents, often resulting in incomplete or noisy information that undermines task performance. Although recent adaptive…

Computation and Language · Computer Science 2024-10-16 Wenjia Zhai

The widespread use of big data across sectors has raised major privacy concerns, especially when sensitive information is shared or analyzed. Regulations such as GDPR and HIPAA impose strict controls on data handling, making it difficult to…

Machine Learning · Computer Science 2025-12-10 Anantaa Kotal , Anupam Joshi

Synthetic data inherits the differential privacy guarantees of the model used to generate it. Additionally, synthetic data may benefit from privacy amplification when the generative model is kept hidden. While empirical studies suggest this…

Machine Learning · Computer Science 2025-06-06 Clément Pierquin , Aurélien Bellet , Marc Tommasi , Matthieu Boussard

In the current data driven era, synthetic data, artificially generated data that resembles the characteristics of real world data without containing actual personal information, is gaining prominence. This is due to its potential to…

Machine Learning · Computer Science 2023-09-06 Tshilidzi Marwala , Eleonore Fournier-Tombs , Serge Stinckwich

Retrieval-Augmented Generation (RAG) systems introduce a critical vulnerability: contextual leakage, where adversaries exploit instruction-following to exfiltrate Personally Identifiable Information (PII) via adaptive extraction. Current…

Cryptography and Security · Computer Science 2026-03-19 Jin Xie , Songze Li , Guang Cheng

Synthetic data generation has become essential for securely sharing and analyzing sensitive data sets. Traditional anonymization techniques, however, often fail to adequately preserve privacy. We introduce the Tabular Auto-Regressive…

Machine Learning · Computer Science 2025-08-12 Andrey Sidorenko , Paul Tiwald

When acting as a privacy-enhancing technology, synthetic data generation (SDG) aims to maintain a resemblance to the real data while excluding personally-identifiable information. Many SDG algorithms provide robust differential privacy (DP)…

Cryptography and Security · Computer Science 2025-04-02 Steven Golob , Sikha Pentyala , Anuar Maratkhan , Martine De Cock

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen