English
Related papers

Related papers: Differentially Private Synthetic Text Generation f…

200 papers

In this work, we develop a privacy-by-design generative model for synthesizing the activity diary of the travel population using state-of-art deep learning approaches. This proposed approach extends literature on population synthesis by…

Machine Learning · Computer Science 2021-01-01 Godwin Badu-Marfo , Bilal Farooq , Zachary Patterson

Retrieval augmented generation (RAG) combines the generative abilities of large language models (LLMs) with external knowledge sources to provide more accurate and up-to-date responses. Recent RAG advancements focus on improving retrieval…

Large Language Models (LLMs) have demonstrated the strong potential to assist both clinicians and the general public with their extensive medical knowledge. However, their application in healthcare is constrained due to concerns about the…

Computation and Language · Computer Science 2024-08-09 Thomas Pouplin , Hao Sun , Samuel Holt , Mihaela van der Schaar

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

Large language models (LLMs) have achieved remarkable success in various domains, primarily due to their strong capabilities in reasoning and generating human-like text. Despite their impressive performance, LLMs are susceptible to…

Cryptography and Security · Computer Science 2025-05-13 Yangguang Shao , Xinjie Lin , Haozheng Luo , Chengshang Hou , Gang Xiong , Jiahao Yu , Junzheng Shi

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach to boost the capabilities of large language models (LLMs) by incorporating external, up-to-date knowledge sources. However, this introduces a potential vulnerability to…

Machine Learning · Computer Science 2026-03-30 Kennedy Edemacu , Vinay M. Shashidhar , Micheal Tuape , Dan Abudu , Beakcheol Jang , Jong Wook Kim

When sharing data among researchers or releasing data for public use, there is a risk of exposing sensitive information of individuals in the data set. Data synthesis (DS) is a statistical disclosure limitation technique for releasing…

Methodology · Statistics 2020-07-01 Claire McKay Bowen , Fang Liu

Large Language Models (LLMs) have been increasingly adopted for health-related tasks, yet their performance in depression detection remains limited when relying solely on text input. While Retrieval-Augmented Generation (RAG) typically…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Xiangyu Zhang , Hexin Liu , Qiquan Zhang , Beena Ahmed , Julien Epps

Large language models (LLMs) in biomedicine face a fundamental conflict between static parameter knowledge and the dynamic nature of clinical evidence. Retrieval-Augmented Generation (RAG) addresses this by grounding generation in external…

Other Quantitative Biology · Quantitative Biology 2025-12-19 Jiawei He , Boya Zhang , Hossein Rouhizadeh , Yingjian Chen , Rui Yang , Jin Lu , Xudong Chen , Nan Liu , Douglas Teodoro

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of applications, e.g., medical question-answering, mathematical sciences, and code generation. However, they also exhibit inherent limitations, such…

Cryptography and Security · Computer Science 2025-06-23 Yang Jiao , Xiaodong Wang , Kai Yang

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

Computation and Language · Computer Science 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Retrieval-Augmented Generation (RAG) systems are usually defined by the combination of a generator and a retrieval component that extracts textual context from a knowledge base to answer user queries. However, such basic implementations…

Computation and Language · Computer Science 2026-04-21 Pietro Ferrazzi , Milica Cvjeticanin , Alessio Piraccini , Davide Giannuzzi

Retrieval-Augmented Generation (RAG) offers a solution to mitigate hallucinations in Large Language Models (LLMs) by grounding their outputs to knowledge retrieved from external sources. The use of private resources and data in constructing…

Computation and Language · Computer Science 2025-02-10 Xiao Hu , Eric Liu , Weizhou Wang , Xiangyu Guo , David Lie

Despite several works that succeed in generating synthetic data with differential privacy (DP) guarantees, they are inadequate for generating high-quality synthetic data when the input data has missing values. In this work, we formalize the…

Databases · Computer Science 2025-11-06 Shubhankar Mohapatra , Jianqiao Zong , Florian Kerschbaum , Xi He

Dataset distillation (DD) compresses large datasets into smaller ones while preserving the performance of models trained on them. Although DD is often assumed to enhance data privacy by aggregating over individual examples, recent studies…

Cryptography and Security · Computer Science 2025-11-14 Shuo Shi , Jinghuai Zhang , Shijie Jiang , Chunyi Zhou , Yuyuan Li , Mengying Zhu , Yangyang Wu , Tianyu Du

Privacy Preserving Synthetic Data Generation (PP-SDG) has emerged to produce synthetic datasets from personal data while maintaining privacy and utility. Differential privacy (DP) is the property of a PP-SDG mechanism that establishes how…

Cryptography and Security · Computer Science 2025-07-23 Frederik Marinus Trudslev , Matteo Lissandrini , Juan Manuel Rodriguez , Martin Bøgsted , Daniele Dell'Aglio

Retrieval-Augmented Generation (RAG) enables large language models to use external knowledge, but outsourcing the RAG service raises privacy concerns for both data owners and users. Privacy-preserving RAG systems address these concerns by…

Cryptography and Security · Computer Science 2026-05-29 Yulong Ming , Mingyue Wang , Jijia Yang , Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

We proposed an end-to-end system design towards utilizing Retrieval Augmented Generation (RAG) to improve the factual accuracy of Large Language Models (LLMs) for domain-specific and time-sensitive queries related to private…

Computation and Language · Computer Science 2024-03-18 Jiarui Li , Ye Yuan , Zehua Zhang

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

Machine Learning · Computer Science 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li