中文
相关论文

相关论文: RAPID: Retrieval Augmented Training of Differentia…

200 篇论文

Differential privacy (DP) is a popular mechanism for training machine learning models with bounded leakage about the presence of specific points in the training data. The cost of differential privacy is a reduction in the model's accuracy.…

机器学习 · 计算机科学 2019-10-29 Eugene Bagdasaryan , Vitaly Shmatikov

While motion generation has made substantial progress, its practical application remains constrained by dataset diversity and scale, limiting its ability to handle out-of-distribution scenarios. To address this, we propose a simple and…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Zhouyingcheng Liao , Mingyuan Zhang , Wenjia Wang , Lei Yang , Taku Komura

We introduce Autoregressive Retrieval Augmentation (AR-RAG), a novel paradigm that enhances image generation by autoregressively incorporating knearest neighbor retrievals at the patch level. Unlike prior methods that perform a single,…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Jingyuan Qi , Zhiyang Xu , Qifan Wang , Lifu Huang

High-dimensional data are widely used in the era of deep learning with numerous applications. However, certain data which has sensitive information are not allowed to be shared without privacy protection. In this paper, we propose a novel…

机器学习 · 计算机科学 2023-10-10 Dongjie Chen , Sen-ching S. Cheung , Chen-Nee Chuah

Retrieval-Augmented Generation (RAG) is a promising technique for applying LLMs to proprietary domains. However, retrieved documents may contain sensitive knowledge, posing risks of privacy leakage in generative results. Thus, effectively…

计算与语言 · 计算机科学 2025-04-15 Yujing Wang , Hainan Zhang , Liang Pang , Yongxin Tong , Binghui Guo , Hongwei Zheng , Zhiming Zheng

The deployment of deep learning applications has to address the growing privacy concerns when using private and sensitive data for training. A conventional deep learning model is prone to privacy attacks that can recover the sensitive…

密码学与安全 · 计算机科学 2020-04-10 Di Gao , Cheng Zhuo

Face recognition poses serious privacy risks due to its reliance on sensitive and immutable biometric data. While modern systems mitigate privacy risks by mapping facial images to embeddings (commonly regarded as privacy-preserving), model…

密码学与安全 · 计算机科学 2026-05-04 Hanrui Wang , Shuo Wang , Chun-Shien Lu , Isao Echizen

Personalizing large-scale diffusion models poses serious privacy risks, especially when adapting to small, sensitive datasets. A common approach is to fine-tune the model using differentially private stochastic gradient descent (DP-SGD),…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Pura Peetathawatchai , Wei-Ning Chen , Berivan Isik , Sanmi Koyejo , Albert No

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable,…

计算与语言 · 计算机科学 2024-05-24 Aldo Gael Carranza , Rezsa Farahani , Natalia Ponomareva , Alex Kurakin , Matthew Jagielski , Milad Nasr

This paper investigates the problem of forecasting multivariate aggregated human mobility while preserving the privacy of the individuals concerned. Differential privacy, a state-of-the-art formal notion, has been used as the privacy…

机器学习 · 计算机科学 2022-06-06 Héber H. Arcolezi , Jean-François Couchot , Denis Renaud , Bechara Al Bouna , Xiaokui Xiao

Federated learning enables collaborative machine learning while preserving data privacy. However, the rise of federated unlearning, designed to allow clients to erase their data from the global model, introduces new privacy concerns.…

机器学习 · 计算机科学 2025-07-15 Bocheng Ju , Junchao Fan , Jiaqi Liu , Xiaolin Chang

With recent advances in speech synthesis including text-to-speech (TTS) and voice conversion (VC) systems enabling the generation of ultra-realistic audio deepfakes, there is growing concern about their potential misuse. However, most…

声音 · 计算机科学 2024-04-24 Zuheng Kang , Yayun He , Botao Zhao , Xiaoyang Qu , Junqing Peng , Jing Xiao , Jianzong Wang

While location trajectories offer valuable insights, they also reveal sensitive personal information. Differential Privacy (DP) offers formal protection, but achieving a favourable utility-privacy trade-off remains challenging. Recent works…

密码学与安全 · 计算机科学 2025-06-12 Erik Buchholz , Natasha Fernandes , David D. Nguyen , Alsharif Abuadbba , Surya Nepal , Salil S. Kanhere

Retrieval-Augmented Generation (RAG) has emerged as a key paradigm for enhancing large language models (LLMs) by incorporating external knowledge. However, current RAG methods face two limitations: (1) they only cover limited RAG scenarios.…

计算与语言 · 计算机科学 2025-01-03 Wanlong Liu , Junying Chen , Ke Ji , Li Zhou , Wenyu Chen , Benyou Wang

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

机器学习 · 计算机科学 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Retrieval-Augmented Generation (RAG) enables large language models to use external knowledge, but outsourcing the RAG service raises privacy concerns for both data owners and users. Privacy-preserving RAG systems address these concerns by…

密码学与安全 · 计算机科学 2026-05-29 Yulong Ming , Mingyue Wang , Jijia Yang , Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Machine learning models used for distributed architectures consisting of servers and clients require large amounts of data to achieve high accuracy. Data obtained from clients are collected on a central server for model training. However,…

密码学与安全 · 计算机科学 2025-09-18 Ozer Ozturk , Busra Buyuktanir , Gozde Karatas Baydogmus , Kazim Yildiz

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

信息检索 · 计算机科学 2025-06-03 Chaitanya Sharma

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

信息检索 · 计算机科学 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

The federated learning (FL) framework enables multiple clients to collaboratively train machine learning models without sharing their raw data, but it remains vulnerable to privacy attacks. One promising approach is to incorporate…

机器学习 · 计算机科学 2025-04-15 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa