English
Related papers

Related papers: Poisoning Attacks to Local Differential Privacy fo…

200 papers

This paper presents LDP-Fed, a novel federated learning system with a formal privacy guarantee using local differential privacy (LDP). Existing LDP protocols are developed primarily to ensure data privacy in the collection of single…

Machine Learning · Computer Science 2020-06-09 Stacey Truex , Ling Liu , Ka-Ho Chow , Mehmet Emre Gursoy , Wenqi Wei

In this paper, we study the offline and online settings of reinforcement learning from human feedback (RLHF) with KL-regularization -- a widely used objective function in large language model alignment -- under the $\epsilon$ local…

Machine Learning · Computer Science 2025-10-16 Yulian Wu , Rushil Thareja , Praneeth Vepakomma , Francesco Orabona

Join size estimation on sensitive data poses a risk of privacy leakage. Local differential privacy (LDP) is a solution to preserve privacy while collecting sensitive data, but it introduces significant noise when dealing with sensitive join…

Databases · Computer Science 2024-05-21 Meifan Zhang , Xin Liu , Lihua Yin

Differential privacy (DP) enables private data analysis. In a typical DP deployment, controllers manage individuals' sensitive data and are responsible for answering analysts' queries while protecting individuals' privacy. They do so by…

Databases · Computer Science 2026-05-05 Zhiru Zhu , Raul Castro Fernandez

Differential Privacy (DP) was originally developed to protect privacy. However, it has recently been utilized to secure machine learning (ML) models from poisoning attacks, with DP-SGD receiving substantial attention. Nevertheless, a…

Cryptography and Security · Computer Science 2023-11-13 Fereshteh Razmi , Jian Lou , Li Xiong

Local Differential Privacy (LDP) addresses significant privacy concerns in sensitive data collection. In this work, we focus on numerical data collection under LDP, targeting a significant gap in the literature: existing LDP mechanisms are…

Cryptography and Security · Computer Science 2025-10-14 Incheol Baek , Yon Dohn Chung

Local differential privacy (LDP) is a model where users send privatized data to an untrusted central server whose goal it to solve some data analysis task. In the non-interactive version of this model the protocol consists of a single round…

Machine Learning · Computer Science 2020-09-24 Yuval Dagan , Vitaly Feldman

We study privacy-preserving exploration in sequential decision-making for environments that rely on sensitive data such as medical records. In particular, we focus on solving the problem of reinforcement learning (RL) subject to the…

Machine Learning · Computer Science 2022-06-24 Dung Daniel Ngo , Giuseppe Vietri , Zhiwei Steven Wu

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

The offline reinforcement learning (RL) problem is often motivated by the need to learn data-driven decision policies in financial, legal and healthcare applications. However, the learned policy could retain sensitive information of…

Machine Learning · Computer Science 2023-01-04 Dan Qiao , Yu-Xiang Wang

Many existing privacy-enhanced speech emotion recognition (SER) frameworks focus on perturbing the original speech data through adversarial training within a centralized machine learning setup. However, this privacy protection scheme can…

Cryptography and Security · Computer Science 2023-04-18 Tiantian Feng , Raghuveer Peri , Shrikanth Narayanan

With the widespread sharing of personal face images in applications' public databases, face recognition systems faces real threat of being breached by potential adversaries who are able to access users' face images and use them to intrude…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Lu Ou , Shaolin Liao , Shihui Gao , Guandong Huang , Zheng Qi

Private and public organizations regularly collect and analyze digitalized data about their associates, volunteers, clients, etc. However, because most personal data are sensitive, there is a key challenge in designing privacy-preserving…

Cryptography and Security · Computer Science 2022-04-05 Héber H. Arcolezi

The key to personalized recommendation is to predict a personalized ranking on a catalog of items by modeling the user's preferences. There are many personalized ranking approaches for item recommendation from implicit feedback like…

Information Retrieval · Computer Science 2024-06-25 Yuli Liu , Christian Walder , Lexing Xie

In this paper, we investigate federated learning for quantile inference under local differential privacy (LDP). We propose an estimator based on local stochastic gradient descent (SGD), whose local gradients are perturbed via a randomized…

Methodology · Statistics 2025-09-29 Leheng Cai , Qirui Hu , Shuyuan Wu

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

We propose the first study of adversarial attacks on online learning to rank. The goal of the adversary is to misguide the online learning to rank algorithm to place the target item on top of the ranking list linear times to time horizon…

Machine Learning · Computer Science 2023-05-31 Zichen Wang , Rishab Balasubramanian , Hui Yuan , Chenyu Song , Mengdi Wang , Huazheng Wang

Local differential privacy is a widely studied restriction on distributed algorithms that collect aggregates about sensitive user data, and is now deployed in several large systems. We initiate a systematic study of a fundamental limitation…

Data Structures and Algorithms · Computer Science 2019-09-23 Albert Cheu , Adam Smith , Jonathan Ullman

Graph neural network (GNN) is a powerful tool for analyzing graph-structured data. However, their vulnerability to adversarial attacks raises serious concerns, especially when dealing with sensitive information. Local Differential Privacy…

Machine Learning · Computer Science 2026-03-24 Matta Varun , Ajay Kumar Dhakar , Yuan Hong , Shamik Sural

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade