English
Related papers

Related papers: Fine-grained Poisoning Attack to Local Differentia…

200 papers

Differential privacy is becoming one gold standard for protecting the privacy of publicly shared data. It has been widely used in social science, data science, public health, information technology, and the U.S. decennial census.…

Cryptography and Security · Computer Science 2022-06-07 Xuan Bi , Xiaotong Shen

The widespread collection and sharing of location data, even in aggregated form, raises major privacy concerns. Previous studies used meta-classifier-based membership inference attacks~(MIAs) with multi-layer perceptrons~(MLPs) to estimate…

Cryptography and Security · Computer Science 2024-12-31 Yuhan Liu , Florent Guepin , Igor Shilov , Yves-Alexandre De Montjoye

LLM developers have imposed technical interventions to prevent fine-tuning misuse attacks, attacks where adversaries evade safeguards by fine-tuning the model using a public API. Previous work has established several successful attacks…

Machine Learning · Computer Science 2025-10-27 Xander Davies , Eric Winsor , Alexandra Souly , Tomek Korbak , Robert Kirk , Christian Schroeder de Witt , Yarin Gal

We initiate an investigation of node differential privacy for graphs in the local model of private data analysis. In our model, dubbed LNDP*, each node sees its own edge list and releases the output of a local randomizer on this input.…

Data Structures and Algorithms · Computer Science 2026-04-03 Sofya Raskhodnikova , Adam Smith , Connor Wagaman , Anatoly Zavyalov

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso

To protect privacy for data-collection-based services, local differential privacy (LDP) is widely adopted due to its rigorous theoretical bound on privacy loss. However, mistakes in complex theoretical analysis or subtle implementation…

Cryptography and Security · Computer Science 2025-08-18 Jingnan Xu , Leixia Wang , Xiaofeng Meng

Federated learning (FL) is a new paradigm that enables many clients to jointly train a machine learning (ML) model under the orchestration of a parameter server while keeping the local data not being exposed to any third party. However, the…

Machine Learning · Computer Science 2022-04-27 Yiwei Li , Shuai Wang , Tsung-Hui Chang , Chong-Yung Chi

Distributed data analysis is a large and growing field driven by a massive proliferation of user devices, and by privacy concerns surrounding the centralised storage of data. We consider two \emph{adaptive} algorithms for estimating one…

Cryptography and Security · Computer Science 2025-02-06 Anders Aamand , Fabrizio Boninsegna , Abigail Gentle , Jacob Imola , Rasmus Pagh

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

Computation and Language · Computer Science 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Differential privacy (DP) provides rigorous privacy guarantees on individual's data while also allowing for accurate statistics to be conducted on the overall, sensitive dataset. To design a private system, first private algorithms must be…

Cryptography and Security · Computer Science 2020-11-19 Mark Cesar , Ryan Rogers

We introduce the novel problem of benchmarking fraud detectors on private graph-structured data. Currently, many types of fraud are managed in part by automated detection algorithms that operate over graphs. We consider the scenario where a…

Cryptography and Security · Computer Science 2025-07-31 Alexander Goldberg , Giulia Fanti , Nihar Shah , Zhiwei Steven Wu

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Parameter estimation in statistics and system identification relies on data that may contain sensitive information. To protect this sensitive information, the notion of \emph{differential privacy} (DP) has been proposed, which enforces…

Optimization and Control · Mathematics 2022-11-21 Braghadeesh Lakshminarayanan , Cristian R. Rojas

Local differential privacy (LDP) has received much interest recently. In existing protocols with LDP guarantees, a user encodes and perturbs his data locally before sharing it to the aggregator. In common practice, however, users would…

Cryptography and Security · Computer Science 2020-02-14 Lin Sun , Xiaojun Ye , Jun Zhao , Chenhui Lu , Mengmeng Yang

Metric Differential Privacy (mDP) extends the local differential privacy (LDP) framework to metric spaces, enabling more nuanced privacy protection for data such as geo-locations. However, existing mDP optimization methods, particularly…

Cryptography and Security · Computer Science 2025-09-11 Ruiyao Liu , Chenxi Qiu

Reinforcement learning algorithms are widely used in domains where it is desirable to provide a personalized service. In these domains it is common that user data contains sensitive information that needs to be protected from third parties.…

Machine Learning · Computer Science 2021-10-28 Evrard Garcelon , Vianney Perchet , Ciara Pike-Burke , Matteo Pirotta

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

As data-driven technologies advance swiftly, maintaining strong privacy measures becomes progressively difficult. Conventional $(\epsilon, \delta)$-differential privacy, while prevalent, exhibits limited adaptability for many applications.…

Cryptography and Security · Computer Science 2025-07-03 Yifeng Liu , Zehua Wang

Label differential privacy (label-DP) is a popular framework for training private ML models on datasets with public features and sensitive private labels. Despite its rigorous privacy guarantee, it has been observed that in practice…

Machine Learning · Computer Science 2023-06-06 Ruihan Wu , Jin Peng Zhou , Kilian Q. Weinberger , Chuan Guo

Deep Neural Networks (DNN) are susceptible to backdoor attacks where malicious attackers manipulate the model's predictions via data poisoning. It is hence imperative to develop a strategy for training a clean model using a potentially…

Cryptography and Security · Computer Science 2023-12-21 Yiming Chen , Haiwei Wu , Jiantao Zhou