English
Related papers

Related papers: Private Hyperparameter Tuning with Ex-Post Guarant…

200 papers

In this paper, we focus on developing a novel mechanism to preserve differential privacy in deep neural networks, such that: (1) The privacy budget consumption is totally independent of the number of training steps; (2) It has the ability…

Cryptography and Security · Computer Science 2018-04-24 NhatHai Phan , Xintao Wu , Han Hu , Dejing Dou

The central question studied in this paper is Renyi Differential Privacy (RDP) guarantees for general discrete local mechanisms in the shuffle privacy model. In the shuffle model, each of the $n$ clients randomizes its response using a…

Cryptography and Security · Computer Science 2021-05-12 Antonious M. Girgis , Deepesh Data , Suhas Diggavi , Ananda Theertha Suresh , Peter Kairouz

This paper presents ongoing research focused on improving the utility of data protected by Global Differential Privacy(DP) in the scenario of summary statistics. Our approach is based on predictions on how an analyst will use statistics…

Cryptography and Security · Computer Science 2024-01-15 Henry C. Nunes , Marlon P. da Silva , Charles V. Neu , Avelino F. Zorzo

We show that an "old dog", the classical discrete Laplace (aka.~geometric) mechanism, can "perform new tricks": 1. It can be post-processed to yield a simple, unbiased estimator of any subexponential function $f$ of the original data,…

Cryptography and Security · Computer Science 2026-05-08 Quentin Hillebrand , Jacob Imola , Rasmus Pagh , Sia Sejer

Machine learning models have shone in a variety of domains and attracted increasing attention from both the security and the privacy communities. One important yet worrying question is: Will training models under the differential privacy…

Machine Learning · Computer Science 2023-11-22 Yuan Zhang , Zhiqi Bu

Propose-Test-Release (PTR) is a differential privacy framework that works with local sensitivity of functions, instead of their global sensitivity. This framework is typically used for releasing robust statistics such as median or trimmed…

Cryptography and Security · Computer Science 2022-09-19 Jiachen T. Wang , Saeed Mahloujifar , Shouda Wang , Ruoxi Jia , Prateek Mittal

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

Differentially-private mechanisms for text generation typically add carefully calibrated noise to input words and use the nearest neighbor to the noised input as the output word. When the noise is small in magnitude, these mechanisms are…

Computation and Language · Computer Science 2021-04-27 Zekun Xu , Abhinav Aggarwal , Oluwaseyi Feyisetan , Nathanael Teissier

The Laplace mechanism and the Gaussian mechanism are primary mechanisms in differential privacy, widely applicable to many scenarios involving numerical data. However, due to the infinite-range random variables they generate, the Laplace…

Cryptography and Security · Computer Science 2023-09-25 Jie Fu , Zhiyu Sun , Haitao Liu , Zhili Chen

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

Machine Learning · Computer Science 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

In this paper, we study the problem of publishing a stream of real-valued data satisfying differential privacy (DP). One major challenge is that the maximal possible value can be quite large; thus it is necessary to estimate a threshold so…

Cryptography and Security · Computer Science 2023-12-11 Tianhao Wang , Joann Qiongna Chen , Zhikun Zhang , Dong Su , Yueqiang Cheng , Zhou Li , Ninghui Li , Somesh Jha

The concept of differential privacy emerged as a strong notion to protect database privacy in an untrusted environment. Later on, researchers proposed several variants of differential privacy in order to preserve privacy in certain other…

Cryptography and Security · Computer Science 2020-07-21 Muneeb Ul Hassan , Mubashir Husain Rehmani , Jinjun Chen

Given a differentially private unbiased estimate $\tilde{q}=q(D) +\nu$ of a statistic $q(D)$, we wish to obtain unbiased estimates of functions of $q(D)$, such as $1/q(D)$, solely through post-processing of $\tilde{q}$, with no further…

Cryptography and Security · Computer Science 2025-12-17 Flavio Calmon , Elbert Du , Cynthia Dwork , Brian Finley , Grigory Franguridi

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

LDP (Local Differential Privacy) has been widely studied to estimate statistics of personal data (e.g., distribution underlying the data) while protecting users' privacy. Although LDP does not require a trusted third party, it regards all…

Databases · Computer Science 2019-05-28 Takao Murakami , Yusuke Kawamoto

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

The accuracy-first perspective of differential privacy addresses an important shortcoming by allowing a data analyst to adaptively adjust the quantitative privacy bound instead of sticking to a predetermined bound. Existing works on the…

Cryptography and Security · Computer Science 2025-09-29 Ossi Räisä , Antti Koskela , Antti Honkela

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

Machine Learning · Computer Science 2025-10-14 Tejash Varsani