English
Related papers

Related papers: Versatile Differentially Private Learning for Gene…

200 papers

A mechanism for releasing information about a statistical database with sensitive data must resolve a trade-off between utility and privacy. Privacy can be rigorously quantified using the framework of {\em differential privacy}, which…

Databases · Computer Science 2009-03-20 Arpita Ghosh , Tim Roughgarden , Mukund Sundararajan

In-context learning (ICL) has shown promising improvement in downstream task adaptation of LLMs by augmenting prompts with relevant input-output examples (demonstrations). However, the ICL demonstrations can contain privacy-sensitive…

Machine Learning · Computer Science 2025-02-03 James Flemings , Haosheng Gan , Hongyi Li , Meisam Razaviyayn , Murali Annavaram

Deep learning techniques have achieved remarkable performance in wide-ranging tasks. However, when trained on privacy-sensitive datasets, the model parameters may expose private information in training data. Prior attempts for…

Machine Learning · Computer Science 2021-06-22 Wenxiao Wang , Tianhao Wang , Lun Wang , Nanqing Luo , Pan Zhou , Dawn Song , Ruoxi Jia

In-context learning (ICL) is an important capability of Large Language Models (LLMs), enabling these models to dynamically adapt based on specific, in-context exemplars, thereby improving accuracy and relevance. However, LLM's responses may…

Machine Learning · Computer Science 2023-10-03 Tong Wu , Ashwinee Panda , Jiachen T. Wang , Prateek Mittal

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Local differential privacy techniques for numerical data typically transform a dataset to ensure a bound on the likelihood that, given a query, a malicious user could infer information on the original samples. Queries are often solely based…

Cryptography and Security · Computer Science 2023-08-29 Francesco Taurone , Daniel Lucani , Qi Zhang

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Differential privacy is achieved by the introduction of Laplacian noise in the response to a query, establishing a precise trade-off between the level of differential privacy and the accuracy of the database response (via the amount of…

Cryptography and Security · Computer Science 2015-10-06 Maurizio Naldi , Giuseppe D'Acquisto

The paper aims to give an overview of various approaches to statistical disclosure control based on random noise that are currently being discussed for official population statistics and censuses. A particular focus is on a stringent…

Methodology · Statistics 2020-12-18 Fabian Bach

The Horvitz-Thompson estimate of a total can be seen as as differentially private mechanism applied to this population total. We provide forumlae to compute the $\epsilon$ and $\delta$ parameter for this specific mecanism, coupled or not…

Statistics Theory · Mathematics 2025-06-18 Daniel Bernard Bonnéry , Julien Jamme

Conventionally, in a differentially private additive noise mechanism, independent and identically distributed (i.i.d.) noise samples are added to each coordinate of the response. In this work, we formally present the addition of noise that…

Cryptography and Security · Computer Science 2025-01-28 Gokularam Muthukrishnan , Sheetal Kalyani

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

Differential privacy is the state-of-the-art formal definition for data release under strong privacy guarantees. A variety of mechanisms have been proposed in the literature for releasing the output of numeric queries (e.g., the Laplace…

Cryptography and Security · Computer Science 2022-04-15 Victor A. E. Farias , Felipe T. Brito , Cheryl Flynn , Javam C. Machado , Subhabrata Majumdar , Divesh Srivastava

Differential privacy provides strong privacy guarantees simultaneously enabling useful insights from sensitive datasets. However, it provides the same level of protection for all elements (individuals and attributes) in the data. There are…

Machine Learning · Statistics 2019-08-30 Parameswaran Kamalaruban , Victor Perrier , Hassan Jameel Asghar , Mohamed Ali Kaafar

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

We introduce the multi-dimensional Skellam mechanism, a discrete differential privacy mechanism based on the difference of two independent Poisson random variables. To quantify its privacy guarantees, we analyze the privacy loss…

Machine Learning · Computer Science 2021-11-01 Naman Agarwal , Peter Kairouz , Ziyu Liu

We investigate the problem of learning discrete, undirected graphical models in a differentially private way. We show that the approach of releasing noisy sufficient statistics using the Laplace mechanism achieves a good trade-off between…

Machine Learning · Computer Science 2017-06-16 Garrett Bernstein , Ryan McKenna , Tao Sun , Daniel Sheldon , Michael Hay , Gerome Miklau

Differential privacy (DP), provides a framework for provable privacy protection against arbitrary adversaries, while allowing the release of summary statistics and synthetic data. We address the problem of releasing a noisy real-valued…

Methodology · Statistics 2024-11-04 Jordan Awan , Aleksandra Slavkovic

Differential privacy (DP) provides rigorous privacy guarantees on individual's data while also allowing for accurate statistics to be conducted on the overall, sensitive dataset. To design a private system, first private algorithms must be…

Cryptography and Security · Computer Science 2020-11-19 Mark Cesar , Ryan Rogers