English
Related papers

Related papers: Beyond Theoretical Bounds: Empirical Privacy Loss …

200 papers

Privacy is an important concern when building statistical models on data containing personal information. Differential privacy offers a strong definition of privacy and can be used to solve several privacy concerns (Dwork et al., 2014).…

Cryptography and Security · Computer Science 2021-02-03 Satyapriya Krishna , Rahul Gupta , Christophe Dupuy

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction --…

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

Differential privacy provides a formal approach to privacy of individuals. Applications of differential privacy in various scenarios, such as protecting users' original utterances, must satisfy certain mathematical properties. Our…

Computation and Language · Computer Science 2022-03-07 Ivan Habernal

In the past decade analysis of big data has proven to be extremely valuable in many contexts. Local Differential Privacy (LDP) is a state-of-the-art approach which allows statistical computations while protecting each individual user's…

Cryptography and Security · Computer Science 2019-07-30 Björn Bebensee

Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a…

Machine Learning · Computer Science 2020-12-11 Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Synthetic text generation with Differential Privacy (DP) guarantees emerges as a principled approach that can enable the sharing of sensitive datasets across institutional and regulatory boundaries, while bounding the risks of…

Differential Privacy (DP) can be applied to raw text by exploiting the spatial arrangement of words in an embedding space. We investigate the implications of such text privatization on Language Models (LMs) and their tendency towards…

Computation and Language · Computer Science 2024-07-02 Stefan Arnold , Rene Gröbner , Annika Schreiner

The study of privacy-preserving Natural Language Processing (NLP) has gained rising attention in recent years. One promising avenue studies the integration of Differential Privacy in NLP, which has brought about innovative methods in a…

Computation and Language · Computer Science 2024-05-06 Stephen Meisenbacher , Maulik Chevli , Florian Matthes

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

As privacy gains traction in the NLP community, researchers have started adopting various approaches to privacy-preserving methods. One of the favorite privacy frameworks, differential privacy (DP), is perhaps the most compelling thanks to…

Computation and Language · Computer Science 2025-08-14 Ivan Habernal

Local Differential Privacy (LDP) offers strong privacy protection, especially in settings in which the server collecting the data is untrusted. However, designing LDP mechanisms that achieve an optimal trade-off between privacy, utility and…

Cryptography and Security · Computer Science 2026-03-20 Héber H. Arcolezi , Sébastien Gambs

Recent work in Differential Privacy with Natural Language Processing (DP NLP) has proposed numerous promising techniques in the form of text rewriting mechanisms. In the evaluation of these mechanisms, an often-ignored aspect is that of…

Computation and Language · Computer Science 2025-11-04 Stephen Meisenbacher , Florian Matthes

Differential privacy (DP) has a wide range of applications for protecting data privacy, but designing and verifying DP algorithms requires expert-level reasoning, creating a high barrier for non-expert practitioners. Prior works either rely…

Machine Learning · Computer Science 2026-05-19 Erchi Wang , Pengrun Huang , Eli Chien , Om Thakkar , Kamalika Chaudhuri , Yu-Xiang Wang , Ruihan Wu

As privacy issues are receiving increasing attention within the Natural Language Processing (NLP) community, numerous methods have been proposed to sanitize texts subject to differential privacy. However, the state-of-the-art text…

Cryptography and Security · Computer Science 2023-09-04 Huimin Chen , Fengran Mo , Yanhao Wang , Cen Chen , Jian-Yun Nie , Chengyu Wang , Jamie Cui

We propose the notion of empirical privacy variance and study it in the context of differentially private fine-tuning of language models. Specifically, we show that models calibrated to the same $(\varepsilon, \delta)$-DP guarantee using…

Machine Learning · Computer Science 2025-05-27 Yuzheng Hu , Fan Wu , Ruicheng Xian , Yuhang Liu , Lydia Zakynthinou , Pritish Kamath , Chiyuan Zhang , David Forsyth

We analyze to what extent final users can infer information about the level of protection of their data when the data obfuscation mechanism is a priori unknown to them (the so-called ''black-box'' scenario). In particular, we delve into the…

Cryptography and Security · Computer Science 2023-05-24 Daniele Gorla , Louis Jalouzot , Federica Granese , Catuscia Palamidessi , Pablo Piantanida

Local differential privacy (LDP) gives a strong privacy guarantee to be used in a distributed setting like federated learning (FL). LDP mechanisms in FL protect a client's gradient by randomizing it on the client; however, how can we…

Cryptography and Security · Computer Science 2022-06-22 Marin Matsumoto , Tsubasa Takahashi , Seng Pei Liew , Masato Oguchi