English
Related papers

Related papers: Privacy Under Hard Distortion Constraints

200 papers

Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement…

Machine Learning · Computer Science 2020-10-27 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu , Jian Yin

Finding anonymization mechanisms to protect personal data is at the heart of recent machine learning research. Here, we consider the consequences of local differential privacy constraints on goodness-of-fit testing, i.e. the statistical…

Statistics Theory · Mathematics 2021-04-16 Joseph Lam-Weil , Béatrice Laurent , Jean-Michel Loubes

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

Distributed data sharing in dynamic networks is ubiquitous. It raises the concern that the private information of dynamic networks could be leaked when data receivers are malicious or communication channels are insecure. In this paper, we…

Optimization and Control · Mathematics 2019-12-18 Yang Lu , Minghui Zhu

Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a…

Machine Learning · Computer Science 2020-12-11 Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Privacy-protected microdata are often the desired output of a differentially private algorithm since microdata is familiar and convenient for downstream users. However, there is a statistical price for this kind of convenience. We show that…

We study the mean estimation problem under communication and local differential privacy constraints. While previous work has proposed \emph{order}-optimal algorithms for the same problem (i.e., asymptotically optimal as we spend more bits),…

Machine Learning · Computer Science 2023-10-31 Berivan Isik , Wei-Ning Chen , Ayfer Ozgur , Tsachy Weissman , Albert No

We study the problem of privacy preservation in data sharing, where $S$ is a sensitive variable to be protected and $X$ is a non-sensitive useful variable correlated with $S$. Variable $X$ is randomized into variable $Y$, which will be…

Information Theory · Computer Science 2020-10-20 Parastoo Sadeghi , Ni Ding , Thierry Rakotoarivelo

Privacy definitions provide ways for trading-off the privacy of individuals in a statistical database for the utility of downstream analysis of the data. In this paper, we present Blowfish, a class of privacy definitions inspired by the…

Databases · Computer Science 2014-06-24 Xi He , Ashwin Machanavajjhala , Bolin Ding

Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong…

Cryptography and Security · Computer Science 2022-03-10 Akash Bharadwaj , Graham Cormode

We study an information-theoretic privacy mechanism design problem, where an agent observes useful data $Y$ that is arbitrarily correlated with sensitive data $X$, and design disclosed data $U$ generated from $Y$ (the agent has no direct…

Information Theory · Computer Science 2026-01-13 Amirreza Zamani , Sajad Daei , Parastoo Sadeghi , Mikael Skoglund

The pervasiveness of Internet of Things results in vast volumes of personal data generated by smart devices of users (data producers) such as smart phones, wearables and other embedded sensors. It is a common requirement, especially for Big…

Cryptography and Security · Computer Science 2018-05-08 Thomas Asikis , Evangelos Pournaras

We study the fundamental problems of identity testing (goodness of fit), and closeness testing (two sample test) of distributions over $k$ elements, under differential privacy. While the problems have a long history in statistics, finite…

Machine Learning · Computer Science 2017-11-01 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Data collecting agents in large networks, such as the electric power system, need to share information (measurements) for estimating the system state in a distributed manner. However, privacy concerns may limit or prevent this exchange…

Information Theory · Computer Science 2015-10-28 E. Veronica Belmega , Lalitha Sankar , H. Vincent Poor

This paper explores the implications of guaranteeing privacy by imposing a lower bound on the information density between the private and the public data. We introduce a novel and operationally meaningful privacy measure called pointwise…

Information Theory · Computer Science 2026-03-17 Sara Saeidian , Leonhard Grosse , Parastoo Sadeghi , Mikael Skoglund , Tobias J. Oechtering

Preference-based fine-tuning has become an important component in training large language models, and the data used at this stage may contain sensitive user information. A central question is how to design a differentially private pipeline…

Machine Learning · Statistics 2026-03-25 Young Hyun Cho , Will Wei Sun

As the use of differential privacy (DP) becomes widespread, the development of effective tools for reasoning about the privacy guarantee becomes increasingly critical. In pursuit of this goal, we demonstrate novel relationships between DP…

Cryptography and Security · Computer Science 2025-07-15 Zeki Kazan , Sagar Sharma , Wanrong Zhang , Bo Jiang , Qiang Yan

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu