English
Related papers

Related papers: Information Contraction under $(\varepsilon,\delta…

200 papers

Our research delves into the balance between maintaining privacy and preserving statistical accuracy when dealing with multivariate data that is subject to \textit{componentwise local differential privacy} (CLDP). With CLDP, each component…

Statistics Theory · Mathematics 2025-01-22 Chiara Amorino , Arnaud Gloter

Differential privacy (DP) is by far the most widely accepted framework for mitigating privacy risks in machine learning. However, exactly how small the privacy parameter $\epsilon$ needs to be to protect against certain privacy risks in…

Machine Learning · Computer Science 2023-08-11 Chuan Guo , Alexandre Sablayrolles , Maziar Sanjabi

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

Differential privacy (DP) has been accepted as a rigorous criterion for measuring the privacy protection offered by random mechanisms used to obtain statistics or, as we will study here, synthetic datasets from confidential data. Methods to…

Methodology · Statistics 2024-05-09 Leila Nombo , Anne-Sophie Charest

Through the lens of information-theoretic reductions, we examine a reductions approach to fair optimization and learning where a black-box optimizer is used to learn a fair model for classification or regression. Quantifying the complexity,…

Machine Learning · Computer Science 2021-05-25 Daniel Alabi

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

Machine Learning · Computer Science 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

We study parametric change-point detection, where the goal is to identify distributional changes in time series, under local differential privacy. In the non-private setting, we derive improved finite-sample accuracy guarantees for a…

Machine Learning · Statistics 2026-02-17 Anuj Kumar Yadav , Cemre Cadir , Yanina Shkel , Michael Gastpar

We consider the problem of estimating sparse discrete distributions under local differential privacy (LDP) and communication constraints. We characterize the sample complexity for sparse estimation under LDP constraints up to a constant…

Information Theory · Computer Science 2021-02-22 Jayadev Acharya , Peter Kairouz , Yuhan Liu , Ziteng Sun

Differential privacy (DP) is a mathematical framework that guarantees individual privacy; however, systematic evaluation of its impact on statistical utility in survival analyses remains limited. In this study, we systematically evaluated…

Cryptography and Security · Computer Science 2026-04-24 Keita Fukuyama , Yukiko Mori , Tomohiro Kuroda , Hiroaki Kikuchi

Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters $(\epsilon,\delta)$. Choosing…

Cryptography and Security · Computer Science 2021-07-21 Daniel Bernau , Günther Eibl , Philip W. Grassal , Hannah Keller , Florian Kerschbaum

In the recent decades, the advance of information technology and abundant personal data facilitate the application of algorithmic personalized pricing. However, this leads to the growing concern of potential violation of privacy due to…

Machine Learning · Statistics 2021-09-13 Xi Chen , Sentao Miao , Yining Wang

Density-adaptive domain discretization is essential for high-utility privacy-preserving analytics but remains challenging under Local Differential Privacy (LDP) due to the privacy-budget costs associated with iterative refinement. We…

Machine Learning · Computer Science 2026-02-24 Alexey Kroshnin , Alexandra Suvorikova

Federated Learning (FL) is emerging as a promising paradigm of privacy-preserving machine learning, which trains an algorithm across multiple clients without exchanging their data samples. Recent works highlighted several privacy and…

Cryptography and Security · Computer Science 2021-06-15 Yaowei Han , Yang Cao , Masatoshi Yoshikawa

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

Differential Privacy (DP) provides a rigorous framework for releasing statistics while protecting individual information present in a dataset. Although substantial progress has been made on differentially private linear regression, existing…

Statistics Theory · Mathematics 2026-01-16 Getoar Sopa , Marco Avella Medina , Cynthia Rush

This paper is focused on derivations of data-processing and majorization inequalities for $f$-divergences, and their applications in information theory and statistics. For the accessibility of the material, the main results are first…

Information Theory · Computer Science 2020-01-08 Igal Sason

Label differential privacy (DP) is designed for learning problems involving private labels and public features. While various methods have been proposed for learning under label DP, the theoretical limits remain largely unexplored. In this…

Machine Learning · Computer Science 2025-03-04 Puning Zhao , Chuan Ma , Li Shen , Shaowei Wang , Rongfei Fan

The data-processing inequality, that is, $I(U;Y) \le I(U;X)$ for a Markov chain $U \to X \to Y$, has been the method of choice for proving impossibility (converse) results in information theory and many other disciplines. Various…

Information Theory · Computer Science 2016-08-01 Yury Polyanskiy , Yihong Wu

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

Machine Learning · Computer Science 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

Federated learning (FL) enables the collaborative training of large-scale language models (LLMs) across edge devices while keeping user data on-device. However, FL still exposes sensitive information through client-provided gradients.…

Machine Learning · Computer Science 2026-05-12 Haaris Mehmood , Jie Xu , Karthikeyan Saravanan , Rogier Van Dalen , Mete Ozay