English
Related papers

Related papers: A New Approach to Adaptive Data Analysis and Learn…

200 papers

This paper considers minimax and adaptive transfer learning for nonparametric classification under the posterior drift model with distributed differential privacy constraints. Our study is conducted within a heterogeneous framework,…

Statistics Theory · Mathematics 2024-07-01 Arnab Auddy , T. Tony Cai , Abhinav Chakraborty

We introduce a privacy measure called statistic maximal leakage that quantifies how much a privacy mechanism leaks about a specific secret, relative to the adversary's prior information about that secret. Statistic maximal leakage is an…

Information Theory · Computer Science 2024-11-28 Shuaiqi Wang , Zinan Lin , Giulia Fanti

We study the generalization error of stochastic learning algorithms from an information-theoretic perspective, with a particular emphasis on deriving sharper bounds for differentially private algorithms. It is well known that the…

Information Theory · Computer Science 2026-04-20 Yanxiao Liu , Chun Hei Michael Shiu , Lele Wang , Deniz Gündüz

A great deal of effort has been devoted to reducing the risk of spurious scientific discoveries, from the use of sophisticated validation techniques, to deep statistical methods for controlling the false discovery rate in multiple…

Machine Learning · Computer Science 2016-03-03 Cynthia Dwork , Vitaly Feldman , Moritz Hardt , Toniann Pitassi , Omer Reingold , Aaron Roth

We propose an operational measure of information leakage in a non-stochastic setting to formalize privacy against a brute-force guessing adversary. We use uncertain variables, non-probabilistic counterparts of random variables, to construct…

Information Theory · Computer Science 2021-01-29 Farhad Farokhi , Ni Ding

This work investigates the problem of analyzing privacy of abrupt changes for general Markov processes. These processes may be affected by changes, or exogenous signals, that need to remain private. Privacy refers to the disclosure of…

Systems and Control · Electrical Eng. & Systems 2021-10-04 Alessio Russo , Alexandre Proutiere

We study the design of differentially private algorithms for adaptive analysis of dynamically growing databases, where a database accumulates new data entries while the analysis is ongoing. We provide a collection of tools for machine…

Data Structures and Algorithms · Computer Science 2018-03-20 Rachel Cummings , Sara Krehbiel , Kevin A. Lai , Uthaipon Tantipongpipat

In this thesis we consider the problem of information hiding in the scenarios of interactive systems, statistical disclosure control, and refinement of specifications. We apply quantitative approaches to information flow in the first two…

Cryptography and Security · Computer Science 2012-02-14 Mário S. Alvim

A deterministic privacy metric using non-stochastic information theory is developed. Particularly, minimax information is used to construct a measure of information leakage, which is inversely proportional to the measure of privacy. Anyone…

Information Theory · Computer Science 2019-03-07 Farhad Farokhi

How can agents exchange information to learn while protecting privacy? Healthcare centers collaborating on clinical trials must balance knowledge sharing with safeguarding sensitive patient data. We address this challenge by using…

Machine Learning · Computer Science 2025-03-19 Marios Papachristou , M. Amin Rahimian

Federated learning has emerged as a promising paradigm for collaborative model training while preserving data privacy. However, recent studies have shown that it is vulnerable to various privacy attacks, such as data reconstruction attacks.…

Cryptography and Security · Computer Science 2024-07-25 Xiaojin Zhang , Wei Chen

The authors discuss their experience applying differential privacy with a complex data set with the goal of enabling standard approaches to statistical data analysis. They highlight lessons learned and roadblocks encountered, distilling…

Cryptography and Security · Computer Science 2023-10-02 Joshua Snoke , Claire McKay Bowen , Aaron R. Williams , Andrés F. Barrientos

We study an information theoretic privacy mechanism design problem for two scenarios where the private data is either observable or hidden. In each scenario, we first consider bounded mutual information as privacy leakage criterion, then we…

Information Theory · Computer Science 2022-12-26 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

Traditional statistical theory assumes that the analysis to be performed on a given data set is selected independently of the data themselves. This assumption breaks downs when data are re-used across analyses and the analysis to be…

Machine Learning · Computer Science 2017-06-06 Adam Smith

Nonlinear aggregation is central to modern distributed systems, yet its privacy behavior is far less understood than that of linear aggregation. Unlike linear aggregation where mature mechanisms can often suppress information leakage,…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Wenrui Yu , Jaron Skovsted Gundersen , Richard Heusdens , Qiongxiu Li

Data-driven advancements significantly contribute to societal progress, yet they also pose substantial risks to privacy. In this landscape, differential privacy (DP) has become a cornerstone in privacy preservation efforts. However, the…

Cryptography and Security · Computer Science 2025-02-11 Sara Saeidian , Tobias J. Oechtering , Mikael Skoglund

Differential privacy offers formal quantitative guarantees for algorithms over datasets, but it assumes attackers that know and can influence all but one record in the database. This assumption often vastly overapproximates the attackers'…

Cryptography and Security · Computer Science 2020-12-01 Damien Desfontaines , Esfandiar Mohammadi , Elisabeth Krahmer , David Basin

Differential privacy is a rigorous mathematical framework for evaluating and protecting data privacy. In most existing studies, there is a vulnerable assumption that records in a dataset are independent when differential privacy is applied.…

Cryptography and Security · Computer Science 2021-01-12 Tao Zhang , Tianqing Zhu , Renping Liu , Wanlei Zhou

The increasing availability of personal data has enabled significant advances in fields such as machine learning, healthcare, and cybersecurity. However, this data abundance also raises serious privacy concerns, especially in light of…

Cryptography and Security · Computer Science 2026-04-24 Napsu Karmitsa , Antti Airola , Tapio Pahikkala , Tinja Pitkämäki

It has been widely understood that differential privacy (DP) can guarantee rigorous privacy against adversaries with arbitrary prior knowledge. However, recent studies demonstrate that this may not be true for correlated data, and indicate…

Machine Learning · Computer Science 2019-06-07 Yanan Li , Xuebin Ren , Shusen Yang , Xinyu Yang