English
Related papers

Related papers: A Tunable Measure for Information Leakage

200 papers

Machine learning (ML) models are known to be vulnerable to a number of attacks that target the integrity of their predictions or the privacy of their training data. To carry out these attacks, a black-box adversary must typically possess…

Cryptography and Security · Computer Science 2023-09-06 Dudi Biton , Aditi Misra , Efrat Levy , Jaidip Kotak , Ron Bitton , Roei Schuster , Nicolas Papernot , Yuval Elovici , Ben Nassi

This paper explores the implications of guaranteeing privacy by imposing a lower bound on the information density between the private and the public data. We introduce a novel and operationally meaningful privacy measure called pointwise…

Information Theory · Computer Science 2026-03-17 Sara Saeidian , Leonhard Grosse , Parastoo Sadeghi , Mikael Skoglund , Tobias J. Oechtering

This paper investigates lift, the likelihood ratio between the posterior and prior belief about sensitive features in a dataset. Maximum and minimum lifts over sensitive features quantify the adversary's knowledge gain and should be bounded…

Information Theory · Computer Science 2023-05-10 Mohammad Amin Zarrabian , Ni Ding , Parastoo Sadeghi

From the perspective of information bottleneck (IB) theory, we propose a novel framework for performing black-box transferable adversarial attacks named IBTA, which leverages advancements in invariant features. Intuitively, diminishing the…

Machine Learning · Computer Science 2024-06-11 Biqing Qi , Junqi Gao , Jianxing Liu , Ligang Wu , Bowen Zhou

We study the pointwise maximal leakage (PML) envelope of the Gaussian mechanism, which characterizes the smallest information leakage bound that holds with high probability under arbitrary post-processing. For the Gaussian mechanism with a…

Information Theory · Computer Science 2026-01-15 Sara Saeidian

The study of leakage measures for privacy has been a subject of intensive research and is an important aspect of understanding how privacy leaks occur in computer systems. Differential privacy has been a focal point in the privacy community…

Information Theory · Computer Science 2023-05-19 Natasha Fernandes , Annabelle McIver , Parastoo Sadeghi

Hypothesis testing is a statistical inference framework for determining the true distribution among a set of possible distributions for a given dataset. Privacy restrictions may require the curator of the data or the respondents themselves…

Information Theory · Computer Science 2017-04-28 Jiachun Liao , Lalitha Sankar , Vincent Y. F. Tan , Flavio P. Calmon

The inevitable leakage of privacy as a result of unrestrained disclosure of personal information has motivated extensive research on robust privacy-preserving mechanisms. However, existing research is mostly limited to solving the problem…

Cryptography and Security · Computer Science 2022-08-23 Chandra Sharma , George Amariucai , Shuangqing Wei

Privacy leakage in LLM agents is often studied through individual storage or execution components, such as memory modules, retrieval pipelines, or tool-mediated artifacts. However, these settings are typically analyzed in isolation, making…

Cryptography and Security · Computer Science 2026-03-31 Tao Huang , Chen Hou , Guosen Wu , Jiayang Meng

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

We prove a two-way correspondence between the min-max optimization of general CPE loss function GANs and the minimization of associated $f$-divergences. We then focus on $\alpha$-GAN, defined via the $\alpha$-loss, which interpolates…

Machine Learning · Computer Science 2022-05-16 Gowtham R. Kurri , Monica Welfert , Tyler Sypherd , Lalitha Sankar

Cryptographic research takes software timing side channels seriously. Approaches to mitigate them include constant-time coding and techniques to enforce such practices. However, recent attacks like Meltdown [42], Spectre [37], and…

Cryptography and Security · Computer Science 2025-04-29 Martin Dunsche , Patrick Bastian , Marcel Maehren , Nurullah Erinola , Robert Merget , Nicolai Bissantz , Holger Dette , Jörg Schwenk

An attacker can gain information of a user by analyzing its network traffic. The size of transferred data leaks information about the file being transferred or the service being used, and this is particularly revealing when the attacker has…

Cryptography and Security · Computer Science 2022-09-12 Sebastian Simon , Cezara Petrui , Carlos Pinzón , Catuscia Palamidessi

The so-called {\em leakage-chain rule} is a very important tool used in many security proofs. It gives an upper bound on the entropy loss of a random variable $X$ in case the adversary who having already learned some random variables…

Information Theory · Computer Science 2013-11-26 Maciej Skorski

Private information retrieval protocols guarantee that a user can privately and losslessly retrieve a single file from a database stored across multiple servers. In this work, we propose to simultaneously relax the conditions of perfect…

Information Theory · Computer Science 2022-01-07 Yauhen Yakimenka , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

To continuously improve quality and reflect changes in data, machine learning applications have to regularly retrain and update their core models. We show that a differential analysis of language model snapshots before and after an update…

Reconstruction attacks and defenses are essential in understanding the data leakage problem in machine learning. However, prior work has centered around empirical observations of gradient inversion attacks, lacks theoretical grounding, and…

Cryptography and Security · Computer Science 2025-03-25 Sheng Liu , Zihan Wang , Yuxiao Chen , Qi Lei

We explore a family of information measures that stems from R\'enyi's $\alpha$-Divergences with $\alpha<0$. In particular, we extend the definition of Sibson's $\alpha$-Mutual Information to negative values of $\alpha$ and show several…

Information Theory · Computer Science 2022-02-09 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

Link prediction is a fundamental problem in network science, aiming to infer potential or missing links based on observed network structures. With the increasing adoption of parameterized models, the rigor of evaluation protocols has become…

Other Statistics · Statistics 2026-04-09 Xinshan Jiao , Yuxin Luo , Yilin Bi , Tao Zhou

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida