English
Related papers

Related papers: Bounds on Maximal Leakage over Bayesian Networks

200 papers

We introduce a \emph{gain function} viewpoint of information leakage by proposing \emph{maximal $g$-leakage}, a rich class of operationally meaningful leakage measures that subsumes recently introduced leakage measures -- {maximal leakage}…

Information Theory · Computer Science 2023-12-08 Gowtham R. Kurri , Lalitha Sankar , Oliver Kosut

We study the information leakage to a guessing adversary in index coding with a general message distribution. Under both vanishing-error and zero-error decoding assumptions, we develop lower and upper bounds on the optimal leakage rate,…

Information Theory · Computer Science 2022-05-24 Yucheng Liu , Lawrence Ong , Phee Lep Yeoh , Parastoo Sadeghi , Joerg Kliewer , Sarah Johnson

We adopt an information-theoretic framework to analyze the generalization behavior of the class of iterative, noisy learning algorithms. This class is particularly suitable for study under information-theoretic metrics as the algorithms are…

Machine Learning · Computer Science 2023-07-20 Ibrahim Issa , Amedeo Roberto Esposito , Michael Gastpar

A bound on the maximum information transmission rate through a cascade of Gaussian links is presented. The network model consists of a source node attempting to send a message drawn from a finite alphabet to a sink, through a cascade of…

Information Theory · Computer Science 2013-01-29 Ramanan Subramanian , Badri Vellambi , Ingmar Land

We study the information leakage to a guessing adversary in zero-error source coding. The source coding problem is defined by a confusion graph capturing the distinguishability between source symbols. The information leakage is measured by…

Information Theory · Computer Science 2021-02-04 Yucheng Liu , Lawrence Ong , Sarah Johnson , Joerg Kliewer , Parastoo Sadeghi , Phee Lep Yeoh

Nonlinear aggregation is central to modern distributed systems, yet its privacy behavior is far less understood than that of linear aggregation. Unlike linear aggregation where mature mechanisms can often suppress information leakage,…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Wenrui Yu , Jaron Skovsted Gundersen , Richard Heusdens , Qiongxiu Li

In this work, maximal $\alpha$-leakage is introduced to quantify how much a quantum adversary can learn about any sensitive information of data upon observing its disturbed version via a quantum privacy mechanism. We first show that an…

Quantum Physics · Physics 2024-03-22 Bo-Yu Yang , Hsuan Yu , Hao-Chung Cheng

In today's data-driven world, the proliferation of publicly available information raises security concerns due to the information leakage (IL) problem. IL involves unintentionally exposing sensitive information to unauthorized parties via…

Machine Learning · Statistics 2025-06-02 Pritha Gupta , Marcel Wever , Eyke Hüllermeier

We consider the problem of parameter estimation in a Bayesian setting and propose a general lower-bound that includes part of the family of $f$-Divergences. The results are then applied to specific settings of interest and compared to other…

Information Theory · Computer Science 2022-05-19 Adrien Vandenbroucque , Amedeo Roberto Esposito , Michael Gastpar

It is already known that in multicast (single source, multiple sinks) network, random linear network coding can achieve the maximum flow upper bound. In this paper, we investigate how random linear network coding behaves in general…

Information Theory · Computer Science 2012-10-09 Yuan Li

We study the generalization error of stochastic learning algorithms from an information-theoretic perspective, with a particular emphasis on deriving sharper bounds for differentially private algorithms. It is well known that the…

Information Theory · Computer Science 2026-04-20 Yanxiao Liu , Chun Hei Michael Shiu , Lele Wang , Deniz Gündüz

Large Language Models (LLMs) are trained on massive web-crawled corpora. This poses risks of leakage, including personal information, copyrighted texts, and benchmark datasets. Such leakage leads to undermining human trust in AI due to…

Computation and Language · Computer Science 2024-03-26 Masahiro Kaneko , Timothy Baldwin

For $\tilde{f}(t) = \exp(\frac{\alpha-1}{\alpha}t)$, this paper shows that the Sibson mutual information is an $\alpha$-leakage averaged over the adversary's $\tilde{f}$-mean relative information gain (on the secret) at elementary event of…

Information Theory · Computer Science 2025-10-09 Ni Ding , Farhad Farokhi , Tao Guo , Yinfei Xu , Xiang Zhang

We introduce a tunable measure for information leakage called maximal alpha-leakage. This measure quantifies the maximal gain of an adversary in inferring any (potentially random) function of a dataset from a release of the data. The…

Information Theory · Computer Science 2019-08-21 Jiachun Liao , Oliver Kosut , Lalitha Sankar , Flavio du Pin Calmon

Information leakage rate is an intuitive metric that reflects the level of security in a wireless communication system, however, there are few studies taking it into consideration. Existing work on information leakage rate has two major…

Cryptography and Security · Computer Science 2018-07-23 Yong Huang , Wei Wang , Biao He , Liang Sun , Tao Jiang

We consider problems where $n$ people are communicating and a random subset of them is trying to leak information, without making it clear who are leaking the information. We introduce a measure of suspicion, and show that the amount of…

Cryptography and Security · Computer Science 2014-02-14 Sune K Jakobsen

This paper proposes an operational measure of non-stochastic information leakage to formalize privacy against a brute-force guessing adversary. The information is measured by non-probabilistic uncertainty of uncertain variables, the…

Information Theory · Computer Science 2021-07-05 Ni Ding , Farhad Farokhi

We derive an exponentially decaying upper-bound on the unnormalized amount of information leaked to the wire-tapper in Wyner's wire-tap channel setting. We characterize the exponent of the bound as a function of the randomness used by the…

Information Theory · Computer Science 2016-02-12 Mani Bastani Parizi , Emre Telatar

Information theoretic leakage metrics quantify the amount of information about a private random variable $X$ that is leaked through a correlated revealed variable $Y$. They can be used to evaluate the privacy of a system in which an…

Information Theory · Computer Science 2025-05-15 Sophie Taylor , Praneeth Kumar Vippathalla , Justin P. Coon

We prove a lower bound on the information leakage of any classical protocol computing the equality function in the simultaneous message passing (SMP) model. Our bound is valid in the finite length regime and is strong enough to demonstrate…

Computational Complexity · Computer Science 2016-07-27 Juan Miguel Arrazola , Dave Touchette