English
Related papers

Related papers: A Tunable Measure for Information Leakage

200 papers

Information disclosure can compromise privacy when revealed information is correlated with private information. We consider the notion of inferential privacy, which measures privacy leakage by bounding the inferential power a Bayesian…

Cryptography and Security · Computer Science 2024-12-16 Shuaiqi Wang , Shuran Zheng , Zinan Lin , Giulia Fanti , Zhiwei Steven Wu

Model Inversion Attacks (MIAs) pose a significant threat to data privacy by reconstructing sensitive training samples from the knowledge embedded in trained machine learning models. Despite recent progress in enhancing the effectiveness of…

Cryptography and Security · Computer Science 2025-12-03 Hongyao Yu , Yixiang Qiu , Hao Fang , Tianqu Zhuang , Bin Chen , Sijin Yu , Bin Wang , Shu-Tao Xia , Ke Xu

Barycentric and pairwise quantum Renyi leakages are proposed as two measures of information leakage for privacy and security analysis in quantum computing and communication systems. These quantities both require minimal assumptions on the…

Quantum Physics · Physics 2024-02-12 Farhad Farokhi

We study the design of mechanisms -- e.g., auctions -- when the designer does not control information flows between mechanism participants. A mechanism equilibrium is leakage-proof if no player conditions their actions on leaked…

Theoretical Economics · Economics 2025-11-04 Samuel Häfner , Marek Pycia , Haoyuan Zeng

In collaborative learning, clients keep their data private and communicate only the computed gradients of the deep neural network being trained on their local data. Several recent attacks show that one can still extract private information…

Machine Learning · Computer Science 2022-07-26 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Soteris Demetriou , Deniz Gündüz , Hamed Haddadi

This paper introduces a case study that involves data leakage in a bank applying the so-called Thinging Machine (TM) model. The aim is twofold: (1) Presenting a systematic conceptual framework for the leakage problem that provides a…

Software Engineering · Computer Science 2018-12-03 Sabah S. Al-Fedaghi , Mahmoud BehBehani

Opacity is a general language-theoretic framework in which several security properties of a system can be expressed. Its parameters are a predicate, given as a subset of runs of the system, and an observation function, from the set of runs…

Cryptography and Security · Computer Science 2019-02-20 B. Bérard , J. Mullins , M. Sassolas

Properness for supervised losses stipulates that the loss function shapes the learning algorithm towards the true posterior of the data generating distribution. Unfortunately, data in modern machine learning can be corrupted or twisted in…

Machine Learning · Computer Science 2022-02-02 Tyler Sypherd , Richard Nock , Lalitha Sankar

We investigate the tradeoff between privacy and utility in a situation where both privacy and utility are measured in terms of mutual information. For the binary case, we fully characterize this tradeoff in case of perfect privacy and also…

Information Theory · Computer Science 2015-10-09 Shahab Asoodeh , Fady Alajaji , Tamás Linder

We study an information theoretic privacy mechanism design problem for two scenarios where the private data is either observable or hidden. In each scenario, we first consider bounded mutual information as privacy leakage criterion, then we…

Information Theory · Computer Science 2022-12-26 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

The design of privacy mechanisms for two scenarios is studied where the private data is hidden or observable. In the first scenario, an agent observes useful data $Y$, which is correlated with private data $X$, and wants to disclose the…

Information Theory · Computer Science 2023-01-16 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

Quantitative information flow (QIF) is concerned with assessing the leakage of information in computational systems. In QIF there are two main perspectives for the quantification of leakage. On one hand, the static perspective considers all…

Cryptography and Security · Computer Science 2025-10-27 Luigi D. C. Soares , Mário S. Alvim , Natasha Fernandes

We study the generalization error of stochastic learning algorithms from an information-theoretic perspective, with a particular emphasis on deriving sharper bounds for differentially private algorithms. It is well known that the…

Information Theory · Computer Science 2026-04-20 Yanxiao Liu , Chun Hei Michael Shiu , Lele Wang , Deniz Gündüz

This paper introduces a new attack on recent messaging systems that protect communication metadata. The main observation is that if an adversary manages to compromise a user's friend, it can use this compromised friend to learn information…

Cryptography and Security · Computer Science 2018-10-25 Sebastian Angel , David Lazar , Ioanna Tzialla

This paper presents a secrecy performance study of a wiretap communication system with finite blocklength (FBL) transmissions over Rayleigh fading channels, based on the definition of an average information leakage (AIL) metric. We evaluate…

Information Theory · Computer Science 2024-01-23 Milad Tatar Mamaghani , Xiangyun Zhou , Nan Yang , A. Lee Swindlehurst , H. Vincent Poor

The success of Large Language Models (LLMs) relies heavily on the huge amount of pre-training data learned in the pre-training phase. The opacity of the pre-training process and the training data causes the results of many benchmark tests…

Computation and Language · Computer Science 2025-03-03 Shiwen Ni , Xiangtao Kong , Chengming Li , Xiping Hu , Ruifeng Xu , Jia Zhu , Min Yang

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

A privacy-utility tradeoff is developed for an arbitrary set of finite-alphabet source distributions. Privacy is quantified using differential privacy (DP), and utility is quantified using expected Hamming distortion maximized over the set…

Information Theory · Computer Science 2018-08-02 Kousha Kalantari , Lalitha Sankar , Anand Sarwate

A conditional version of Sibson's $\alpha$-information is defined using a simple closed-form "log-expectation" expression, which satisfies important properties such as consistency, uniform expansion, and data processing inequalities. This…

Information Theory · Computer Science 2021-05-18 Yi Liu , Wei Cheng , Sylvain Guilley , Olivier Rioul

Comparing the top $k$ elements between two or more ranked results is a common task in many contexts and settings. A few measures have been proposed to compare top $k$ lists with attractive mathematical properties, but they face a number of…

Information Theory · Computer Science 2013-10-02 Arun Konagurthu , James Collier