English
Related papers

Related papers: Data Privacy and Utility Trade-Off Based on Mutual…

200 papers

Differential privacy is a precise mathematical constraint meant to ensure privacy of individual pieces of information in a database even while queries are being answered about the aggregate. Intuitively, one must come to terms with what…

Information Theory · Computer Science 2016-08-15 Paul Cuff , Lanqing Yu

As reinforcement learning techniques are increasingly applied to real-world decision problems, attention has turned to how these algorithms use potentially sensitive information. We consider the task of training a policy that maximizes…

Machine Learning · Computer Science 2024-04-17 Chris Cundy , Rishi Desai , Stefano Ermon

This paper is concerned with enhancing data utility in the privacy watchdog method for attaining information-theoretic privacy. For a specific privacy constraint, the watchdog method filters out the high-risk data symbols through applying a…

Information Theory · Computer Science 2021-10-12 Mohammad Amin Zarrabian , Ni Ding , Parastoo Sadeghi , Thierry Rakotoarivelo

Consider a data publishing setting for a data set with public and private features. The objective of the publisher is to maximize the amount of information about the public features in a revealed data set, while keeping the information…

Information Theory · Computer Science 2018-05-11 Hao Wang , Mario Diaz , Flavio P. Calmon , Lalitha Sankar

Deep ensemble learning has been shown to improve accuracy by training multiple neural networks and averaging their outputs. Ensemble learning has also been suggested to defend against membership inference attacks that undermine privacy. In…

Machine Learning · Computer Science 2023-05-26 Shahbaz Rezaei , Zubair Shafiq , Xin Liu

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Huge volume of data from domain specific applications such as medical, financial, library, telephone, shopping records and individual are regularly generated. Sharing of these data is proved to be beneficial for data mining application. On…

Databases · Computer Science 2013-06-07 Hitesh Chhinkaniwala , Sanjay Garg

The privacy-utility tradeoff problem is formulated as determining the privacy mechanism (random mapping) that minimizes the mutual information (a metric for privacy leakage) between the private features of the original dataset and a…

Information Theory · Computer Science 2026-05-12 Kousha Kalantari , Oliver Kosut , Lalitha Sankar

Networked system often relies on distributed algorithms to achieve a global computation goal with iterative local information exchanges between neighbor nodes. To preserve data privacy, a node may add a random noise to its original data for…

Information Theory · Computer Science 2017-03-21 Jianping He , Lin Cai , Xinping Guan

Many mobile applications and virtual conversational agents now aim to recognize and adapt to emotions. To enable this, data are transmitted from users' devices and stored on central servers. Yet, these data contain sensitive information…

Machine Learning · Computer Science 2019-10-30 Mimansa Jaiswal , Emily Mower Provost

We study differentially private distributed optimization under communication constraints. A server using SGD for optimization aggregates the client-side local gradients for model updates using distributed mean estimation (DME). We develop a…

Machine Learning · Computer Science 2023-02-23 Antonious M. Girgis , Suhas Diggavi

Data collecting agents in large networks, such as the electric power system, need to share information (measurements) for estimating the system state in a distributed manner. However, privacy concerns may limit or prevent this exchange…

Information Theory · Computer Science 2015-10-28 E. Veronica Belmega , Lalitha Sankar , H. Vincent Poor

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional DP formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world…

Cryptography and Security · Computer Science 2023-05-18 Syomantak Chaudhuri , Thomas A. Courtade

Network data needs to be shared for distributed security analysis. Anonymization of network data for sharing sets up a fundamental tradeoff between privacy protection versus security analysis capability. This privacy/analysis tradeoff has…

Cryptography and Security · Computer Science 2011-11-10 William Yurcik , Clay Woolam , Greg Hellings , Latifur Khan , Bhavani Thuraisingham

This paper is concerned with the security problem for interconnected systems, where each subsystem is required to detect local attacks using locally available information and the information received from its neighboring subsystems.…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Haojun Wang , Kun Liu , Baojia Li , Emilia Fridman , Yuanqing Xia

In an Internet of Things network, multiple sensors send information to a fusion center for it to infer a public hypothesis of interest. However, the same sensor information may be used by the fusion center to make inferences of a private…

Information Theory · Computer Science 2017-06-30 Meng Sun , Wee Peng Tay , Xin He

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

We identify fundamental tradeoffs between statistical utility and privacy under local models of privacy in which data is kept private even from the statistician, providing instance-specific bounds for private estimation and learning…

Statistics Theory · Mathematics 2020-10-01 John C. Duchi , Feng Ruan

Deploying machine learning (ML) models often requires both fairness and privacy guarantees. Both of these objectives present unique trade-offs with the utility (e.g., accuracy) of the model. However, the mutual interactions between…

Machine Learning · Computer Science 2023-02-21 Mohammad Yaghini , Patty Liu , Franziska Boenisch , Nicolas Papernot

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao