English
Related papers

Related papers: Information-Theoretic Privacy with General Distort…

200 papers

In this paper, we define noiseless privacy, as a non-stochastic rival to differential privacy, requiring that the outputs of a mechanism (i.e., function composition of a privacy-preserving mapping and a query) can attain only a few values…

Information Theory · Computer Science 2019-10-30 Farhad Farokhi

Through the lens of information-theoretic reductions, we examine a reductions approach to fair optimization and learning where a black-box optimizer is used to learn a fair model for classification or regression. Quantifying the complexity,…

Machine Learning · Computer Science 2021-05-25 Daniel Alabi

Large-scale machine learning systems often involve data distributed across a collection of users. Federated learning algorithms leverage this structure by communicating model updates to a central server, rather than entire datasets. In this…

Machine Learning · Statistics 2022-07-19 Alberto Bietti , Chen-Yu Wei , Miroslav Dudík , John Langford , Zhiwei Steven Wu

This paper studies the statistical characterization of detecting an adversary who wants to harm some computation such as machine learning models or aggregation by altering the output of a differentially private mechanism in addition to…

Information Theory · Computer Science 2021-06-28 Ayşe Ünsal , Melek Önen

Smart-metering systems report electricity usage of a user to the utility provider on almost real-time basis. This could leak private information about the user to the utility provider. In this work we investigate the use of a rechargeable…

Information Theory · Computer Science 2017-09-19 Simon Li , Ashish Khisti , Aditya Mahajan

We present a framework for designing distorting mechanisms that allow remotely operating anomaly detectors while preserving privacy. We consider the problem setting in which a remote station seeks to identify anomalies using system…

Systems and Control · Electrical Eng. & Systems 2023-09-08 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

To enable an ethical and legal use of machine learning algorithms, they must both be fair and protect the privacy of those whose data are being used. However, implementing privacy and fairness constraints might come at the cost of utility…

Machine Learning · Computer Science 2021-02-12 Marlotte Pannekoek , Giacomo Spigler

As an increasing amount of data is gathered nowadays and stored in databases (DBs), the question arises of how to protect the privacy of individual records in a DB even while providing accurate answers to queries on the DB. Differential…

Information Theory · Computer Science 2022-03-02 Arun Padakandla , P. R. Kumar , Wojciech Szpankowski

Machine learning models require datasets for effective training, but directly sharing raw data poses significant privacy risk such as membership inference attacks (MIA). To mitigate the risk, privacy-preserving techniques such as data…

Machine Learning · Computer Science 2025-09-03 Yi Yin , Guangquan Zhang , Hua Zuo , Jie Lu

Organizations often collect private data and release aggregate statistics for the public's benefit. If no steps toward preserving privacy are taken, adversaries may use released statistics to deduce unauthorized information about the…

Cryptography and Security · Computer Science 2022-01-19 Priyanka Nanayakkara , Johes Bater , Xi He , Jessica Hullman , Jennie Rogers

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

Fairness and privacy are two vital pillars of trustworthy machine learning. Despite extensive research on these individual topics, their relationship has received significantly less attention. In this paper, we utilize an…

Machine Learning · Computer Science 2026-03-25 Arjun Nichani , Hsiang Hsu , Chun-Fu , Chen , Haewon Jeong

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

Motivated by understanding the dynamics of sensitive social networks over time, we consider the problem of continual release of statistics in a network that arrives online, while preserving privacy of its participants. For our privacy…

Cryptography and Security · Computer Science 2018-09-20 Shuang Song , Susan Little , Sanjay Mehta , Staal Vinterbo , Kamalika Chaudhuri

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

A distributed binary hypothesis testing (HT) problem involving two parties, a remote observer and a detector, is studied. The remote observer has access to a discrete memoryless source, and communicates its observations to the detector via…

Information Theory · Computer Science 2020-04-30 Sreejith Sreekumar , Asaf Cohen , Deniz Gündüz

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

In this paper, we present an optimization-based formulation for privacy-utility tradeoff in the Ensemble and Unscented Kalman filtering framework, with a focus on space situational awareness. Privacy and utility are defined in terms of a…

Optimization and Control · Mathematics 2019-12-10 Niladri Das , Raktim Bhattacharya

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world scenarios…

Cryptography and Security · Computer Science 2023-10-23 Syomantak Chaudhuri , Konstantin Miagkov , Thomas A. Courtade