English
Related papers

Related papers: Information-Theoretic Privacy with General Distort…

200 papers

Bottleneck problems are an important class of optimization problems that have recently gained increasing attention in the domain of machine learning and information theory. They are widely used in generative models, fair machine learning…

Machine Learning · Computer Science 2022-07-12 Behrooz Razeghi , Flavio P. Calmon , Deniz Gunduz , Slava Voloshynovskiy

How to achieve the tradeoff between privacy and utility is one of fundamental problems in private data analysis.In this paper, we give a rigourous differential privacy analysis of networks in the appearance of covariates via a generalized…

Methodology · Statistics 2023-11-20 Ting Yan

Machine learning models are deployed as a central component in decision making and policy operations with direct impact on individuals' lives. In order to act ethically and comply with government regulations, these models need to make fair…

Machine Learning · Computer Science 2023-11-28 Bogdan Ficiu , Neil D. Lawrence , Andrei Paleyes

Hierarchical text classification consists in classifying text documents into a hierarchy of classes and sub-classes. Although artificial neural networks have proved useful to perform this task, unfortunately they can leak training data…

Cryptography and Security · Computer Science 2021-12-10 Dominik Wunderlich , Daniel Bernau , Francesco Aldà , Javier Parra-Arnau , Thorsten Strufe

To prevent implicit privacy disclosure in sharing gradients among data owners (DOs) under federated learning (FL), differential privacy (DP) and its variants have become a common practice to offer formal privacy guarantees with low…

Computer Science and Game Theory · Computer Science 2023-02-16 Yuntao Wang , Zhou Su , Yanghe Pan , Abderrahim Benslimane , Yiliang Liu , Tom H. Luan , Ruidong Li

Internet of things (IoT) devices are becoming increasingly popular thanks to many new services and applications they offer. However, in addition to their many benefits, they raise privacy concerns since they share fine-grained time-series…

Information Theory · Computer Science 2020-06-25 Ecenaz Erdemir , Pier Luigi Dragotti , Deniz Gunduz

Consider statistical learning (e.g. discrete distribution estimation) with local $\epsilon$-differential privacy, which preserves each data provider's privacy locally, we aim to optimize statistical data utility under the privacy…

Information Theory · Computer Science 2016-07-28 Shaowei Wang , Liusheng Huang , Pengzhan Wang , Yiwen Nie , Hongli Xu , Wei Yang , Xiang-Yang Li , Chunming Qiao

The privacy of machine learning models has become a significant concern in many emerging Machine-Learning-as-a-Service applications, where prediction services based on well-trained models are offered to users via pay-per-query. The lack of…

Machine Learning · Computer Science 2022-06-24 Xun Xian , Mingyi Hong , Jie Ding

We study the problem of privacy preservation in data sharing, where $S$ is a sensitive variable to be protected and $X$ is a non-sensitive useful variable correlated with $S$. Variable $X$ is randomized into variable $Y$, which will be…

Information Theory · Computer Science 2020-10-20 Parastoo Sadeghi , Ni Ding , Thierry Rakotoarivelo

In many practical applications of differential privacy, practitioners seek to provide the best privacy guarantees subject to a target level of accuracy. A recent line of work by Ligett et al. '17 and Whitehouse et al. '22 has developed such…

Cryptography and Security · Computer Science 2023-12-07 Ryan Rogers , Gennady Samorodnitsky , Zhiwei Steven Wu , Aaditya Ramdas

Federated learning (FL) enables participating parties to collaboratively build a global model with boosted utility without disclosing private data information. Appropriate protection mechanisms have to be adopted to fulfill the opposing…

Machine Learning · Computer Science 2023-07-24 Xiaojin Zhang , Yan Kang , Kai Chen , Lixin Fan , Qiang Yang

We present a novel way to compare the statistical cost of privacy mechanisms using their Dobrushin coefficient. Specifically, we provide upper and lower bounds for the Dobrushin coefficient of a privacy mechanism in terms of its maximal…

Information Theory · Computer Science 2018-01-22 Mario Diaz , Lalitha Sankar , Peter Kairouz

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

Algorithmic fairness and privacy are essential pillars of trustworthy machine learning. Fair machine learning aims at minimizing discrimination against protected groups by, for example, imposing a constraint on models to equalize their…

Machine Learning · Statistics 2021-04-08 Hongyan Chang , Reza Shokri

Differential Privacy protects individuals' data when statistical queries are published from aggregated databases: applying "obfuscating" mechanisms to the query results makes the released information less specific but, unavoidably, also…

Cryptography and Security · Computer Science 2021-07-27 Natasha Fernandes , Annabelle McIver , Carroll Morgan

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

This paper studies the design of an optimal privacyaware estimator of a public random variable based on noisy measurements which contain private information. The public random variable carries non-private information, however, its estimate…

Optimization and Control · Mathematics 2018-08-08 Ehsan Nekouei , Henrik Sandberg , Mikael Skoglund , Karl H. Johansson

We study the problem of estimating a functional $\theta(\mathbb P)$ of an unknown probability distribution $\mathbb P \in\mathcal P$ in which the original iid sample $X_1,\dots, X_n$ is kept private even from the statistician via an…

Statistics Theory · Mathematics 2019-05-29 Angelika Rohde , Lukas Steinberger

We focus on two mainstream privacy models: k-anonymity and differential privacy. Once a privacy model has been selected, the goal is to enforce it while preserving as much data utility as possible. The main objective of this thesis is to…

Cryptography and Security · Computer Science 2013-07-04 Jordi Soria-Comas

Local Differential Privacy (LDP) protocols allow an aggregator to obtain population statistics about sensitive data of a userbase, while protecting the privacy of the individual users. To understand the tradeoff between aggregator utility…

Cryptography and Security · Computer Science 2019-10-18 Milan Lopuhaä-Zwakenberg , Boris Škorić , Ninghui Li