English
Related papers

Related papers: On the Privacy-Robustness-Utility Trilemma in Dist…

200 papers

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

Mechanisms used in privacy-preserving machine learning often aim to guarantee differential privacy (DP) during model training. Practical DP-ensuring training methods use randomization when fitting model parameters to privacy-sensitive data…

Machine Learning · Computer Science 2023-05-16 Bogdan Kulynych , Hsiang Hsu , Carmela Troncoso , Flavio P. Calmon

Differential privacy (DP) is a neat privacy definition that can co-exist with certain well-defined data uses in the context of interactive queries. However, DP is neither a silver bullet for all privacy problems nor a replacement for all…

Cryptography and Security · Computer Science 2020-11-05 Josep Domingo-Ferrer , David Sánchez , Alberto Blanco-Justicia

Machine learning (ML) systems are increasingly deployed in high-stakes domains where reliability is paramount. This thesis investigates how uncertainty estimation can enhance the safety and trustworthiness of ML, focusing on selective…

Machine Learning · Computer Science 2025-09-09 Stephan Rabanser

Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make…

Machine Learning · Computer Science 2023-01-10 Zongshun Zhang , Andrea Pinto , Valeria Turina , Flavio Esposito , Ibrahim Matta

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

We consider data release protocols for data $X=(S,U)$, where $S$ is sensitive; the released data $Y$ contains as much information about $X$ as possible, measured as $\operatorname{I}(X;Y)$, without leaking too much about $S$. We introduce…

Cryptography and Security · Computer Science 2021-01-25 Milan Lopuhaä-Zwakenberg , Jasper Goseling

Emerging Distributed AI systems are revolutionizing big data computing and data processing capabilities with growing economic and societal impact. However, recent studies have identified new attack surfaces and risks caused by security,…

Machine Learning · Computer Science 2024-02-05 Wenqi Wei , Ling Liu

Differential privacy (DP), as a rigorous mathematical definition quantifying privacy leakage, has become a well-accepted standard for privacy protection. Combined with powerful machine learning techniques, differentially private machine…

Machine Learning · Computer Science 2023-10-17 Chengkun Wei , Minghu Zhao , Zhikun Zhang , Min Chen , Wenlong Meng , Bo Liu , Yuan Fan , Wenzhi Chen

Differential privacy (DP) ensures that training a machine learning model does not leak private data. In practice, we may have access to auxiliary public data that is free of privacy concerns. In this work, we assume access to a given amount…

Machine Learning · Computer Science 2024-09-11 Andrew Lowy , Zeman Li , Tianjian Huang , Meisam Razaviyayn

We propose a general learning framework for the protection mechanisms that protects privacy via distorting model parameters, which facilitates the trade-off between privacy and utility. The algorithm is applicable to arbitrary privacy…

Machine Learning · Computer Science 2023-06-06 Xiaojin Zhang , Wenjie Li , Kai Chen , Shutao Xia , Qiang Yang

To enable an ethical and legal use of machine learning algorithms, they must both be fair and protect the privacy of those whose data are being used. However, implementing privacy and fairness constraints might come at the cost of utility…

Machine Learning · Computer Science 2021-02-12 Marlotte Pannekoek , Giacomo Spigler

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world scenarios…

Cryptography and Security · Computer Science 2023-10-23 Syomantak Chaudhuri , Konstantin Miagkov , Thomas A. Courtade

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

While significant progress has been made in conventional fairness-aware machine learning (ML) and differentially private ML (DPML), the fairness of privacy protection across groups remains underexplored. Existing studies have proposed…

Machine Learning · Computer Science 2025-11-18 Zhi Yang , Changwu Huang , Ke Tang , Xin Yao

With the increasing adoption of data-hungry machine learning algorithms, personal data privacy has emerged as one of the key concerns that could hinder the success of digital transformation. As such, Privacy-Preserving Machine Learning…

Cryptography and Security · Computer Science 2022-04-22 Ziyao Liu , Jiale Guo , Kwok-Yan Lam , Jun Zhao

Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm that guarantees user privacy and prevents the risk of data leakage due to the advantage of the client's local training. Researchers have struggled…

Machine Learning · Computer Science 2023-12-01 Kangkang Sun , Xiaojin Zhang , Xi Lin , Gaolei Li , Jing Wang , Jianhua Li

Empirical defenses for machine learning privacy forgo the provable guarantees of differential privacy in the hope of achieving higher utility while resisting realistic adversaries. We identify severe pitfalls in existing empirical privacy…

Cryptography and Security · Computer Science 2024-09-06 Michael Aerni , Jie Zhang , Florian Tramèr

Privacy-Preserving machine learning (PPML) can help us train and deploy models that utilize private information. In particular, on-device machine learning allows us to avoid sharing raw data with a third-party server during inference.…

Machine Learning · Computer Science 2024-01-23 Xinchi Qiu , Ilias Leontiadis , Luca Melis , Alex Sablayrolles , Pierre Stock