English
Related papers

Related papers: Differentially Private Learning with Adaptive Clip…

200 papers

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated learning, as a distributed architecture, shows great promise for applications in Cyber-Physical-Social Systems (CPSS). In order to mitigate the privacy risks inherent in CPSS, the integration of differential privacy with federated…

Machine Learning · Computer Science 2025-06-05 Jiayi Wan , Xiang Zhu , Fanzhen Liu , Wei Fan , Xiaolong Xu

Federated Learning (FL) faces challenges from client data heterogeneity and resource-constrained mobile devices, which can degrade model accuracy. Personalized Federated Learning (PFL) addresses this issue by adapting shared global…

Machine Learning · Computer Science 2026-04-21 Xingyan Chen , Tian Du , Changqiao Xu , Fuzhen Zhuang , Lujie Zhong , Gabriel-Miro Muntean , Enmao Diao

Differential Privacy (DP) is the leading approach to privacy preserving deep learning. As such, there are multiple efforts to provide drop-in integration of DP into popular frameworks. These efforts, which add noise to each gradient…

Machine Learning · Statistics 2021-06-08 Mathias Lécuyer

Broad adoption of machine learning techniques has increased privacy concerns for models trained on sensitive data such as medical records. Existing techniques for training differentially private (DP) models give rigorous privacy guarantees,…

Machine Learning · Statistics 2019-10-04 Zhengli Zhao , Nicolas Papernot , Sameer Singh , Neoklis Polyzotis , Augustus Odena

Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange…

We propose new techniques for reducing communication in private federated learning without the need for setting or tuning compression rates. Our on-the-fly methods automatically adjust the compression rate based on the error induced during…

Machine Learning · Computer Science 2023-07-21 Enayat Ullah , Christopher A. Choquette-Choo , Peter Kairouz , Sewoong Oh

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

Federated learning is a distributed learning technique that allows training a global model with the participation of different data owners without the need to share raw data. This architecture is orchestrated by a central server that…

Federated learning (FL) enables edge devices to collaboratively train machine learning models, with model communication replacing direct data uploading. While over-the-air model aggregation improves communication efficiency, uploading…

Information Theory · Computer Science 2024-10-28 Hang Liu , Jia Yan , Ying-Jun Angela Zhang

Federated learning (FL) combined with differential privacy (DP) offers machine learning (ML) training with distributed devices and with a formal privacy guarantee. With a large population of devices, FL with DP produces a performant model…

Machine Learning · Computer Science 2023-07-17 Tatsuki Koga , Congzheng Song , Martin Pelikan , Mona Chitnis

Federated learning is a privacy-preserving training method which consists of training from a plurality of clients but without sharing their confidential data. However, previous work on federated learning do not explore suitable neural…

Machine Learning · Computer Science 2023-11-16 Shuhei Nitta , Taiji Suzuki , Albert Rodríguez Mulet , Atsushi Yaguchi , Ryusuke Hirai

We propose an algorithm for the adaptation of the learning rate for stochastic gradient descent (SGD) that avoids the need for validation set use. The idea for the adaptiveness comes from the technique of extrapolation: to get an estimate…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Antti Honkela

Federated learning(FL) is an emerging distributed learning paradigm with default client privacy because clients can keep sensitive data on their devices and only share local training parameter updates with the federated server. However,…

Machine Learning · Computer Science 2021-07-05 Wenqi Wei , Ling Liu , Yanzhao Wu , Gong Su , Arun Iyengar

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the…

Machine Learning · Computer Science 2019-10-16 Frederik Harder , Jonas Köhler , Max Welling , Mijung Park

Survival analysis or time-to-event analysis aims to model and predict the time it takes for an event of interest to happen in a population or an individual. In the medical context this event might be the time of dying, metastasis,…

Machine Learning · Computer Science 2022-02-09 Shadi Rahimian , Raouf Kerkouche , Ina Kurth , Mario Fritz

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

Learning from data owned by several parties, as in federated learning, raises challenges regarding the privacy guarantees provided to participants and the correctness of the computation in the presence of malicious parties. We tackle these…

Cryptography and Security · Computer Science 2022-10-31 César Sabater , Aurélien Bellet , Jan Ramon