English
Related papers

Related papers: Improved Differential Privacy for SGD via Optimal …

200 papers

Decentralized Learning (DL) enables users to collaboratively train models without sharing raw data by iteratively averaging local updates with neighbors in a network graph. This setting is increasingly popular for its scalability and its…

Machine Learning · Computer Science 2026-03-02 Aurélien Bellet , Edwige Cyffers , Davide Frey , Romaric Gaudel , Dimitri Lerévérend , François Taïani

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

Federated learning with differential privacy, or private federated learning, provides a strategy to train machine learning models while respecting users' privacy. However, differential privacy can disproportionately degrade the performance…

Machine Learning · Computer Science 2022-04-18 Borja Rodríguez-Gálvez , Filip Granqvist , Rogier van Dalen , Matt Seigel

Federated Learning (FL) is a distributed machine learning paradigm based on protecting data privacy of devices, which however, can still be broken by gradient leakage attack via parameter inversion techniques. Differential privacy (DP)…

Machine Learning · Computer Science 2025-05-27 Pengcheng Sun , Erwu Liu , Wei Ni , Rui Wang , Yuanzhe Geng , Lijuan Lai , Abbas Jamalipour

Tabular generative adversarial networks (TGAN) have recently emerged to cater to the need of synthesizing tabular data -- the most widely used data format. While synthetic tabular data offers the advantage of complying with privacy…

Machine Learning · Computer Science 2021-08-03 Aditya Kunar , Robert Birke , Zilong Zhao , Lydia Chen

Despite recent progress in enhancing the privacy of federated learning (FL) via differential privacy (DP), the trade-off of DP between privacy protection and performance is still underexplored for real-world medical scenario. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Meirui Jiang , Yuan Zhong , Anjie Le , Xiaoxiao Li , Qi Dou

Building a recommendation system involves analyzing user data, which can potentially leak sensitive information about users. Anonymizing user data is often not sufficient for preserving user privacy. Motivated by this, we propose a…

Information Retrieval · Computer Science 2023-04-19 Sohan Salahuddin Mugdho , Hafiz Imtiaz

Federated learning is a distributed learning setting where the main aim is to train machine learning models without having to share raw data but only what is required for learning. To guarantee training data privacy and high-utility models,…

Machine Learning · Computer Science 2025-03-26 Mikko A. Heikkilä

Federated learning (FL) has emerged as a privacy solution for collaborative distributed learning where clients train AI models directly on their devices instead of sharing their data with a centralized (potentially adversarial) server.…

Machine Learning · Computer Science 2022-09-08 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

Differentially-private histograms have emerged as a key tool for location privacy. While past mechanisms have included theoretical & experimental analysis, it has recently been observed that much of the existing literature does not fully…

Databases · Computer Science 2017-02-21 Maryam Fanaeepour , Benjamin I. P. Rubinstein

In differential privacy, $\textit{continual observation}$ refers to problems in which we wish to continuously release a function of a dataset that is revealed one element at a time. The challenge is to maintain a good approximation while…

Machine Learning · Computer Science 2025-03-07 Joel Daniel Andersson , Rasmus Pagh

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Distributed algorithms enable private Optimal Power Flow (OPF) computations by avoiding the need in sharing sensitive information localized in algorithms sub-problems. However, adversaries can still infer this information from the…

Optimization and Control · Mathematics 2020-03-23 Vladimir Dvorkin , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

Privacy noise may negate the benefits of using adaptive optimizers in differentially private model training. Prior works typically address this issue by using auxiliary information (e.g., public data) to boost the effectiveness of adaptive…

Machine Learning · Computer Science 2023-06-09 Tian Li , Manzil Zaheer , Ken Ziyu Liu , Sashank J. Reddi , H. Brendan McMahan , Virginia Smith

Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest…

Multiagent Systems · Computer Science 2023-10-23 Syed Eqbal Alam , Dhirendra Shukla , Shrisha Rao

Differential privacy (DP) has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping,…

Machine Learning · Computer Science 2025-06-03 Linzh Zhao , Aki Rehn , Mikko A. Heikkilä , Razane Tajeddine , Antti Honkela

Federated learning has emerged as a powerful framework for analysing distributed data, yet two challenges remain pivotal: heterogeneity across sites and privacy of local data. In this paper, we address both challenges within a federated…

Machine Learning · Computer Science 2026-04-07 Mengchu Li , Ye Tian , Yang Feng , Yi Yu

Distributed online stochastic optimization has received extensive attention in large-scale distributed learning and other related fields due to its unique advantage in processing streaming data. However, information exchange through the…

Optimization and Control · Mathematics 2026-05-29 Zhiguo Zhang , Cheng Kui , Qian Ma , Dongrui Wu