English
Related papers

Related papers: Unified Privacy Guarantees for Decentralized Learn…

200 papers

Federated learning with differential privacy, or private federated learning, provides a strategy to train machine learning models while respecting users' privacy. However, differential privacy can disproportionately degrade the performance…

Machine Learning · Computer Science 2022-04-18 Borja Rodríguez-Gálvez , Filip Granqvist , Rogier van Dalen , Matt Seigel

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations…

Machine Learning · Statistics 2019-04-23 Hafiz Imtiaz , Anand D. Sarwate

Many real-world networks are inherently decentralized. For example, in social networks, each user maintains a local view of a social graph, such as a list of friends and her profile. It is typical to collect these local views of social…

Machine Learning · Computer Science 2022-01-25 Wanyu Lin , Baochun Li , Cong Wang

Federated Learning (FL) allows multiple participants to train machine learning models collaboratively by keeping their datasets local while only exchanging model updates. Alas, this is not necessarily free from privacy and robustness…

Cryptography and Security · Computer Science 2022-05-30 Mohammad Naseri , Jamie Hayes , Emiliano De Cristofaro

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

Federated learning (FL) enables multiple clients to collaboratively learn a shared model without sharing their individual data. Concerns about utility, privacy, and training efficiency in FL have garnered significant research attention.…

Machine Learning · Computer Science 2024-01-30 Hanlin Gu , Xinyuan Zhao , Gongxi Zhu , Yuxing Han , Yan Kang , Lixin Fan , Qiang Yang

Decentralized learning offers privacy and communication efficiency when data are naturally distributed among agents communicating over an underlying graph. Motivated by overparameterized learning settings, in which models are trained to…

Machine Learning · Computer Science 2023-03-28 Hossein Taheri , Christos Thrampoulidis

Machine learning models are often trained on sensitive data (e.g., medical records and race/gender) that is distributed across different "silos" (e.g., hospitals). These federated learning models may then be used to make consequential…

Machine Learning · Computer Science 2024-11-13 Devansh Gupta , A. S. Poornash , Andrew Lowy , Meisam Razaviyayn

Privacy concerns arise as sensitive data proliferate. Despite decentralized federated learning (DFL) aggregating gradients from neighbors to avoid direct data transmission, it still poses indirect data leaks from the transmitted gradients.…

Machine Learning · Computer Science 2025-02-05 Xiaoye Miao , Bin Li , Yanzhang , Xinkui Zhao , Yangyang Wu

Federated learning(FL) is an emerging distributed learning paradigm with default client privacy because clients can keep sensitive data on their devices and only share local training parameter updates with the federated server. However,…

Machine Learning · Computer Science 2021-07-05 Wenqi Wei , Ling Liu , Yanzhao Wu , Gong Su , Arun Iyengar

Federated learning (FL), as a type of distributed machine learning, is capable of significantly preserving client's private data from being shared among different parties. Nevertheless, private information can still be divulged by analyzing…

Machine Learning · Computer Science 2024-02-06 Adrien Banse , Jan Kreischer , Xavier Oliva i Jürgens

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for discovery of hidden semantic architecture of text datasets, and plays a fundamental role in many machine learning applications. However, like many other machine…

Machine Learning · Computer Science 2019-07-02 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Xinyu Yang

While the application of differential privacy (DP) has been well-studied in cross-device federated learning (FL), there is a lack of work considering DP and its implications for cross-silo FL, a setting characterized by a limited number of…

Machine Learning · Computer Science 2022-10-18 Ziyu Liu , Shengyuan Hu , Zhiwei Steven Wu , Virginia Smith

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Federated Learning (FL) is emerging as a promising paradigm of privacy-preserving machine learning, which trains an algorithm across multiple clients without exchanging their data samples. Recent works highlighted several privacy and…

Cryptography and Security · Computer Science 2021-06-15 Yaowei Han , Yang Cao , Masatoshi Yoshikawa

Federated Learning (FL) has become a key method for preserving data privacy in Internet of Things (IoT) environments, as it trains Machine Learning (ML) models locally while transmitting only model updates. Despite this design, FL remains…

Machine Learning · Computer Science 2025-03-25 Fardin Jalil Piran , Zhiling Chen , Mohsen Imani , Farhad Imani

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Wider coverage and a better solution to a latency reduction in 5G necessitate its combination with multi-access edge computing (MEC) technology. Decentralized deep learning (DDL) such as federated learning and swarm learning as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-23 Yuwei Sun , Hideya Ochiai , Hiroshi Esaki