中文
相关论文

相关论文: No Peek: A Survey of private distributed deep lear…

200 篇论文

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

机器学习 · 计算机科学 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

In this work, we carry out the first, in-depth, privacy analysis of Decentralized Learning -- a collaborative machine learning framework aimed at addressing the main limitations of federated learning. We introduce a suite of novel attacks…

密码学与安全 · 计算机科学 2023-11-13 Dario Pasquini , Mathilde Raynal , Carmela Troncoso

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

机器学习 · 计算机科学 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Distributed (or Federated) learning enables users to train machine learning models on their very own devices, while they share only the gradients of their models usually in a differentially private way (utility loss). Although such a…

机器学习 · 计算机科学 2023-02-28 Ioannis Arapakis , Panagiotis Papadopoulos , Kleomenis Katevas , Diego Perino

In many real-world applications of machine learning, data are distributed across many clients and cannot leave the devices they are stored on. Furthermore, each client's data, computational resources and communication constraints may be…

Federated Learning is a distributed machine-learning environment that allows clients to learn collaboratively without sharing private data. This is accomplished by exchanging parameters. However, the differences in data distributions and…

机器学习 · 计算机科学 2023-03-17 Kuang Hangdong , Mi Bo

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

机器学习 · 计算机科学 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

The proliferation of deep learning applications in healthcare calls for data aggregation across various institutions, a practice often associated with significant privacy concerns. This concern intensifies in medical image analysis, where…

机器学习 · 计算机科学 2023-07-03 Kishore Babu Nampalle , Pradeep Singh , Uppala Vivek Narayan , Balasubramanian Raman

Deep learning with medical data often requires larger samples sizes than are available at single providers. While data sharing among institutions is desirable to train more accurate and sophisticated models, it can lead to severe privacy…

机器学习 · 计算机科学 2018-12-05 Brett K. Beaulieu-Jones , William Yuan , Samuel G. Finlayson , Zhiwei Steven Wu

Federated learning facilitates the collaborative training of models without the sharing of raw data. However, recent attacks demonstrate that simply maintaining data locality during training processes does not provide sufficient privacy…

机器学习 · 计算机科学 2019-08-16 Stacey Truex , Nathalie Baracaldo , Ali Anwar , Thomas Steinke , Heiko Ludwig , Rui Zhang , Yi Zhou

Split learning is a distributed training framework that allows multiple parties to jointly train a machine learning model over vertically partitioned data (partitioned by attributes). The idea is that only intermediate computation results,…

机器学习 · 计算机科学 2022-03-07 Xin Yang , Jiankai Sun , Yuanshun Yao , Junyuan Xie , Chong Wang

Federated Learning (FL) represents a significant advancement in distributed machine learning, enabling multiple participants to collaboratively train models without sharing raw data. This decentralized approach enhances privacy by keeping…

密码学与安全 · 计算机科学 2025-02-10 Jaydip Sen , Hetvi Waghela , Sneha Rakshit

Federated learning is emerging as a machine learning technique that trains a model across multiple decentralized parties. It is renowned for preserving privacy as the data never leaves the computational devices, and recent approaches…

机器学习 · 计算机科学 2021-06-25 Yuchen Li , Yifan Bao , Liyao Xiang , Junhan Liu , Cen Chen , Li Wang , Xinbing Wang

Distributed deep learning frameworks such as split learning provide great benefits with regards to the computational cost of training deep neural networks and the privacy-aware utilization of the collective data of a group of data-holders.…

密码学与安全 · 计算机科学 2022-09-19 Ege Erdogan , Alptekin Kupcu , A. Ercument Cicek

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

机器学习 · 计算机科学 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

机器学习 · 计算机科学 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

This paper presents a holistic approach to gradient leakage resilient distributed Stochastic Gradient Descent (SGD). First, we analyze two types of strategies for privacy-enhanced federated learning: (i) gradient pruning with random…

机器学习 · 计算机科学 2023-05-12 Wenqi Wei , Ling Liu , Jingya Zhou , Ka-Ho Chow , Yanzhao Wu

Federated Learning (FL) enables collaborative model training while preserving data privacy by keeping raw data locally stored on client devices, preventing access from other clients or the central server. However, recent studies reveal that…

密码学与安全 · 计算机科学 2025-09-26 Ren-Yi Huang , Dumindu Samaraweera , Prashant Shekhar , J. Morris Chang

Privacy-preserving federated learning enables a population of distributed clients to jointly learn a shared model while keeping client training data private, even from an untrusted server. Prior works do not provide efficient solutions that…

密码学与安全 · 计算机科学 2022-02-22 David Byrd , Vaikkunth Mugunthan , Antigoni Polychroniadou , Tucker Hybinette Balch

Federated learning (FL) is a distributed machine learning strategy that enables participants to collaborate and train a shared model without sharing their individual datasets. Privacy and fairness are crucial considerations in FL. While FL…

机器学习 · 计算机科学 2023-05-24 Ayush K. Varshney , Sonakshi Garg , Arka Ghosh , Sargam Gupta