English
Related papers

Related papers: Private Federated Learning with Autotuned Compress…

200 papers

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Large language models (LLMs) have driven profound transformations in wireless networks. However, within wireless environments, the training of LLMs faces significant challenges related to security and privacy. Federated Learning (FL), with…

Machine Learning · Computer Science 2025-06-17 Feibo Jiang , Li Dong , Siwei Tu , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Dusit Niyato

Federated learning facilitates the collaborative training of models without the sharing of raw data. However, recent attacks demonstrate that simply maintaining data locality during training processes does not provide sufficient privacy…

Machine Learning · Computer Science 2019-08-16 Stacey Truex , Nathalie Baracaldo , Ali Anwar , Thomas Steinke , Heiko Ludwig , Rui Zhang , Yi Zhou

Terabytes of data are collected by wind turbine manufacturers from their fleets every day. And yet, a lack of data access and sharing impedes exploiting the full potential of the data. We present a distributed machine learning approach that…

Machine Learning · Computer Science 2023-09-18 Lorin Jenkel , Stefan Jonas , Angela Meyer

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Storage-efficient privacy-preserving learning is crucial due to increasing amounts of sensitive user data required for modern learning tasks. We propose a framework for reducing the storage cost of user data while at the same time providing…

Information Theory · Computer Science 2023-03-23 Berivan Isik , Tsachy Weissman

Federated learning can be used to train machine learning models on the edge on local data that never leave devices, providing privacy by default. This presents a challenge pertaining to the communication and computation costs associated…

Machine Learning · Computer Science 2021-10-08 Dhruv Guliani , Lillian Zhou , Changwan Ryu , Tien-Ju Yang , Harry Zhang , Yonghui Xiao , Francoise Beaufays , Giovanni Motta

Gradient inversion attack enables recovery of training samples from model gradients in federated learning (FL), and constitutes a serious threat to data privacy. To mitigate this vulnerability, prior work proposed both principled defenses…

Machine Learning · Computer Science 2023-06-13 Ruihan Wu , Xiangyu Chen , Chuan Guo , Kilian Q. Weinberger

The longstanding goals of federated learning (FL) require rigorous privacy guarantees and low communication overhead while holding a relatively high model accuracy. However, simultaneously achieving all the goals is extremely challenging.…

Machine Learning · Computer Science 2021-06-02 He Yang

Federated Learning (FL) provides a decentralized machine learning approach, where multiple devices or servers collaboratively train a model without sharing their raw data, thus enabling data privacy. This approach has gained significant…

Machine Learning · Computer Science 2025-02-17 Mahad Ali , Curtis Lisle , Patrick W. Moore , Tammer Barkouki , Brian J. Kirkwood , Laura J. Brattain

Federated learning is a method used in machine learning to allow multiple devices to work together on a model without sharing their private data. Each participant keeps their private data on their system and trains a local model and only…

Cryptography and Security · Computer Science 2025-04-07 Feiran Yang

Personalized federated learning (FL) facilitates collaborations between multiple clients to learn personalized models without sharing private data. The mechanism mitigates the statistical heterogeneity commonly encountered in the system,…

Machine Learning · Computer Science 2022-09-23 Zichen Ma , Yu Lu , Wenye Li , Shuguang Cui

Federated Learning (FL) is a distributed machine learning (ML) paradigm that enables multiple parties to jointly re-train a shared model without sharing their data with any other parties, offering advantages in both scale and privacy. We…

Machine Learning · Computer Science 2019-12-17 Daniel Peterson , Pallika Kanani , Virendra J. Marathe

We propose Compressed Vertical Federated Learning (C-VFL) for communication-efficient training on vertically partitioned data. In C-VFL, a server and multiple parties collaboratively train a model on their respective features utilizing…

Machine Learning · Computer Science 2023-03-30 Timothy Castiglia , Anirban Das , Shiqiang Wang , Stacy Patterson

Federated learning is a promising framework for learning over decentralized data spanning multiple regions. This approach avoids expensive central training data aggregation cost and can improve privacy because distributed sites do not have…

Machine Learning · Computer Science 2021-01-01 Beomyeol Jeon , S. M. Ferdous , Muntasir Raihan Rahman , Anwar Walid

In this paper, we address the problem of privacy-preserving hyperparameter (HP) tuning for cross-silo federated learning (FL). We first perform a comprehensive measurement study that benchmarks various HP strategies suitable for FL. Our…

Cryptography and Security · Computer Science 2024-05-24 Natalija Mitic , Apostolos Pyrgelis , Sinem Sav

Federated learning (FL) is an emerging paradigm for training deep neural networks (DNNs) in distributed manners. Current FL approaches all suffer from high communication overhead and information leakage. In this work, we present a federated…

Machine Learning · Computer Science 2023-11-10 Guangchen Lan

Federated learning (FL) is a popular paradigm for collaborative training which avoids direct data exposure between clients. However, data privacy issues still remain: FL-trained large language models are capable of memorizing and completing…

Machine Learning · Computer Science 2026-03-10 Thierry Bossy , Julien Vignoud , Tahseen Rabbani , Juan R. Troncoso Pastoriza , Martin Jaggi

The performance of federated learning systems is bottlenecked by communication costs and training variance. The communication overhead problem is usually addressed by three communication-reduction techniques, namely, model compression,…

Machine Learning · Computer Science 2021-02-01 Nima Mohammadi , Jianan Bai , Qiang Fan , Yifei Song , Yang Yi , Lingjia Liu